TrickySheep9

71 Questions, 428 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

383 × Eureka!

Questions 71
Answers 428

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

How To Update The Logging Level Of All Loggers In Clearml?

How to update the logging level of all loggers in clearml?

clearml

3 years ago

0 Votes

8 Answers

2K Views

0 Votes 8 Answers 2K Views

Is It Not Possible To Add Artifacts To A Completed Task?

Is it not possible to add artifacts to a completed task?

clearml

4 years ago

0 Votes

3 Answers

2K Views

0 Votes 3 Answers 2K Views

What Is Parent Task For A Dataset? When Does It Get Populated?

What is parent task for a dataset? When does it get populated?

clearml

4 years ago

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

Collecting Click Using Cached Click-8.0.1-Py3-None-Any.Whl (97 Kb)

Collecting click Using cached click-8.0.1-py3-none-any.whl (97 kB)And then: ERROR: typer 0.3.2 has requirement click<7.2.0,>=7.1.1, but you'll have click 8.0...

mlops

4 years ago

0 Votes

7 Answers

2K Views

0 Votes 7 Answers 2K Views

How Do People Generally Handle Moving From Experimental Mode With Notebooks And Then Running Pipelines For Production Training And Beyond?

How do people generally handle moving from experimental mode with notebooks and then running pipelines for production training and beyond?

clearml

4 years ago

0 Votes

29 Answers

2K Views

0 Votes 29 Answers 2K Views

Getting This Error At

Getting this error at task.execute_remotely()

clearml

4 years ago

0 Votes

17 Answers

2K Views

0 Votes 17 Answers 2K Views

Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So

Is it possible to increase the polling interval for k8s glue? Currently it is 5 seconds I believe. Would adding an argument for it help? Can do a PR if so

clearml

4 years ago

0 Votes

7 Answers

2K Views

0 Votes 7 Answers 2K Views

My Nth Question For The Day

My nth question for the day 🙂 What’s the general pattern for running a pipeline - train model, evaluate metrics and publish the model if satisfactory (based...

clearml

4 years ago

0 Votes

9 Answers

2K Views

0 Votes 9 Answers 2K Views

When Using Docker Mode (And Specifically K8S Glue), What Are The Options For Caching? One Option Is Definitely Having A Base Image That Has The Things Needed. Anything Else? Thanks!

When using docker mode (and specifically k8s glue), what are the options for caching? One option is definitely having a base image that has the things needed...

clearml

4 years ago

0 Votes

17 Answers

2K Views

0 Votes 17 Answers 2K Views

Is It Possible To Schedule Pipelines On Events Like Dataset Update?

Is it possible to schedule pipelines on events like dataset update?

clearml

4 years ago

0 Votes

0 Answers

2K Views

0 Votes 0 Answers 2K Views

@AgitatedDove14 - similarly seeing some difference in way packages are installed. How does clearml agent cache packages? having issues with Click 7 vs 8.

AgitatedDove14 - similarly seeing some difference in way packages are installed. How does clearml agent cache packages? having issues with Click 7 vs 8.

mlops

4 years ago

0 Votes

27 Answers

2K Views

0 Votes 27 Answers 2K Views

Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

Playing around with HPO for first time. I am giving this as hyperparameter: DiscreteParameterRange("General/num_iterations", values=[10, 20, 30]), Is it expe...

clearml

4 years ago

0 Votes

30 Answers

2K Views

0 Votes 30 Answers 2K Views

Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

Can someone help me with deploying this example model (from triton inference server) deployed in clearml-serving? Too many random errors for me to figure it ...

clearml

4 years ago

0 Votes

19 Answers

2K Views

0 Votes 19 Answers 2K Views

I Saw Some Talk Of Clearml + Kedro On Reddit. Is That A Good Approach?

I saw some talk of ClearML + Kedro on reddit. Is that a good approach?

clearml

4 years ago

0 Votes

12 Answers

2K Views

0 Votes 12 Answers 2K Views

Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

Has anyone done this exact use case - updates to datasets triggering pipelines?

clearml

4 years ago

0 Votes

9 Answers

2K Views

0 Votes 9 Answers 2K Views

Is There An Efficient Way To Query All Unique Models (Ie Excluding Versions) In A Project?

Is there an efficient way to query ALL unique models (ie excluding versions) in a project?

clearml

4 years ago

0 Votes

3 Answers

2K Views

0 Votes 3 Answers 2K Views

Is There A Way I Can Create A Dataset As Part Of A Pipeline And Be Able To See That This Dataset Came From This Pipeline / Task ?

Is there a way I can create a dataset as part of a pipeline and be able to see that this dataset came from this pipeline / task ?

clearml

4 years ago

0 Votes

3 Answers

2K Views

0 Votes 3 Answers 2K Views

Any Specific Reason For Modelling Experiments As Separate Tasks Rather Than A Single Entity With Multiple Runs?

Any specific reason for modelling experiments as separate tasks rather than a single entity with multiple runs?

clearml

4 years ago

0 Votes

10 Answers

2K Views

0 Votes 10 Answers 2K Views

Does K8S Glue Support Running Service Agent? Slightly Confused Here

Does k8s glue support running service agent? Slightly confused here

clearml

4 years ago

0 Votes

4 Answers

2K Views

0 Votes 4 Answers 2K Views

I Might Be Missing Something, But Is There No Way To Clear All Tags Or Remove A Tag In A Task? I Only See A Add_Tags()

I might be missing something, but is there no way to clear all tags or remove a tag in a Task? I only see a add_tags()

clearml

4 years ago

0 Votes

2 Answers

2K Views

0 Votes 2 Answers 2K Views

The

The execute_jupyter_notebook_server.py link in https://allegro.ai/clearml/docs/docs/examples/services/jupyter-service/execute_jupyter_notebook_server.html is...

clearml

4 years ago

0 Votes

3 Answers

2K Views

0 Votes 3 Answers 2K Views

Sorry If This Is Addressed In Docs Somewhere - Does An Agent Map To One Worker (1:1) All The Time? Can I Have Multiple Workers In An Agent? Does Docker Mode Enable Multiple Workers Per Agent?

Sorry if this is addressed in docs somewhere - Does an agent map to one worker (1:1) all the time? Can I have multiple workers in an agent? Does docker mode ...

mlops

4 years ago

0 Votes

0 Answers

2K Views

0 Votes 0 Answers 2K Views

Can I Do These From A Notebook?

Can I do these from a notebook? https://github.com/allegroai/clearml/blob/master/examples/pipeline/step2_data_processing.py

clearml

4 years ago

0 Votes

4 Answers

2K Views

0 Votes 4 Answers 2K Views

Is It Not Possible To Fire And Forget A Pipeline? In This Example, What’S The Step To Just Trigger A Pipeline Without Waiting? Without The Pipe.Wait() I Don’T See The Stages Running

Is it not possible to fire and forget a pipeline? In this example, what’s the step to just trigger a pipeline without waiting? Without the pipe.wait() I don’...

clearml

4 years ago

0 Votes

8 Answers

2K Views

0 Votes 8 Answers 2K Views

Is It Possible To Do Additional Setup (The

Is it possible to do additional setup (the extra_bash_init_script , container_bash_script etc per task? Say a task requires a system package, install it befo...

clearml

4 years ago

0 Votes

12 Answers

2K Views

0 Votes 12 Answers 2K Views

Any Info On The Lifecycle Of Datasets Downloaded To $Home/.Clearml/Cache/Storage_Manager/Datasets Via Get_Local_Copy I Have A Task Running And I Was Watching The Above Path And Datasets Were Being Downloaded And Then They Are All Removed And For A Partic

Any info on the lifecycle of datasets downloaded to $HOME/.clearml/cache/storage_manager/datasets via get_local_copy I have a task running and I was watching...

clearml

4 years ago

0 Votes

2 Answers

2K Views

0 Votes 2 Answers 2K Views

Any Ideas Of Using Label Studio With Clearml Datasets - Base Dataset, Load To Label Studio, Annotate, Child Annotated Dataset Is The Kind Of Flow

Any ideas of using Label Studio with Clearml Datasets - base dataset, load to label studio, annotate, child annotated dataset is the kind of flow

clearml

4 years ago

0 Votes

14 Answers

2K Views

0 Votes 14 Answers 2K Views

Hi Folks Any Info On When The Helm Chart Will Be Updated For 1.0.1 ?

Hi folks any info on when the helm chart will be updated for 1.0.1 ?

clearml

4 years ago

0 Votes

30 Answers

2K Views

0 Votes 30 Answers 2K Views

Is It Possible To Add A Callback For A Pipeline From A Step?

Is it possible to add a callback for a pipeline from a step?

clearml

4 years ago

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

Seeing This Error When Trying To Run A Monitor In Services Queue (Agentservices Running On Kubernetes): Am I Missing Some Configuration I Need To Add Over Defaults?

Seeing this error when trying to run a Monitor in services queue (agentservices running on Kubernetes): Am I missing some configuration I need to add over de...

clearml

4 years ago

Show more results

0 Is There A Way I Can Create A Dataset As Part Of A Pipeline And Be Able To See That This Dataset Came From This Pipeline / Task ?

Will try it out. Pretty impressed 🙂

4 years ago

0 Is There A Way I Can Create A Dataset As Part Of A Pipeline And Be Able To See That This Dataset Came From This Pipeline / Task ?

Ah…that’s great!

4 years ago

0 I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):

AgitatedDove14 - yeah wanted to see what’s happening before disabling as I wasn’t sure if this is what’s expected.

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

AgitatedDove14 - looks like the serving is doing the savemodel stuff?

https://github.com/allegroai/clearml-serving/blob/main/clearml_serving/serving_service.py#L554

4 years ago

0 I Saw Some Talk Of Clearml + Kedro On Reddit. Is That A Good Approach?

This actually ties well with the next version of pipelines we are working on

Is there a way to see a roadmap on such things AgitatedDove14 ?

4 years ago

0 Collecting Click Using Cached Click-8.0.1-Py3-None-Any.Whl (97 Kb)

Yeah but where’s the cache from? does it setup a pip cache anywhere?

4 years ago

0 Getting This Error At

Lot of time had passed though

4 years ago

0 When I Do Task.Init() And Then A Execute_Remotely(), The Task Is Being Aborted Rather Than Be In Draft. Am I Missing Something?

I don’t want to though. Will run it as part of a pipeline

4 years ago

0 Hi, We Noted That Using K8S Glue, There Are Some Situations Where The Task Cannot Be Registered As Error And Will Be Stuck At Pending. An Example Of One Situation Is When The Task Is Pulling A Docker Image That Doesn'T Exist. Is There A Way To Catch Such

Lot of us are averse to using git repo directly

4 years ago

0 Logger.Report_Table

Nothing. nothing apparent at least

4 years ago

0 When Using Something Like Pdf2Image Which Requires Poppler (Which Can Be Installed With Conda), How Can I Ensure That The Task Can Run On An Agent Correctly? As Of Now It Doesn’T Know About Poppler

Is there a good reference to get started with k8s glue?

4 years ago

0 The

Great, thanks

4 years ago

0 Does K8S Glue Support Running Service Agent? Slightly Confused Here

I guess the question is - I want to use services queue for running services, and I want to do it on k8s

4 years ago

0 Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So

Like it said, it works, but goes into the error loop

4 years ago

0 Getting This Error At

The console output in the UI says done but the pipeline is still “running”

4 years ago

0 Looking At Clearml-Serving - Two Questions - 1, What’S The Status Of The Project 2. How Does One Say How A Model Is Loaded And Served Etc? For Example, If I Have A Spacy Ner Model, I Need To Specify Some Custom Code Right?

Found the custom backend aspect of Triton - https://github.com/triton-inference-server/python_backend
Is that the right way?

4 years ago

0 What’S The Easiest Way To Update The Repo Url Alone For A Task? Need - In My Ci, The Url Used Is Https But I Need The Ssh Url To Be Used. I See That We Can Pass Repo To Task.Create But Not Task.Init

Ahhhh thanks!

4 years ago

0 Any Pointers On Running Gpu Tasks With K8S Glue?

I am seeing that it still picks up nvidia/cuda:10.1-cudnn7-runtime-ubuntu18.04

4 years ago

0 Clearml Server Deployment Uses Node Storage. If More Than One Node Is Labeled As App=Clearml, And You Redeploy Or Update Later, Then Clearml Server May Not Locate All Your Data.

Thanks!

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

Sorry, don’t get it

4 years ago

0 Does K8S Glue Support Running Service Agent? Slightly Confused Here

Yeah got it. Was mainly wondering if k8s glue was meant for this as well or not

4 years ago

0 When I Do Task.Init() And Then A Execute_Remotely(), The Task Is Being Aborted Rather Than Be In Draft. Am I Missing Something?

AgitatedDove14 - thoughts on this? I remember that it was Draft before, but maybe because it was in a notebook vs now I am running a script?

4 years ago

0 Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?

AgitatedDove14 sounds almost what might be needed, will give it a shot. Thanks, as always 🙂

3 years ago

AgitatedDove14 - on a similar note, using this is it possible to add to requirements of task with task_overrides?

4 years ago

0 Is There An Efficient Way To Query All Unique Models (Ie Excluding Versions) In A Project?

Yes I have multiple lines

4 years ago

0 After I Have Create A Task And Closed It In A Notebook, Any Activity Seems To Trigger Another Task. For Example:

Ah thanks for the info.

4 years ago

0 Are People Using Devcontainer + Clearml-Session?

Yeah mostly. With k8s glue going, want to finally look at clearml-session and how people are using it.

4 years ago

0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

create_task_from_functionI was looking at options to implement this just today, as part of the same remote debugging that I was talking of in this thread

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

no task.close()

4 years ago

0 Hi, I'M Trying To Understand If Clearml Supports My Usecase: I Generate My Own Data (Problem-Specific) And Generation Process Is Uploading A Parquet Dataset (In Fact, Parquet Contains Multiple Files Obv.) To S3. Is There A Way To "Register" The Dataset In

+1 to this question

4 years ago

Show more results