ClearML FAQ | TrickySheep9

TrickySheep9

71 Questions, 428 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

0

Badges 1

383 × Eureka!

Answers 428

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

AgitatedDove14 - thanks for the quick reply. automation.Monitor is the abstraction i could use?

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

Thanks let me try playing with these!

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

Not able to understand what’s really happening in the links

4 years ago

0 Getting This Error At

Also the pipeline ran as per this example - https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_controller.py

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

The agent ip? Generally what’s the expected pattern to deploy and scale this for multiple models?

4 years ago

0 Sorry Folks Too Many Questions - If I Have A Project (And I Set The Output Uri In It While Creating, To A S3 Folder) How Can I Ensure That A Experiment (Task) That I Run On My Local Outputs The Model To The Uri?

AgitatedDove14 - added it in bucket_config.py and sdk.conf but somehow value is not being picked up

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

I am essentially creating a EphemeralDataset abstraction and creating controlled lifecycle for it such that the data is removed after a day in experiments. Additionally and optionally, data created during a step in a pipeline can be cleared once the pipeline completes

4 years ago

0 Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?

Something like this - https://aws.amazon.com/blogs/machine-learning/processing-pdf-documents-with-a-human-loop-using-amazon-textract-and-amazon-augmented-ai/

3 years ago

0 Clearml Server Deployment Uses Node Storage. If More Than One Node Is Labeled As App=Clearml, And You Redeploy Or Update Later, Then Clearml Server May Not Locate All Your Data.

in the repo whereas the docs are https://allegroai.github.io/clearml-server-helm/

4 years ago

0 Hello, I Was Wondering If

You might have to setup a service (systemd) etc

4 years ago

0 When Using Something Like Pdf2Image Which Requires Poppler (Which Can Be Installed With Conda), How Can I Ensure That The Task Can Run On An Agent Correctly? As Of Now It Doesn’T Know About Poppler

I guess this is a advantage with docker mode. Will try that out as well sometime.

4 years ago

0 Hi Folks Any Info On When The Helm Chart Will Be Updated For 1.0.1 ?

I can contribute as well as needed

4 years ago

0 This Verify Param To Decode Of Pyjwt Seems To Be Removed And In A Fresh Intallation We Are Seeing This Error:

Latest version was released 11 hours ago - https://github.com/jpadilla/pyjwt/releases/tag/2.2.0

4 years ago

0 How Does The Uncommitted Changes Stuff Work? Is It Only For Modified Changes And Not Untracked Files?

Ok, got it thanks. Would be cool to let it get untracked as well, especially if we want to as an option

4 years ago

0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

yeah

4 years ago

0 Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

Sorry if it was confusing. Was asking if people have setup pipelines automatically triggered on update to datasets

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

AgitatedDove14 - where does automation.controller.PipelineController fit in?

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

now if dataset1 is updated, i want process to update dataset2

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

Trying to understand these, maybe playing around will help

4 years ago

0 What’S The Easiest Way To Update The Repo Url Alone For A Task? Need - In My Ci, The Url Used Is Https But I Need The Ssh Url To Be Used. I See That We Can Pass Repo To Task.Create But Not Task.Init

I just want to change git remote like https://gitserver.com/path/to.git -> mailto:git@gitserver.com :path/to.git

4 years ago

0 Is It Not Possible To Add Artifacts To A Completed Task?

I was thinking such limitations will exist only for published

4 years ago

0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

When did this PipelineDecorator come. Looks interesting 🙂

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

You mean the job with the exact same arguments ?

Yes

4 years ago

0 I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?

From the code - it’s supposed to not cache if task override is different? I also have task_override that adds a version which changes each run

4 years ago

0 When Running An Optimization Task, It Says Warning Parameter Not Found But Works Anyway. I Guess It’S Because It’S Looking For General/Param But Ends Up Using It As Default While Creating Tasks Anyway. If Default Is General, Can We Do Away With This Warni

Or WARNING should be param not found, but using General/param etc

4 years ago

0 Sorry Folks Too Many Questions - If I Have A Project (And I Set The Output Uri In It While Creating, To A S3 Folder) How Can I Ensure That A Experiment (Task) That I Run On My Local Outputs The Model To The Uri?

He/Him 🙂

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

AgitatedDove14 - mean this - says name=None but text says default is General.

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

Sorry, don’t get it

4 years ago

0 Is It Not Possible To Fire And Forget A Pipeline? In This Example, What’S The Step To Just Trigger A Pipeline Without Waiting? Without The Pipe.Wait() I Don’T See The Stages Running

AgitatedDove14 - is my understanding right that we have to call pipe.wait() ?

4 years ago

0 After I Have Create A Task And Closed It In A Notebook, Any Activity Seems To Trigger Another Task. For Example:

Exact reproduction:

4 years ago

Show more results