TrickySheep9

71 Questions, 428 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

383 × Eureka!

Answers 428

0 Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?

As in run a training experiment, then a test/validation experiment to choose best model etc etc and also have a human validate sample results via annotations all as part of a pipeline

3 years ago

0 Anyway To Make A Job Fail If The Required Python Version (3.7 Vs 3.8 For Example) Is Not Available In The Agent?

I would prefer controlled behavior than some available version being used. Here triggered a bunch of jobs that all went fine and even evaluations were fine and then when we triggered a inference deploy it failed

4 years ago

0 Off Topic - Is There A Slack / Discord Community For General Ml Discussions?

Thanks

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

Looks like Task.current_task() is indeed None in this case. Bit of log below where I print(Task.current_task()) as first step in the script

Environment setup completed successfully Starting Task Execution: None

4 years ago

0 Getting This Error At

Any idea why the Pipeline Controller is Running despite the task passing?

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

It completed after the max_job limit (10)

4 years ago

0 Hi, We Noted That Using K8S Glue, There Are Some Situations Where The Task Cannot Be Registered As Error And Will Be Stuck At Pending. An Example Of One Situation Is When The Task Is Pulling A Docker Image That Doesn'T Exist. Is There A Way To Catch Such

Awesome

4 years ago

0 Apart From Having Packages In Requirements.Txt, Does Clearml Expect Them To Be Actuall Installed To Add Them As Installed Packages For A Task?

irrespective of what I actually have installed when running the script?

4 years ago

0 Apart From Having Packages In Requirements.Txt, Does Clearml Expect Them To Be Actuall Installed To Add Them As Installed Packages For A Task?

Ok i did a pip install -r requirements.txt and NOW it picks them up correctly

4 years ago

0 I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):

Can you point me at relevant code in ClearML for the autoconnect so that I can understand exactly what's happening

4 years ago

0 Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So

Nope, that doesn’t seem to be it. Will debug a bit more.

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

Essentially - 1. run a task normally. 2. clone 3. edit to have only those two lines.

Question - since this is a task, why is Task.currnet_task() None?

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

But that itself is running in a task right?

4 years ago

0 I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?

pipeline code itself is pretty standard

4 years ago

0 Is There An Efficient Way To Query All Unique Models (Ie Excluding Versions) In A Project?

And anyway once a model is published can’t update it right? Which means there will be atleast multiple published models entries of same model over time?

4 years ago

0 Hi Folks Any Info On When The Helm Chart Will Be Updated For 1.0.1 ?

BTW AgitatedDove14 - that 1.0.0 is the helm chart version, not necessarily the version of the app the chart deploys

4 years ago

0 Hi

Thanks AnxiousSeal95

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

Will debug a bit more and see what’s up

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

just that the task itself is still Running state

4 years ago

0 Hi Folks Any Info On When The Helm Chart Will Be Updated For 1.0.1 ?

The chart installs 0.17

4 years ago

0 Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So

Planning to exec into the container and run it in a loop and see what happens

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

How can a task running like this know its own project name?

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

It’s essentially this now:

from clearml import Task print(Task.current_task())

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

Yes, I have no experience with triton does it do lazy loading? Was wondering how it can handle 10s, 100s of models. If we load balance across a set of these engine containers with say 100 models and all of these models get traffic but distribution is not even, each of those engine container will load all those 100 models?

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

Yeah

4 years ago

0 After I Have Create A Task And Closed It In A Notebook, Any Activity Seems To Trigger Another Task. For Example:

Thanks AgitatedDove14 . Have removed Task.current_task() usage for this now. Think I can do without it

4 years ago

0 Clearml-Serving Will Automatically Serve Published Models From Your Clearml Model Repository, So The First Step Is Getting A Model Into Your Clearml Model Repository.

Ok it’s not implemented right, that’s what I was asking

4 years ago

0 Hi Folks Any Info On When The Helm Chart Will Be Updated For 1.0.1 ?

Yeah meant the 1.0+ release as I don’t think the chart has been updated