CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hey Everyone With Recent Changes In Dockerhub Policy, Very Soon We Will Lose Our Ability For Pull

Hi @<1523701842515595264:profile|PleasantOwl46> , I think its a docker hub limitation for non paying accounts pulling too many images and unrelated to ClearML. You can always host your own artifactory as well.

one year ago

0 Another Qn, Is Clearml-Data Analogous To A Feature-Store

ClearML has a built in model repository so together I think they make a "feature store" again, it really depends on your definition

3 years ago

0 Hello Guys, I Got This Error On My Pipeline Execution When Processing Data For Model Training. There Are About 10 Steps, But This Errors Occured When It Reaches Step 7

Hi MoodyCentipede68 ,

What version of ClearML / ClearML-Agent are you using? Is it a self hosted server or the SaaS?
Also, can you explain what step 7 was trying to do? Is it running locally or distributed?

3 years ago

0 Hi, I'Ve Run Into A Problem And Would Appreciate Some Help. I Installed Clearml Locally. When I Run A New Task On A Remote Server And In The Python Training Code I Set It To Only Train On One Gpu. Everything Works Fine And I See All The Scalars Automatica

What is the command you used to run the agent?

11 months ago

0 Dear Clearml Team! I Have Experiments Running With Your Tool, And Displaying Images In The "Debug Samples" Section. After Few Iteration, It Stopped Showing Images, And Showed A Broken Image Icon Saying "Unable To Load Image Binary%20Preds_Sample_0_0000005

BoredPigeon26 , are images from previous iterations still showing?

4 years ago

0 Hi Team, Are You Adding Support For More Dataframe Tools Such As Polars To The List For Metadata Displaying In The Ui?

Hi @<1882599179692281856:profile|FriendlyBluewhale89> , not sure what you mean by metadata displaying. Can you elaborate?

18 days ago

0 Hi, Can I Run A Single Hyperparameter Optimization Task With At Least 100 Experiments On Multiple Machines By Using Clearml-Agent And Queue?

Hi @<1664079296102141952:profile|DangerousStarfish38> , yes you can 🙂

one year ago

0 Hi, When I Start A New Task, In Execution Tab I See That By Default Log Level Set To Basic. Is It Possible To Change To, Lets Say, Debug Level? I Want To Catch More Information In Console While Training On Remote Worker.

Hi @<1555362936292118528:profile|AdventurousElephant3> , if you clone/reset the task, you can change the logging level to 'debug'

2 years ago

0 I Am Doing Port Forwarding Of Ports From Localhost Clearml Server In Ec2 Instance To The Ports In Laptop Locally. I Am Able To Login To The Server And Generate The Credentials But I Am Not Able To Create Task

Or when running something and uploading to a s3?

3 years ago

0 Hi, Does Anyone Know If There Is A Way To Have The Dataset Graph That Tells Us Which Dataset Was Created From Which Other Ones Without Setting The Previous Datasets As Parents? We Have Large Raw Datasets That Are Used To Create Several Smaller Ones, And I

Hi @<1523703397830627328:profile|CrookedMonkey33> , not sure I follow. Can you please elaborate more on the specific use case?

Currently you can add plots to the preview section of a dataset

one year ago

0 Hi Everyone, I'M New To Clearml And I Want To Run A Task On A Remote Host Inside A Docker Container. The Python Interpreter I Need To Use Is Located At

you set up 2 agent runs - one with docker and the other without. Each agent should be listening to a different queue. Makes sense?

2 years ago

0 Hey Guys! I'M Having Some Issues With Pytorch And Clearml. I Am Starting A New Task Using Task.Create And Setting Pytorch As A Requirement Under `Packages`. For Some Reason Pytorch With Cuda 12 Is Being Installed, But I Need Cuda 11. Do You Know How To Se

OK, then just try the docker image I suggested 🙂

one year ago

0 Hi All, Is There A Way To Configure Clearml On A Host Running Pytorch Training, But Not Having Access To The Clearml Server, So It Would Output Clearml Experiments On A S3 Bucket And, The Clearml Server To Have A Project Exclusively Listening To This Buck

Hi @<1772795696529805312:profile|LethalCoral80> , I think what you're looking for is the offline mode - None

11 months ago

0 Hi All, I Hope I'M In The Right Channel, We(

Are the previews large? Can you supply an example?

3 years ago

0 Hi There! I'M Getting An Error Whenever Trying To Queue Experiments Using Conda Package Manager That Require Python>=3.10. Locally (Non-Queued) The Training Runs Just Fine. In The Ui I See The The Following Console Output:

GreasyLeopard35 , what happens if you try to run the command it's (agent) trying to run yourself?

3 years ago

0 Hello, We Are Getting Following Timeout Errors During The Task Run:

It can be changed with this env var for the apiserver:
CLEARML__hosts__elastic__events__args__timeout=<new number>
Though the better handling could be either increase the elasticsearch capacity (memory and cpu) or decrease the load (send events in smaller batches)

2 years ago

0 What The Best Practice To Configure Clearml-Agent In The Way To Don’T Install Packages That Are Already Available Every Time? I Use Nvidia-Docker To Run The Train Script For Example. I Initialized Clearml-Agent Inside A Running Nvidia-Docker Container

None

one year ago

0 Hello, I Got This Error When Calling .Get_Local_Copy() From An Artifact Of A Task. The Artifact Contains Nested Folders And Image Files In There. What Are Possible Causes Of This? And How Can I Solve It?

Hi DeterminedOwl36 , are you sure the file is there? Can you access it via console?

2 years ago

0 Hi, I’M Running An Agent In K8S Using The Glue. I’M Trying To Set The Setup Shell Script To Install Some Packages Through Apt But I Don’T Think It Even Runs. I Dont See Anything In The Console Logs That Says It Does, At Least. Is There Anyway I Can Debug

Can you add a full log of an experiment?

one year ago

0 Hi I'M Using Clearml Datasets. How Do I Tell From The Clearml Ui Which Datasets Version Am I Using?

SubstantialElk6 , can you view the dataset in the UI? Can you please provide a screenshot so I can mark it down for you

4 years ago

0 Hey Everyone, We'Re Running A Remote Execution (K8S Agent) Clearml Pipeline From Jupyterhub, But When The Agent Prepares The Environment, It Installs A Different Version Of The Packages Specified In Our

I think this is what you're looking for - None

2 years ago

0 Hi All. In Self Hosted Clearml Suddenly Scalars Stopped To Be Shown In Scalars Tab. Any Ideas?

Just make sure you make regular backups

2 years ago

0 Hi All I Have A Question About The "Reports" Feature. I Followed The Steps Below. 1. Created Report At "Project Root" 2. Ran Api

Hi @<1567321746447536128:profile|EmaciatedCentipede72> , I would suggest checking what api calls the UI sends when doing work in the UI with reports. You can see it in the network section of developer tools (F12), filter by XHR for easier time reading 🙂

2 years ago

0 Hi, Is It Possible To Set Script Always Clone The Latest Commi From Branch?

Hi @<1523701260895653888:profile|QuaintJellyfish58> , yes it is. You can simply specify a branch 🙂

2 years ago

0 Hello, I Wanted To Test Out Clearml And Installed The 7.14.2 Helm Chart. The Deployment Looks Ok. I Can Access The Webui And Create Workspace Api Credentials. What I Can’T Do Is.

Looks like a network issue.

As a side note, I would suggest removing & revoking all credentials you've pasted here 🙂

9 months ago

0 Can I Use “Autoscaler” To Go From 0->1 Agent? I.E. 1 Queue For Tasks, Start 1 Machine, Process Everything To Completion, Then Shut Down?

Hi @<1607184400250834944:profile|MortifiedChimpanzee9> , yes 🙂
This is exactly how the autoscalers work. Scale from 0 to as many as needed and then back to 0

2 years ago

0 Hi All! I Want To Setup A Tool That I Can Use To Analyse Clearml Logs (Just User And Experiment Logs, I Am Not Doing Any Model Serving Yet). Is There An Api Endpoint That I Can Fetch Such Metrics? Metrics Like Number Of Active Users, Number Of Experiments

Hi @<1573119955400921088:profile|CloudyPelican46> , you can certainly do this. You can find all the related api calls here - None
I suggest opening developer tools (F12) and seeing what is sent in the UI to fetch the various metrics you're looking for

2 years ago

0 Hi All! I Want To Run An Agent With Gpu Support, So I Need Docker Mode. In My Environment, Which Is Quite Restricted, Only Podman Is Available For Managing Containers Due To Security Reasons. Is It Possible To Use Podman Instead Of Docker In Docker Mode?

Hi @<1874989039501709312:profile|LividDragonfly0> , podman is supported out of the box and is transparent, you can just run the agent with --docker command.

one month ago

0 Hi, I Was Wondering How Come My Api Calls Keeps Going Up While I'M Not Executing Any Tasks\Experiments? I Think It Is Related To The Fact That I Have A Worker That Is Running In The Background, And I Was Wondering How Many Api Calls A Worker Is Doing Per

worker by default checks the backend every 5 seconds for new tasks in the queue. While running a task I think it basically sends whatever api calls a regular local task sends

2 years ago

0 Hi All, I'M Running Dl Experiments On Top Of Mmdetection. The Experiments Are Deployed Remotely On A Dedicated Ec2 Instance Through

ResponsiveHedgehong88 , do you have an option to log into the machine and see the state or if there were any errors? Is there any chance it's running out of memory? The agent also keeps a local log, can you take a look there to see if there is any discrepancy?

3 years ago

Show more results