CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 When Using A

Hi DangerousDragonfly8 , can you please elaborate on your use case? If you want only a single instance to exist at any time how do you expect to update it?

3 years ago

0 Should Dataset Triggers Also Be Activated If There Is No Trigger Condition Except Dataset_Project And A New Task Starts In That Project? Is This Expected Behavior?

Let me play with it a bit and see if I can find more 🙂

4 years ago

0 Should Dataset Triggers Also Be Activated If There Is No Trigger Condition Except Dataset_Project And A New Task Starts In That Project? Is This Expected Behavior?

Can you please provide a snippet of your implementation?

4 years ago

0 Hey Community, So I Am Facing An Issue Related To Passing Parameters. I Am Getting The Parameters From The Taskscheduler , Taskparameter.

Hi @<1533619725983027200:profile|BattyHedgehong22> , can you please elaborate on this? Can you add a snippet that reproduces this?

2 years ago

0 Hi All! I Want To Run An Agent With Gpu Support, So I Need Docker Mode. In My Environment, Which Is Quite Restricted, Only Podman Is Available For Managing Containers Due To Security Reasons. Is It Possible To Use Podman Instead Of Docker In Docker Mode?

Hi @<1874989039501709312:profile|LividDragonfly0> , podman is supported out of the box and is transparent, you can just run the agent with --docker command.

2 months ago

0 Hi, I Am Wondering Is There Anyway To Use Clearml Agent Without Setting Up The Environment, For Example, Do Not Enforce The Git Clone And Pip Install But Cd Some Dir And Activate An Environment?

Hi @<1654294834359308288:profile|DistressedCentipede23> , do you mean completely circumventing that basic function of the agent and simply pointing it to a specific script/env?

one year ago

0 Hi, I Am Wondering Is There Anyway To Use Clearml Agent Without Setting Up The Environment, For Example, Do Not Enforce The Git Clone And Pip Install But Cd Some Dir And Activate An Environment?

@<1654294834359308288:profile|DistressedCentipede23> , can you please elaborate on the exact workflow you want to build?

one year ago

0 How I Can Cache The Poetry And Pip Installations, On My Workers, So Every Worker And Trial That Is Running Inside A Container On My Worker, Doesn'T Need To Install Again And Use The Cache Of The Host (Worker Server)? I Need To Create A Docker Volume For T

Hi @<1820993257639776256:profile|DeepOwl31> , can you please elaborate on what your current setup is?

4 months ago

0 I Have A Question And I'M Not Sure If Anyone Is Clear On This. If I Want The Agent To Manage Dependencies Using Conda, And Install A New Environment Based On The Yaml File Output By

@<1718799873618219008:profile|FunnyPeacock68> , it appears that reading a yaml isn't supported. Currently only requirements.txt. I'd suggest opening a GitHub feature request for this capability!

one year ago

0 I Have A Question And I'M Not Sure If Anyone Is Clear On This. If I Want The Agent To Manage Dependencies Using Conda, And Install A New Environment Based On The Yaml File Output By

Hi @<1718799873618219008:profile|FunnyPeacock68> , you can set this up in clearml.conf of the running agent
None

one year ago

0 Is There Any Way Of Passing Additional Parameters To Pip In Clearml-Agent? For Example, When You Install

@<1601023807399661568:profile|PompousSpider11> , if you know it needs to be installed I guess you could even inject it as a bash script if running in docker mode or just have it already pre-installed. Regardless, clearml-agent will attempt to resolve torch installs.

2 years ago

0 Hello! I Need To Run Clearml Pipeline With Caching Of Steps. I Specify Cache_Executed_Step=True For Each Step, But My Steps Are Not Cached And Ended With The Status - Completed.

Hi @<1578555761724755968:profile|GrievingKoala83> , please provide a standalone code snippet. I mean a single stand alone piece of code that I can just run without modifications, even imports

7 months ago

0 Hey Guys! I'M Trying To Retrieve A Tile Of An Image (

Hi SmugSnake6 , can you add a small snippet to reproduce?

3 years ago

0 Hello Team, We Are Currently Utilizing A Self-Hosted Clearml For Various Projects. Our Aim Is To Implement Role-Based Access Control Across Projects. As I Understand, This Feature Is Presently Available Only On The Enterprise Plan. Is It Possible To Enab

Hi @<1696331935023894528:profile|BoredBee87> , role based access controls are available only in the Scale & Enterprise licenses. These licenses do support full on premise deployments. Besides role based access controls there are many other features available. I'd suggest contacting ClearML directly to hear about other options 🙂

one year ago

0 Hi

ShinyLobster84 , Hi 🙂

What do you think if there was an api to retrieve all the scalars as tables. Do you think it would be useful?

3 years ago

0 Is It Possible To Create A Task Using Task Cli Using A Python Entrypoint (Either Script Or Module) And Then Have The Task_Name Become Overridden By The Values Of Task.Init(Task_Name="Real_Task_Name") Inside The Python Script?

@<1774245260931633152:profile|GloriousGoldfish63> , you can simply use Task.set_name - None

I think this is what you're looking for

8 months ago

0 Hi, I'M Having Problems With The Installed Packages When Creating An Experiment. The Installed Packages Used To Be A List With The Versions Of All The Installed Packages In The Venv. However, Now I Get The Following:

MuddySquid7 , Yes! Reproduced like a charm. We're looking into it 🙂

3 years ago

0 Is Clearml-Agent Supports Pip Versions Up To 22.3.1? Should I Update The Pip Version In Clearml.Conf If Mine Is More Recent?

You can try 🙂 Should work

2 years ago

0 Hi, I'M Using Clearml Over Aws And I Can See That My Ec2 Instance Disk Space Is Filling Up Really Fast. I First Started With 100Gb Disk Space And Once It Filled Up I Increased The Size To 150Gb Which Is Soon To Be Filled Up As Well. I Wanted To Check If T

Where is most of the data concentrated?

3 years ago

0 Hey Guys Trying To Run A Task On An Agent Using Docker Mode (Machine Has Only Cpu) I Always Get This Error (No Matter The Docker- Image Im Using, I Tried Several): Docker: Error Response From Daemon: Failed To Create Shim: Oci Runtime Create Failed: Runc

Hi @<1544853695869489152:profile|NonchalantOx99> , can you run that docker with the docker run command?

2 years ago

0 Has Anyone Else Benchmarked Clearml? I'M Seeing Catastrophic Logging Overhead:

I tested how many resources ClearML consumes. The entire process of ClearML SDK consumes about 50mb of RAM memory on my side and it requires minimal amount of CPU.

Is it possible that your training steps are that inefficient?

8 months ago

0 Hi! We Are Trying To Upload Datasets To Clearml From Redshift. Is There Any Direct Integration Between With Redshift? We Would Like To Avoid Downloading The Whole Dataset And Uploading It Every Time. Thank You!

Hi @<1617693654191706112:profile|HelpfulMosquito8> , can you please elaborate? Did you self deploy on Redshift? I don't think it really matters. What is the workflow you're trying to achieve?

2 years ago

0 Hello Everyone, What Is The Behavior Of Clearml-Agent When Run In Docker Mode And The Container Crashes? To Me It Seems Like The Clearml-Agent Will Stop. In My Case I Memory-Limit The Container And It Seems To Crash, When Too Much Memory Is Used. However,

ReassuredTiger98 , Hi 🙂

Which version of clearml-agent are you using? Do you get the same result if you manually kill the docker container by force?

3 years ago

0 Hi All, What Is The Best Way To Monitor Failer Clearml Agent That Kill All Tasks In Queue?

I think you should monitor your tasks and see what's going on. Also an agent should be set up in a way that you know it will work and has all the required drivers etc..

2 years ago

0 Hi, I Am Trying To Save Task Artifacts On Gcs Bucket - I Have Configured The Project To Use The Bucket As “Default Output Destination” (In The Project Create Dialog) But The Artifacts Still Created Inside The File Server, Any Idea What Am I Missing?

Hi ApprehensiveSeahorse83 ,

Please try editing your Task.init() to the following Task.init(..., output_uri=True) please tell me if this helps 🙂

3 years ago

0 Hey Guys! I'M Saving My Datasets On Our Self-Hosted Clearml File-Server. However, When Deleting Them Through The Ui, It Doesn'T Delete Them On The Server. I Have To Go To

Hi SmugSnake6 , interesting point! Maybe open a Github issue to track this 🙂

3 years ago

0 Good Afternoon I Didn'T Find Any Mention In The Documentation Please Tell Me If It Is Possible To Implement “Move To Top” Through The Api, How Can This Be Done Through The Ui

Hi @<1523702932069945344:profile|CheerfulGorilla72> , it's possible. I see the web UI uses queues.move_task_to_front .
I suggest using the webUI as a reference together with developer tools 🙂

one year ago

0 Hi. I'M Using Clearml To Log My Experiments. During Training, I Load Files Using Torch.Load.Clearml Displays The Following Message:

SoreDragonfly16 You can disable this with the following argument in task.init() - auto_connect_frameworks=False for example:
task = Task.init(..., auto_connect_frameworks={'pytorch': False})You can refer to this documentation for further reading at this https://clear.ml/docs/latest/docs/references/sdk/task#taskinit 🙂

4 years ago

0 I Have The User/Pass Set Up On The

Also, you need to restart the agent between changes in the config

11 months ago

0 Hi Everyone, I Got Several Error Messages Like This When Trying To Upload Data On The Clearml Which We Self-Hosted. Do You Have Any Ideas?

Hi @<1638712150060961792:profile|SilkyCrocodile89> , it looks like a connectivity issue. Are you trying to upload data to the files server? Can you share the full log?

one year ago

Show more results