CostlyOstrich36

0 Questions, 4212 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4212

0 Hi, I'M Trying To Reduce My Team And My Api Calls When Training Models, We All Ready Added The Following Flags In Our Config File On Each Training Agent

Hi @<1523701295830011904:profile|CluelessFlamingo93> , I think you can also control the agent sampling rate (to sample queue every 10 or 20 seconds instead of 5 for example)

one year ago

0 Hi, I'M Trying To Reduce My Team And My Api Calls When Training Models, We All Ready Added The Following Flags In Our Config File On Each Training Agent

Hi @<1523701295830011904:profile|CluelessFlamingo93> , I would suggest leaving your details here:
None

one year ago

0 Hi Everyone, I Want To Clone A Git Repo With Clearml-Agent That Has To Following Url Format

Hi @<1523701868901961728:profile|ReassuredTiger98> , you can simply set up the token in clearml.conf of the agent so the agent will have the rights to clone. What do you think?

9 months ago

0 Hi, I Have A Question Regarding Optimization Task: I Want To Run A Standard Optimization Process And I Want To Tag All The Ran Tasks From The Optimization With A Common Tag And Also Set A Unique Tag For Each Task How Can I Do That?

Hi @<1643060807786827776:profile|WorriedPeacock92> , you mean like this?
None

one year ago

0 Once I'Ve Created A Dataset And Finalized/Published It, I Can'T Figure Out How To Associate It With A Task Such That It Shows Up In The Task Ui. Dataset.Get() Finds A Dataset, But It Doesn'T Show Up In The Task Ui. I Can Get Inputmodels And Outputmodels T

Hi @<1836213542399774720:profile|ConvincingDragonfly85> , I believe you're looking for the alias parameter of Dataset.get() - None

5 months ago

0 How Can I Search For Training Tasks That Use A Given Dataset? The Dataset Was Linked To The Task: After I Initialized The Task, I Called Dataset.Get(..., Alias="Training Examples") And So I See The Dataset'S Id In The Clearml Ui On The Task Hyperparamete

Hi @<1787653555927126016:profile|SoggyDuck67> , you can add it as column and then filter from there.
See related screenie 🙂

7 months ago

0 `I'M Attempting My First Project In Clearml And Have A Few Questions. I'M Migrating My Video Encoding Pipeline In Python3.12 To Clearml Using The Decorators.: @Pipelinedecorator.Pipeline( Name="Run Video Encoder Pipeline", Project="Video Encoder

Part of the docker compose, there is a container with a special agent that works specifically for managing services for the system, like the pipelines controllers

8 months ago

0 Hi

I'm afraid it's not supported right now.

The daemon agent on the machine will have to be started differently and monitored differently - you're welcome to add a PR though 🙂

one year ago

0 Hi, Is There A Way To Enqueue The Dataset

Hi EnormousCormorant39 ,

is there a way to enqueue the dataset

add

command on a worker

Can you please elaborate a bit on this? Do you want to create some sort of trigger action to add files to a dataset?

3 years ago

0 Hi

What about fetching the parent from the task info itself? It should be somewhere in task.data.

one year ago

0 Hi, After Installing Self Hosted Clearml Server, I'M Getting The Following Error In The Fileserver.Log File: [2024-11-14 08:37:28,289] [7] [Warning] [Urllib3.Connectionpool] Retrying (Retry(Total=237, Connect=1, Read=240, Redirect=240, Status=240)) After

Looks like you're having issues connecting to the server through the SDK. Are you able to access the webUI? Is it a self hosted server?

12 months ago

0 Hello, Is There A Function In The Sdk To List All Projects ? Also, Are Projects Shared Between Datasets And Experiments ?

Hi @<1644147961996775424:profile|HurtStarfish47> , you can do that via the API
None
None

Regarding projects, think of them as folders hosting datasets and experiments

one year ago

0 Hi Is It Possible To Use The Pythonic Remote-Execution Command Task.Execute_Remotely(Queue_Name="Default") And Have The Remote Job Select Requirements From A .Txt File Or Uv.Lock File While Ignoring The Local Environment Packages?

Hi @<1523708920831414272:profile|SuperficialDolphin93> , I think this is what you're looking for
None

8 months ago

0 Hi, The Restful Api

You can use scroll_id to scroll through the tasks. When you call tasks.get_all you will get a scroll_id back. Use that scroll_id in the following calls to go through the entire database. Considering you have only 2k tasks, you can cover this in 4 scrolls 🙂

3 years ago

0 Hi, Does Anyone Have A Preferred Way To Access The Ebs Device When Running The Autoscaler? I Tried Mounting It Via The Init Script, Which Didn'T Work. I Now Have A Hack By Giving Elevated Access To Docker On Task-Level And Then Mounting Via Python. But Ov

Hi @<1806135344731525120:profile|GrumpyDog7> , I would personally go for the init script route. What part didn't work for you?

7 months ago

From where did you get the 9008/9080/9081 ports? I don't see them in the docker compose anywhere

8 months ago

The controller simply runs the logic of the pipeline and requires minimal resources. All the heavy computation happens on the nodes/machines running the steps

8 months ago

0 Is There Anyway To Change The Workspace Owner In The Free Tier Of The Hosted Web App? I Signed Up For The Free Tier, Invited Two Of My Colleagues And We Now Want To Upgrade To Pro (To Access The Cloud Autoscaling Service). However, My Colleague Who Has Th

Hi @<1858681577442119680:profile|NonchalantCoral99> , I would suggest opening a new workspace with PRO, tying it to a generic email ( devop@company.com for example) so when people shift, you won't have a problem with emails.

3 months ago

0 Hi Everyone ! I'M Working With Pipelinecontroller. Is It Possible To Create A Pipeline With Optional Steps ? To Clarify I Add An Example Of A Pipeline In The Picture. For Example, The User Would Be Able To Modify The Value Of A Parameter To Execute The St

Yes, and even more 🙂

one year ago

0 Hi, I Am Giving Another Try To Clearml-Session And I Am Blocked At The Current Error Shown When The Cli Try To Establish The Tunneling:

Well not really

Please elaborate 🙂

3 years ago

0 Hi Everyone, I'M Running A Local Server 2.0.0 And I Would Like To Start Using The Model Registry For Versioning. However I Found That There Is No Way To Retrospectively Match Models To A Task, Cannot Sort/Filter By Model Task Name Or Even Search By Model

Hi @<1547028074090991616:profile|ShaggySwan64> , how are you currently saving models? What framework are you using? Usually the output models are listed in the 'artifacts' section of a task and on the model side, there is the 'lineage' tab to see which task created the model and what other tasks are using it as input.

7 months ago

0 Hey

Hi @<1523701949617147904:profile|PricklyRaven28> , are you using the docker argument and it's not working? Are you sure the agent is running in docker mode?

2 years ago

0 Hello, Got A Simple Pipeline With 2 Tasks, First Task Is The Parent Of The Second One. Until Recently Everything Worked Fine. We Updated Agent Versions And Now A Strange Behavior Happens: The Second Task Is Always Skipped. The Code Base Hasn'T Changed. I'

Hi @<1523708602928336896:profile|HungryArcticwolf62> , can you share an isolated code snippet that reproduces this? What version of the agent are you using now?
Also, what do you mean by skipped? What happens to the pipeline?

2 years ago

0 If Possible, I Would Like All Together Prevent The Fileserver And Write Everything To S3 (Without Needing Every User To Change Their Config)

In the UI check under the execution tab in the experiment view then scroll to the bottom - You will have a field called "OUTPUT" what is in there? Select an experiment that is giving you trouble?

3 years ago

0 Hi! Trying To Orchestrate A Pipeline On Multiple Agents For The First Time. I Am Setting Up The Pipeline From Functions And I Need The Individual Function Steps To Run From A Cloned Repository Due To Local Imports. The Pipeline Task Detects And Clones The

Hi @<1547028074090991616:profile|ShaggySwan64> , can you please provide minimal sample code that reproduces this? The local imports - are they from the private repo?

one year ago

I think the controller and steps need to be in the same repository

one year ago

Same repo as the private repo?

one year ago

0 Hi

Hi @<1523701949617147904:profile|PricklyRaven28> , note that steps in a pipeline are special tasks with hidden system tag, I think you might want to enable that in your search

one year ago

0 Hello Everyone - I Have Installed A New Clearml Server, Now I Want To Run My Scripts Using The 4 Gpus On That Server Machine. Do I Need To Install A Clearml Agent On That Machine, Or Does The Clearml Server Come With A Built-In Agent Automatically?

Hi ProudElephant77 , you will need to install the agents on that machine. The ClearML server doesn't assume any GPU capabilities since it is only the control plane for ClearML

2 years ago

0 There Is A Problem Starting From Clearml 1.7.0 With Python-Fire

Hi PricklyRaven28 , can you try with the latest clearml version? 1.7.1

3 years ago

Show more results