CostlyOstrich36

0 Questions, 4210 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4210

0 Hi, I Update Recently To Clearml-Server 1.2 (Self Hosted), Great Job! I Am Seeing The Popup Asking For S3 Creds Often When Navigating In Debug Samples. I Set Them Multiple Times Under Settings > Configuration > Web App Cloud Access, But For Some Reason It

JitteryCoyote63 , reproduces on my side as well 🙂

3 years ago

0 Hi, While Loading A Task I See The Following Line In The Output:

Yeah this is a lock which is always in our cache, cant figure out why it's there, but when I delete the lock and the other files, they always reappear when I run a new clearml task.

Is the lock something that occurs on your machine regardless of ClearML?

3 years ago

0 Hi All! I Am Trying To Run The Notebook From The Remote Server Using Aws. It Seems Like I Successfully Installed Clearml Using !Pip Install Clearml Command, But When I Am Trying To Run !Clearml-Init I Got The Following Error: /Bin/Bash: Clearml-Init: Comm

try like this

3 years ago

0 Hello, How Can I Run My Tasks Inside Docker Without Installing Anything At All. Assume That My Image Is Ready To Go And Only Thing That Could Change Is Code. This Is How I Run My Queue On Worker: Clearml-Agent Daemon --Queue Cccg --Docker This Is How I

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , I think these are the env variables you're looking for:
CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
CLEARML_AGENT_FORCE_CODE_DIR
None

one year ago

0 I Am Studying Using The「Pipeline From Tasks 」Pages.

You don't need to have the services queue, but you need to enqueue the controller into some queue if not running locally. I think this is what you're looking for.
None

11 months ago

0 Hi All, How Can We Clear The Local Dataset Cache In Clearml?

Hi @<1587615463670550528:profile|DepravedDolphin12> , your cache is defined by your clearml.conf you can see where it points and delete that folder 🙂

2 years ago

0 Hi Everyone, How Can One Import Additional Requirements To The Pipeline While Remote Execution

@<1610083503607648256:profile|DiminutiveToad80> , can you give a stand alone code example for such a pipeline that reproduces the issue? Each task should have it's own requirements logged. What is failing, the controller or individual steps?

2 years ago

0 Hi Team, I Am Running Code In Vsc And Connected To Clearml Server. It Taking Too Much Of Time To Execute,May I Know The Reason?

Hi SuperiorCockroach75 , can you please elaborate? What is taking to execute?

2 years ago

0 Sorry For The Barrage Of Questions. I Can'T Seem To Figure Out How Best To Get A Python Script I Need To Run On An Agent. I Have An Agent Listening To The Default Queue And I Also Have The Script That I Need To Run On The Agent. Can You Guide Me On How To

Glad to help 🙂

3 years ago

0 Hi All, Any Idea Why Spawned Trainings During Optimization Can End With The Following Message

CurvedHedgehog15 , isn't the original experiment you selected to run against is the basic benchmark?

3 years ago

0 Hey All, I'Ve Been Doing Some Hyperparameter Tuning Today Using A Clearml Managed Dataset. However, I Kept Running Into The Following Error:

Hi @<1780043419314294784:profile|LargeHamster21> , are you running multiple instances of the agent on the same machine? If that is the case, can you elaborate on the use case?

10 months ago

0 Hi Everyone. I'M Facing A Problem When Connecting To Azure Storage. When The Task Tries To Download A Dataset, It Fails With The Message

Hi @<1523707653782507520:profile|MelancholyElk85> , I assume you're running remotely?

one year ago

0 I Am Studying Using The「Pipeline From Tasks 」Pages.

Also review these pages -
None
None

11 months ago

0 <no title>

@<1797800418953138176:profile|ScrawnyCrocodile51> , you can edit the hyper params when a task is in draft mode

8 months ago

0 Is There An External Way To Access Pipelinecontroller._Relaunch_Node(Node) ?

Hi @<1639799308809146368:profile|TritePigeon86> , can you please elaborate? What do you mean by external way?

one year ago

0 Hi, Is It Possible To Sync Expiriment Using S3 Or Gs? I Loved To Have A Look At The Some Documentation. We Want To Sync The Training While They Are Running[Not Just When They Are Finished] Thanks,

DisturbedElk70 Hi 🙂

Can you elaborate?

3 years ago

0 Hi, I Would Like To Ask Around If Anyone Has Following Languages Working With Clearml? It Can Be Direct From Clearml Sdk Or Via Any Indirect Method.

SubstantialElk6 , do you mean compiling them into a language or calling certain functions from the wheel?

3 years ago

0 Hi, Is There Any Way To Mount An S3 Bucket To Worker Nodes For Some Specific Use Cases Like Data Streaming? If So, How Does Clearml Tackle Data Versioning?

Hi @<1562610699555835904:profile|VirtuousHedgehong97> , I think you can mount some shared folder between the ec2 instances to use as cache. ClearML hashes data so it can know if what it has in it's cache is relevant or not.

2 years ago

Are you sure that the file is on the server? Can you access it?

3 years ago

0 Hi, I'Ve Noticed That In A Few Experiments That Got Stuck With No Indication That Something Went Wrong And It Kept On "Running" Until I Manually Aborted The Experiments, Is There A Way To Create A Timeout For If The Server Is Stuck? For Clarification I'M

Oh, I misunderstood. You mean you're using app.clear.ml ?

one year ago

0 Hey, I Have One Query.

Hi @<1585078763312386048:profile|ArrogantButterfly10> , you can fetch a task using it's id. Then with the task object in hand you can find the model in the artifacts section. For ease of use I suggest playing with dir(task) in python

2 years ago

0 Hey All, Im Using S3 As Files_Server. When I Run A Task Not In A Docker Everything Works, That I Run The Same Task In A Docker I Get: Raise Valueerror("Could Not Download Dataset Id={} Entry={}".Format(Self._Id, Data_Artifact_Name)) Valueerror: Could Not

Are you running it inside a docker yourself or is it run via the agent?

3 years ago

0 Hi, Me Again. How Can I See User-Specified

In compare view you need to switch to 'Last Values' to see these scalars. Please see screenshot

2 years ago

0 Question About Pipeline And Long-Waiting Tasks: Say I Want To Generate A Dataset. The Workflow I Have Requires

Hi RoughTiger69 ,

Have you considered maybe cron jobs or using the task scheduler?

Another option is running a dedicated agent just for that - I'm guessing you can make it require very little compute power

3 years ago

0 Dear Clearml Team! I Have Experiments Running With Your Tool, And Displaying Images In The "Debug Samples" Section. After Few Iteration, It Stopped Showing Images, And Showed A Broken Image Icon Saying "Unable To Load Image Binary%20Preds_Sample_0_0000005

Can you please provide a snippet of how the debug images are saved, also an example url would be useful :)

4 years ago

0 Hey, Guys! I Have A Problem. I Launched Clearml Server And Trying To Run A Worker On Another Machine. When I Run

What version of clearml and clearml-agent are you using, what OS? Can you add the line you're running for the agent?

2 years ago

0 Hey Guys! I'M Having Some Issues With Pytorch And Clearml. I Am Starting A New Task Using Task.Create And Setting Pytorch As A Requirement Under `Packages`. For Some Reason Pytorch With Cuda 12 Is Being Installed, But I Need Cuda 11. Do You Know How To Se

I think it tries to get the latest one. Are you using the agent in docker mode? you can also control this via clearml.conf with agent.cuda_version

one year ago

0 Hi Folks, Any Idea Why I Am Getting This Strange Error From Clearml-Data:

Can you give it a try?

3 years ago

0 I'M Looking At How Triggers Work In Clearml. Is There An Example, Maybe With Clearml Data And A Dataset Being Uploaded Or Some Other Example?

Yes, for an enqueued task to run you require an agent to run against the task 🙂

3 years ago

0 Hi, Does Anyone Know If There Is A Way To Have The Dataset Graph That Tells Us Which Dataset Was Created From Which Other Ones Without Setting The Previous Datasets As Parents? We Have Large Raw Datasets That Are Used To Create Several Smaller Ones, And I

Hi @<1523703397830627328:profile|CrookedMonkey33> , not sure I follow. Can you please elaborate more on the specific use case?

Currently you can add plots to the preview section of a dataset

one year ago

Show more results