CostlyOstrich36

0 Questions, 4181 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4181

0 Hi Everyone! I Have Few Questions In Hosting The Clearml Server

Or are you trying to change something in the docker compose?

one year ago

0 Is This The Write Way To Add A Tag To An Output Model Artifact Of A Task? Torch.Save(Model, '

Which version of clearml are you using?

3 years ago

0 Why It Is Not Running If I Specify The Agent On The Docker Mode , Usually I Just Run "Clearml-Agent Daemon" And It Works But Today I Am Trying "Clearml-Agent Deamon --Docker"

WickedBee96 , I think basically you need to find a way to use docker commands without requiring sudo before

2 years ago

0 Hello Everyone, Is There An Easy Way To Clone A Pipline And Execute It With New Parameters? I Know That There Is The Possibility With Task But With Pipelines I Haven'T Found Anything In The Documentation Yet. Thank You In Advance For Your Answer.

Oh I see. Technically speaking the pipeline controller is a task of a special type of itself. So technically speaking you could provide the task ID of the controller and clone that. You would need to make sure that the relevant system tags are also applied so it would show up properly as a pipeline in the webUI.

In addition to that, you can also trigger it using the API also

9 months ago

0 Hi All, Is There A Way To Configure Clearml On A Host Running Pytorch Training, But Not Having Access To The Clearml Server, So It Would Output Clearml Experiments On A S3 Bucket And, The Clearml Server To Have A Project Exclusively Listening To This Buck

Hi @<1772795696529805312:profile|LethalCoral80> , I think what you're looking for is the offline mode - None

9 months ago

0 Hi Everyone, I'M Having An Issue With Clearml Datasets And Would Like To Know If This Is Possible. I Have A Task That Is Executed Repeatedly. This Task May Require Data To Be Loaded And Updated From A Dataset. My Question Is: Is There A Way To Append To A

In that case you are correct. If you want to have a 'central' source of data then Datasets would be the suggested approach. Regarding your question on adding data, you would always have to create a new child version and append new data to the child.

Also maybe squashing the dataset might be relevant to you - None

2 months ago

0 I Have A Dataset Uploaded To Clearml. By Mistake I Didn'T Set The Destination Correctly And The Dataset Is Now Saved On A Computer Rather Than In S3. Is There An Easy Way To Rectify This?

Hi @<1562973083189383168:profile|GrievingDuck15> , I think you'll need to re-register it

one year ago

0 Hey All, Is There A Way To Upload A Fiftyone Dataset As An Artifact In A Clearml Pipeline? I Am Getting The Following Error When I Try To Upload It

Hi @<1610083503607648256:profile|DiminutiveToad80> , I'd suggest using the Datasets feature. But you can however of course upload it as artifacts.

Where are you trying to upload it? Can you provide the full log? Also, a code snippet would help.

one year ago

0 Hi, Is There A Way To Access The Clearml File Server? I Would Like To Check If An Artifact Object Has Been Deleted Or Not.

Oh, I would suggest asking on the main support channel for ClearML 🙂

one year ago

0 Hi, Is There A Way To Access The Clearml File Server? I Would Like To Check If An Artifact Object Has Been Deleted Or Not.

You mean the community server?

one year ago

0 I Have A Dataset Uploaded To Clearml. By Mistake I Didn'T Set The Destination Correctly And The Dataset Is Now Saved On A Computer Rather Than In S3. Is There An Easy Way To Rectify This?

Setting the upload destination correctly and doing the same steps again

one year ago

0 Discovered An Issue With Clearml-Session Where We Have The Agents Running Within A Tailscale Network. When The Clearml Session Is Local On The Same Physical Network, Connections Work Fine. But When We Are On The Virtual Network, They Dont Work Fine

And where is the agent running?

one year ago

Hi @<1717350310768283648:profile|SplendidFlamingo62> , you can also use artifacts on the task itself in order to pass data between tasks - None

2 months ago

0 Hello All, I'Ve Previously Successfully Used The "Clearml Gpu Compute" Application, From Clearml And Genesis. Recently, My Tasks Are Failing With A Modulenotfounderror Error (For Banal Things Like Scipy And Scikit-Learn). It Seems Clearml'S Automagical En

What version of clearml are you using? Can you try in a clean python virtual env?

2 years ago

0 Hello Again

Hi WickedCat12 ,

During Task.init() you can specify auto_connect_frameworks=False for the framework you're working with. However please note that this will stop auto reporting scalars etc

https://clear.ml/docs/latest/docs/references/sdk/task#taskinit

3 years ago

0 Hi Guys! What Is The Best Way To Access Artifacts From Other Step Of The Pipeline? I Have Step One Returning Dataframe And Step Two Takes It As An Input But When First Step Is Cached I Only Get An Artifact Url. So How Should I Read It From Artifacts Stora

@<1544853721739956224:profile|QuizzicalFox36> , are you running the steps from the machine who's config you checked?

2 years ago

0 I Just Encountered A Really Frightening Bug. Best I Can Explain What Happened Was This: Data Scientist Created New Venv, Installed Clearml==1.11.0 Instead Of Clearml[S3]==1.11.1, And Upon Re-Running A Pipeline From Cli, The Entire Project "Disappeared" (W

Doesn't seem to reproduce for me (just ran pipeline and nothing changed about my project)

2 years ago

0 Hello, I Have Clearml Autoscaler Setup. Previously, When A New Task Comes Up, An Already Running Worker (If There Is), Will Take It, Apply The New Commit And Run The Task. Now, I Get An Error. So, I Can'T Run A Task On An Already Running Worker. It Has To

And are they the same tasks?

Are you using the OS autoscaler or the PRO version?

one year ago

0 I Have A Question Regarding Dataset Versioning Lets Say I Create Dataset A Which Has 1000 Files Then I Create Dataset B With Dataset A As It'S Parent. All I Did Was Delete 900 Files That Were Corrupted. When I Pull A Local Copy Of Dataset B, Do I Just Pul

Yes

2 years ago

0 Hello, Is There A Way To Check Whether The Experiment Was Run From Cli (E.G. Using Clearml-Task) Or By Clone+Enqueue From The Api, I Mean From The Code While The Experiment Is Running?

ResponsiveHedgehong88 hi,

The best indication would be in the 'INFO' section of the experiment. If it was run via CLI it should have N/A in the worker/queue section

3 years ago

0 I Am Trying To Run A Task On An Agent For The First Time But I Am Running Into Some Things I Do Not Understand, I Hope Someone Can Help Me Out With This. I Got An Agent Running On Google Colab, But When I Clone A Task And Enqueue It From The Web Ui, I Ge

Regarding the packages issue:
What python did you run on originally - Because it looks that 1.22.3 is only supported by python 3.8. You can circumvent this entire issue by running in docker mode with a docker that has 3.7 pre-installed

Regarding the data file loading issue - How do you specify the path? Is it relative?

3 years ago

0 Hi, Having Problems During Credentials Verification In Clearml-Init. Server Installed On A Separate Machine, Web Ui Is Accessible Where I Generated Credentials For Api. Here Is The Log. Don'T Know Why I'M Getting Http 403. Detected Credentials Key="Wrdif3

It looks like there might be a firewall or something of the sort, please try the curl command from the machine itself to verify

3 years ago

0 Hi, When I Read An Argument From The Configuration Tab In The Clearml Using The

Hi,
From the looks of it, it always returns a string. What is your use case for this? Do you have some conditionality on the type of variable the parameters are?

3 years ago

0 Do I Understand Correctly That Python Versions Must Match Between Client (My Mac, Sends Task For Remote Execution) And Clearml-Agent? I Don’T Really Get How The Environments Are Managed. All I Want To Do Is Take My Code And Execute It On The Agent Machin

Is there a reason it is requiring pytorch? )
The script you provided has only clearml as a requirement

2 years ago

0 Hi Everyone, Now This Is Happening: I Decided To Use The Default Clearml.Conf File, And I Try To Run The Agents Using Clearml-Agent Daemon --Queue Default --Docker --Foreground So, As It Is Default I Expect It To Be Able To Install Everything But Always H

Hi @<1739818374189289472:profile|SourSpider22> , can you provide a full log of the run?

one year ago

0 Hello There! I Have A Question Regarding The Web Ui, On The Project Page: I Have The Following Use Case: I Need To Add Two Custom Columns, Each Reporting One Metric. Currently, This Shows Me The Best (Min/Max) Values Reached By The Model, But Not Necessar

How about the comparison?

3 years ago

0 Hi, What Could Be The Reason That A Task Ran On An Agent Just Stopped Updating? The Status Is Still "Running" But It Doesn'T Seems Like It. The Agent Is Running On A Docker On A Gpu. It Completed 92 Epochs And Started 93. Run Started At 18:37 Feb 27, Last

Can you see if in the APIserver logs something happened during this time? Is the agent still reporting?

2 years ago

Must have missed this:

I have also hit my computer with a shoe.

Might need bigger shoe 😄

2 years ago

0 Hi Everyone! We Are In The Middle Of Changing Clearml Cluster We Have Dumped Mongodb (With Mongodump Tool) And Restored (Mongorestore) It In A New Cluster, But No

I'm guessing you didn't move ES?

3 months ago

0 I Assume I Can Ask A Question Here. The Clearml Orchestrator Looks Interesting. But The Website Suggests That K8S Is Required. We Have A Linux Training Box (Lambdabox) Where We Want To Run Training. Can We Place The Clearml Orchestrator Agent On The M

Hi RobustFlamingo1 ,
Can you point to where the website suggests that K8S is a requirement?
I use the ClearML-Agent on a local machine without any K8S. It is certainly not a requirement. From what I understand you can run it on K8S as well.

So to answer your question:
You can definitely use ClearML Orchestration (ClearML-Agent) with OR without K8S
I hope this helps 🙂

3 years ago

Show more results