CostlyOstrich36

0 Questions, 4181 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4181

0 Discovered An Issue With Clearml-Session Where We Have The Agents Running Within A Tailscale Network. When The Clearml Session Is Local On The Same Physical Network, Connections Work Fine. But When We Are On The Virtual Network, They Dont Work Fine

And where is the agent running?

one year ago

0 Hello All, I'Ve Previously Successfully Used The "Clearml Gpu Compute" Application, From Clearml And Genesis. Recently, My Tasks Are Failing With A Modulenotfounderror Error (For Banal Things Like Scipy And Scikit-Learn). It Seems Clearml'S Automagical En

What version of clearml are you using? Can you try in a clean python virtual env?

2 years ago

0 Hello Again

Hi WickedCat12 ,

During Task.init() you can specify auto_connect_frameworks=False for the framework you're working with. However please note that this will stop auto reporting scalars etc

https://clear.ml/docs/latest/docs/references/sdk/task#taskinit

3 years ago

0 Hi Guys! What Is The Best Way To Access Artifacts From Other Step Of The Pipeline? I Have Step One Returning Dataframe And Step Two Takes It As An Input But When First Step Is Cached I Only Get An Artifact Url. So How Should I Read It From Artifacts Stora

@<1544853721739956224:profile|QuizzicalFox36> , are you running the steps from the machine who's config you checked?

2 years ago

0 I Just Encountered A Really Frightening Bug. Best I Can Explain What Happened Was This: Data Scientist Created New Venv, Installed Clearml==1.11.0 Instead Of Clearml[S3]==1.11.1, And Upon Re-Running A Pipeline From Cli, The Entire Project "Disappeared" (W

Doesn't seem to reproduce for me (just ran pipeline and nothing changed about my project)

2 years ago

0 Hello, I Have Clearml Autoscaler Setup. Previously, When A New Task Comes Up, An Already Running Worker (If There Is), Will Take It, Apply The New Commit And Run The Task. Now, I Get An Error. So, I Can'T Run A Task On An Already Running Worker. It Has To

And are they the same tasks?

Are you using the OS autoscaler or the PRO version?

one year ago

0 I Have A Question Regarding Dataset Versioning Lets Say I Create Dataset A Which Has 1000 Files Then I Create Dataset B With Dataset A As It'S Parent. All I Did Was Delete 900 Files That Were Corrupted. When I Pull A Local Copy Of Dataset B, Do I Just Pul

Yes

2 years ago

0 Hello, Is There A Way To Check Whether The Experiment Was Run From Cli (E.G. Using Clearml-Task) Or By Clone+Enqueue From The Api, I Mean From The Code While The Experiment Is Running?

ResponsiveHedgehong88 hi,

The best indication would be in the 'INFO' section of the experiment. If it was run via CLI it should have N/A in the worker/queue section

3 years ago

0 I Am Trying To Run A Task On An Agent For The First Time But I Am Running Into Some Things I Do Not Understand, I Hope Someone Can Help Me Out With This. I Got An Agent Running On Google Colab, But When I Clone A Task And Enqueue It From The Web Ui, I Ge

Regarding the packages issue:
What python did you run on originally - Because it looks that 1.22.3 is only supported by python 3.8. You can circumvent this entire issue by running in docker mode with a docker that has 3.7 pre-installed

Regarding the data file loading issue - How do you specify the path? Is it relative?

3 years ago

0 Hi, Having Problems During Credentials Verification In Clearml-Init. Server Installed On A Separate Machine, Web Ui Is Accessible Where I Generated Credentials For Api. Here Is The Log. Don'T Know Why I'M Getting Http 403. Detected Credentials Key="Wrdif3

It looks like there might be a firewall or something of the sort, please try the curl command from the machine itself to verify

3 years ago

0 Hi, When I Read An Argument From The Configuration Tab In The Clearml Using The

Hi,
From the looks of it, it always returns a string. What is your use case for this? Do you have some conditionality on the type of variable the parameters are?

3 years ago

0 Do I Understand Correctly That Python Versions Must Match Between Client (My Mac, Sends Task For Remote Execution) And Clearml-Agent? I Don’T Really Get How The Environments Are Managed. All I Want To Do Is Take My Code And Execute It On The Agent Machin

Is there a reason it is requiring pytorch? )
The script you provided has only clearml as a requirement

2 years ago

0 Hi Everyone, Now This Is Happening: I Decided To Use The Default Clearml.Conf File, And I Try To Run The Agents Using Clearml-Agent Daemon --Queue Default --Docker --Foreground So, As It Is Default I Expect It To Be Able To Install Everything But Always H

Hi @<1739818374189289472:profile|SourSpider22> , can you provide a full log of the run?

one year ago

0 Hello There! I Have A Question Regarding The Web Ui, On The Project Page: I Have The Following Use Case: I Need To Add Two Custom Columns, Each Reporting One Metric. Currently, This Shows Me The Best (Min/Max) Values Reached By The Model, But Not Necessar

How about the comparison?

3 years ago

0 Hi, What Could Be The Reason That A Task Ran On An Agent Just Stopped Updating? The Status Is Still "Running" But It Doesn'T Seems Like It. The Agent Is Running On A Docker On A Gpu. It Completed 92 Epochs And Started 93. Run Started At 18:37 Feb 27, Last

Can you see if in the APIserver logs something happened during this time? Is the agent still reporting?

2 years ago

Must have missed this:

I have also hit my computer with a shoe.

Might need bigger shoe 😄

2 years ago

0 Hi Everyone! We Are In The Middle Of Changing Clearml Cluster We Have Dumped Mongodb (With Mongodump Tool) And Restored (Mongorestore) It In A New Cluster, But No

I'm guessing you didn't move ES?

3 months ago

0 I Assume I Can Ask A Question Here. The Clearml Orchestrator Looks Interesting. But The Website Suggests That K8S Is Required. We Have A Linux Training Box (Lambdabox) Where We Want To Run Training. Can We Place The Clearml Orchestrator Agent On The M

Hi RobustFlamingo1 ,
Can you point to where the website suggests that K8S is a requirement?
I use the ClearML-Agent on a local machine without any K8S. It is certainly not a requirement. From what I understand you can run it on K8S as well.

So to answer your question:
You can definitely use ClearML Orchestration (ClearML-Agent) with OR without K8S
I hope this helps 🙂

3 years ago

0 Hi Guys! Anyone Else Has Trouble Caching Virtual Environments In The Agent? I Manually Installed A Single Agent On A Virtual Machine, And I'M Using This Conf For Venv Caching :

@<1691620877822595072:profile|FlutteringMouse14> , can you try upgrading to the latest available? 1.8.1rc2

one year ago

0 Hey Guys, Hope You Missed Me

And you're sure that clearml.conf points to the correct server with the right credentials?

2 years ago

0 Hello Everybody, I Have Been Testing Clearml As An All In One Solution For Mlops In Our Team. I Deployed The Clearml Server And Everything Worked Fine

Hi @<1534496192929468416:profile|EagerGiraffe33> , what if you try to put a specific version of pytorch you've tested on your remote environment in the requirements section of the cloned task?

2 years ago

0 Hi, When Trying To To Run An Experiment With Pytorch, Pip Keeps Failing On Installing The Pytorch Packages, Did Somebody Else Solve This Problem? Here Are My Log Files.

You can add it to your pip configuration so it will always be taken into account

2 years ago

0 Hi, I Am Trying To Figure Out How To Get Cloud Storage Access Working In The Agent. I Am Running The Agent Locally In Docker Mode. I Set Up Gcp Storage In The Clearml.Json But It Seems Not To Get Passed To The Agent. Also Tried To Add Agent.Extra_Docker_A

Or should I set agent.google.storage {}?

Did you follow the instructions in the docs?

one year ago

0 Hi, I Configured An On-Prem File Server For Clearml Which Is Mounted On My Pc. I Am Trying Retrieve An Artifact From A Previous Run . Because This File Is Big I Want To Bring It To The Local Cache (On My Pc). However, When I Do The Following Artifact =Tas

Hi @<1546303277010784256:profile|LivelyBadger26> , can you provide a snippet that reproduces this?

2 years ago

0 I Have The User/Pass Set Up On The

Can you also add a full log of the run that was showing the git pass in the startup print?

9 months ago

0 Hello Everyone, I Seem To Recall A While Back That Support For Azure Autoscaler Was Supposed To Come Later. However, Looking At The Applications Tab, There Is Still Only Aws, Gcp, And Genesis. Has Support For Azure Been Dropped? Or Is It Still Supposed To

Hi @<1523711002288328704:profile|YummyLion54> , it hasn't been added to the PRO yet 🙂

one year ago

0 How Do I Disable

How many envs does it cache?

2 years ago

0 Hi, I Hope Someone Can Help Me With The Following Problem: I Have Been Using Clearml For Some Time And Have Many Projects And Experiments. Today, For The 1St Time, I Tried Cloning An Experiment. After Enqueueing The Cloned Experiment (As Explained

I would guess so
sudo docker logs --follow trains-webserver

3 years ago

0 Hi, Does Anyone Know If There Is A Way To Have The Dataset Graph That Tells Us Which Dataset Was Created From Which Other Ones Without Setting The Previous Datasets As Parents? We Have Large Raw Datasets That Are Used To Create Several Smaller Ones, And I

Hi @<1523703397830627328:profile|CrookedMonkey33> , not sure I follow. Can you please elaborate more on the specific use case?

Currently you can add plots to the preview section of a dataset

one year ago

0 Hi Everyone, I’M New To Clearml And Server Administration. We Are Considering Tools To Manage A Dgx H100 Server. Ideally, The Tool Could Provide "Sandboxes" That Are Already Equipped With All The Necessary Tools And Frameworks. This Way, Each Team Member

Hi @<1756488209237282816:profile|IdealCamel64> , I think ClearML would be perfect for that. You can also enable users to have their own remote sessions directly to the GPUs (inside a container even). I'd check out ClearML's orchestration layer + remote sessions:
None
None

Regarding what @<1576381444509405184:profile|ManiacalLizard2> said, he's wrong I'm afraid. ClearML can run ...

11 months ago

Show more results