CostlyOstrich36

0 Questions, 4172 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4172

0 Hello, Tldr, Delete Metrics, Plots And Debug Samples From A Previous Task More Details: I Have A Task I Ran That Trained A Model And Then Tested It. The Test Results Were Reported By The Logger In Metrics, Plots And Debug Samples. I Wrote Code That Gets

Hi @<1541592227107573760:profile|EnchantingHippopotamus83> , to "clean" a task, you need to reset it. Resetting a task will purge all outputs

2 years ago

0 I’M Interested In Learning More About Internals Of Clearml Server - For Example, How Elasticsearch, Mongodb, And Redis Are Used Internally. Are There Any Materials Available?

DilapidatedDucks58 , regarding internal workings - MongoDB - all experiment objects are saved there. Elastic - Console logs, debug samples, scalars all is saved there. Redis - some stuff regarding agents I think

2 years ago

0 Hi Guys, Can I Somehow Link 2 Versions Of Dataset As Parent-Child After I Uploaded Both Of Them? They Have The Exact Same Name But Uploaded As Independent

I think that once a version has been finalized you can't add changes to it directly. You could probably hack something with setting it manually to running via the API, add the relevant connections and then move it to completed

2 years ago

0 I Am Getting Certificate Warning When Running Clearml:

LethalCentipede31 , it appears we had an internal issue with a load balancer, it was fixed a couple of minutes after your comment 🙂

3 years ago

0 Hi, I Hope Someone Can Help Me With The Following Problem: I Have Been Using Clearml For Some Time And Have Many Projects And Experiments. Today, For The 1St Time, I Tried Cloning An Experiment. After Enqueueing The Cloned Experiment (As Explained

BTW - did the agent print out anything? Which version of clearml-agent are you using?

3 years ago

0 Hi Everyone! I Have A Question Regarding Running A Script Inside Docker Container With Clearml: I Build An Image Containing All Requirements To Run Some Python Script That Is Getting Arguments Via Argparse. When I Build A Wrapper Script That Will Run This

I would suggest structuring everything around the Task object. After you clone and enqueue the agent can handle all the required packages / environment. You can even set environment variables so it won't try to create a new env but use the existing one in the docker container.

2 years ago

0 I Have A Question And I'M Not Sure If Anyone Is Clear On This. If I Want The Agent To Manage Dependencies Using Conda, And Install A New Environment Based On The Yaml File Output By

Hi @<1718799873618219008:profile|FunnyPeacock68> , you can set this up in clearml.conf of the running agent
None

one year ago

0 Is There A Way To Debug Docker-Based Clearml-Agent, How It Reaches This Error Message? Where Is The Code Executed, Can I Add Some Debug Prints To See Variable Values, Frame Stack Trace, Etc?

Hi @<1715900788393381888:profile|BitingSpider17> , you can run the agent in --debug mode and this should pass it over to the internal agent running the code

one year ago

0 In General, How To Pass Clearml_Agent_* Envriornment Variables To Have Effect, If The Agent Is Already Started?

Hi @<1715900788393381888:profile|BitingSpider17> , you need to set it in the environment where you are running the agent. Basically export it as an env variable and then run the agent

one year ago

0 New To Clearml, I Primarily Use Rye To Handle My Package Management. For Some Reason, Our Training Task Is Capturing All Of Our Depenendencies As Declared In Our

Hi @<1719524669695987712:profile|ClearHippopotamus36> , what if you manually add these two packages to the installed packages section in the execution tab of the experiment?

one year ago

0 Hi, Is There A Way To Log Sklearn Metrices (Like Accuracy/Precision) In A Tabular Way Rather Than Plot ?

HappyDove3 Hi 🙂

Well, since all the data is logged you can simply use the API to retrieve it and create the tables yourself quite easily!

3 years ago

0 Hi! To Make My Script Work Inside A Task, I Need To Add

Hi @<1691983266761936896:profile|AstonishingOx62> , I'm not sure I understand what you're trying to do. You have some python code unrelated to ClearML. Does it run without issues? Did you afterwards add Task.init() to that code?

one year ago

0 Hi! To Make My Script Work Inside A Task, I Need To Add

You can export it in the same shell you run the agent in and that should work for example

export FOO=bar clearml-agent daemon ...

one year ago

0 Hi, I Have Been Testing Clearml And Checking If It Is A Good Fit For The Use Case That I Have In Hand. Everything Is Quite Good So Far But I Have A Question Regarding Models In Clearml .... Is There Any Model Versioning Introduced?? For Example: If I Trai

Hi @<1729309137944186880:profile|GrittyBee73> , models are unique objects in the system so each one of them has a unique ID. By default they will be named the same. However, you can add versioning on top in any way that you want. You can either add tags or even add metadata on top of them and then add custom columns according to this metadata so you can filter by versions.

What do you think?

one year ago

0 Hi All, I Wanted To Know About Saving Datasets, We Want To Specify The Path To Gs By Default, As I Understand By Default It Uses The Path To File_Server? We Tried Sdk.Development.Default_Output_Uri =

Hi @<1603198163143888896:profile|LonelyKangaroo55> , you can change the value of files_server in your clearml.conf to control it as well.

one year ago

0 Hi Everyone, Has Anyone Ever Had Issues With An Elasticsearch Index Being Corrupted? We Are Unable To Load The "Scalars" Tab On Any Experiment Without Getting The Error

Hi @<1625666182751195136:profile|MysteriousParrot48> , I'm afraid that this looks like a pure ElasticSearch issue, I'd suggest checking on ES forums for help on this

one year ago

0 How Can I Check Which Experiments Are Using The Most Metrics? And Does Archiving Those Experiments Save Some Space?

Hi @<1581454875005292544:profile|SuccessfulOtter28> , using the most metrics you mean how much metric space it takes?

Archiving doesn't remove anything, but once archived, you can delete experiments to free up space

one year ago

0 Hi, I'Ve Seem To Come Across A Bug When Creating A New Child Dataset That Overwrites Parent Dataset Files. The New Files In The Child Are Added As External Files, But The Files In The Parent Are Zipped. As A Result, The Modified Files Are Both In Link Ent

Hi @<1709015393701466112:profile|ScatteredPeacock14> , please open a GitHub issue for this to follow up on!

12 months ago

0 When Using Clearml Virtual Environment Execution, I'D Like To Add One Of The Git Folders To The Python Path As An Environment Variable. How Do I Know Where The Path Of The Git Folder Is On The Machine Though And How Do I Add It? I Found

Hi @<1739455977599537152:profile|PoisedSnake58> , in the log you have the location of the cloned repo printed out.

For CLEARML_AGENT_EXTRA_PYTHON_PATH you need to provide it with a path

12 months ago

0 Hi, I Have A Question: How Can I Set Docker Image When Init A Clearml Task, I Don'T See Docker Option In Task.Init. I Saw A Docker Option In Task.Create But When I Create A Task With Task.Create And Docker Option => Task Couldn'T Run On Remote Agent.

Hi @<1749965229388730368:profile|UnevenDeer21> , I think this is what you're looking for
None

11 months ago

0 Hi Community, I Want To Add 2 Args For Clearml Agent Dockers " ["--Network=Host", "--Ipc=Host"]". I'Ve Tried With Changing Agent.Default_Docker.Arguments => But It Didn'T Work. Later When I Tried With Agent.Extra_Docker_Arguments => It Worked. So I Was Wo

Hi @<1749965229388730368:profile|UnevenDeer21> , can you add the log of the job that failed?

Also, note that you can set these arguments from the webUI on the task level itself as well, Execution tab and then container section

11 months ago

0 Hi, I'M Not Sure When Exactly But At Some Point I'Ve Got No Access To My Debug Samples. We'Re Using Self-Hosted Clearml, Which Runs Within A Docker Container. Any Ideas? Thanks!

Hi @<1717350332247314432:profile|WittySeal70> , where are the debug samples stored? Have you recently moved the server?

11 months ago

0 Hello Everyone, I Have A Question About Clearml Reports. I Want To Use Them As Modelcards And Change Their Data When Something On The Model Changes. Is There A Way To Update A Reports Markdown Automatically/Via Api? I Only Found That I Can Have Dynamic Qu

Hi @<1717350310768283648:profile|SplendidFlamingo62> , you can basically export the same plots from a model and do that in the report. Or am I missing something?

10 months ago

0 Hi All

Hi @<1546303293918023680:profile|MiniatureRobin9> , please take a look at add_pipeline_tags in
None

2 years ago

0 How Do I Create An Experiment Where I Can Set The Github Repository/Branch Name/Script Path Like This Example Shows?

Hi BoredHedgehog47 , You need to add
from clearml import Task task = Task.init(project_name='examples', task_name='hello world')to your code and run it once after you've ran clearml-init

2 years ago

0 Hi, I Am Trying To Use Omegaconf With Task.Connect_Configuration And I Get The Following Error:

Regarding connect_configuration() , reading into the docs I see that this method needs to be called before reading the config file
https://clear.ml/docs/latest/docs/references/sdk/task#connect_configuration

3 years ago

0 Hi. Is There A Way To Transfer Clearml Workspace Ownership To Another Team Member?

The webUI is using the API to show everything so I would suggest opening developer tools (F12) and seeing what is being sent by the UI when you navigate different sections of the experiments to use as a baseline

7 months ago

0 Hey! As Part Of Migrating From The On-Premise Server To The Saas Solution Server, We'D Need To Migrate Some Of The Workloads & Experiment Log From Clearml. Is It Possible?

Hi @<1710827340621156352:profile|HungryFrog27> , you can do that. You would want to export everything you want using the API and then recreate and populate all the tasks you want using the API.

See here - None

7 months ago

0 I'M Facing An Issue With Aborting A Clearml Task. Even Though I'Ve Tried Aborting It Both Through The Context Menu And Using The Api, The Task Persists In The 'Running' State. I'Ve Tried:

Can you try with the latest version of the server?

7 months ago

0 Hi Everyone! I Have A Question Regarding The Use Of S3 For Storage. At Our Company, We Only Use Temporary S3 Credentials (Key+Secret+Token) For Security Reasons. That Should Be No Problem On The User Side, As We Can Use The Credential Chain. However, For

I don't think there is such an option currently but it does make sense. Please open a GitHub feature request for this 🙂

2 years ago

Show more results