CostlyOstrich36

0 Questions, 4209 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4209

0 Hi, I Was Trying Out The Clearml Pipelines From Task. I Had 2 Tasks That Have Run Successfully As Clearml Task. One Of The Tasks Has Dependency On External Python File. I.E. I Have Used From <External File> Import Methoda In My First Task. It Executed Fin

Hi OddShrimp85 , have you run this task remotely? If you are importing your own package, how is it connected to the task?

2 years ago

0 Hi, I'M Trying To Save Artifacts In A Folder Using Command

Hi GrittyCormorant73 , can you please add the error you're getting? What version of ClearML are you using?

3 years ago

0 Hello Everyone. Im Using Clearml Hpo And Having A Problem With An

Hi @<1623491856241266688:profile|TenseCrab59> , can you elaborate on what do you mean spending this compute on other hprams? I think you could in theory check if a previous artifact file is located then you could also change the parameters & task name from within the code

2 years ago

0 Hi All, The Repo I'M Working On Has A Few Projects And We Have Some Code Which Is Shared Between All The Projects, For Example Our Own Augmentations, I'Ve Created A Script Which Runs Unit Tests For Each Environment And I Wanted To Know Is There A Feature

Hi CluelessFlamingo93 . This is indeed a capability within ClearML.
I think this is what you're looking for:
https://www.youtube.com/watch?v=k5e-E5oEFUw

2 years ago

0 Hello Everyone, Is There An Easy Way To Clone A Pipline And Execute It With New Parameters? I Know That There Is The Possibility With Task But With Pipelines I Haven'T Found Anything In The Documentation Yet. Thank You In Advance For Your Answer.

For example:
None
Thats adding an argument with pipeline from tasks
None
Thats adding an argument with pipelines from decorator, see - mock_parameter & pickle_url

11 months ago

0 Hi All! I Want To Setup A Tool That I Can Use To Analyse Clearml Logs (Just User And Experiment Logs, I Am Not Doing Any Model Serving Yet). Is There An Api Endpoint That I Can Fetch Such Metrics? Metrics Like Number Of Active Users, Number Of Experiments

Hi @<1573119955400921088:profile|CloudyPelican46> , you can certainly do this. You can find all the related api calls here - None
I suggest opening developer tools (F12) and seeing what is sent in the UI to fetch the various metrics you're looking for

2 years ago

0 How Do I Ensure That If There Is Any Error In A Task, Then The State Is Set To "Failed"? At The Moment, When I Get Errors, The Task Is Still Just Marked As "Completed", Even Though It Did Not "Terminate Successfully" But Stopped As There Was An Error?

Hi @<1654294828365647872:profile|GorgeousShrimp11> , can you provide a log for such a task? What is the status change in the INFO section?

one year ago

0 Clearml Tracks The Executed

Hi @<1541954607595393024:profile|BattyCrocodile47> , how does ClearML react when you run the scripts this way? The repository is logged as usual?

2 years ago

0 I Have A Problem That Might Not Directly Be Clearml Related, But Maybe Someone Here Has An Idea: I Run A Clearml-Server On A Machine With 128Gb Ram, 32 Cores And 2 Gpus. On The Same Machine I Run 2 Clearml-Agent Each With Access To 1 Gpu, 12 Cores, An 48G

What happens if you look at elastic container logs directly? I think it's something along the lines sudo docker logs clearml-elastic --follow . Don't catch me on the exact syntax naming tho 😛

3 years ago

0 Hello Everyone, I Have A Small Question For The

Hi @<1582179652133195776:profile|LudicrousPanda17> , I suggest doing a similar filtering in the UI with dev tools open (F12) and see what is sent by the web UI 🙂

2 years ago

0 Cannot Import My Custom Python File When Creating A Pipeline Using The Decorator Do Anyone Have Any Idea As To How To Solve This Issue.

What do you mean? How are you running the pipeline - locally or remotely?

2 years ago

0 Hi, I Have Two Instances Of Clearml-Server That I Would Like To Merge Into One. Is There Any Way To Do That Without Loosing Tracked Experiments, Datasets Or Artefacts? Additionally, Do You If It Is Possible To Backup Clearml-Server

Yes. However I don't think you need to backup Redis as it holds only data related to the currently running agents.

7 months ago

0 Hi Clearml Community, Is There A Way To Install Additional Packages On Top Of Base Docker Env When Using

Hi @<1797800418953138176:profile|ScrawnyCrocodile51> , you can use Task.add_requirements to add any packages. Additionally, you can also install packages with the docker bash init script

6 months ago

0 Hi! I'M Trying To Set Up Clear Ml, I Don'T Know How To Setup Azure Container Storage, For Some Reason It Raises Errors. I Tried This

Hi @<1739818374189289472:profile|SourSpider22> , are you using the self deployed server?

one year ago

0 Hi, I Am Giving Another Try To Clearml-Session And I Am Blocked At The Current Error Shown When The Cli Try To Establish The Tunneling:

Well not really

Please elaborate 🙂

3 years ago

0 Hi Folks! Is There A Way To Programmatically Create Users And Groups On A Server? If So, Can Someone Point Me To The Docs? Thanks

It's supported 🙂

one year ago

0 Hey Everyone! I’M Currently Trying To Set Up Hyperparameter Optimization With Clearml On A Base Experiment Using Hydra. I Got Everything Working From The Examples. However, The Child Experiments Started By The Optimization Don’T Seem To Actually Get The N

In the task hyper parameters section you have a section called Hydra. In that section there should be a configuration called _allow_omegaconf_edit_ , what is it set to?

3 years ago

0 I Know At Least One Other Person Has Posted About This Previously, But When I Interact With

Hi @<1533620191232004096:profile|NuttyLobster9> , what version of clearml SDK are you using and is it a self hosted server or not?

2 years ago

0 Hi There, I Am Looking For A Way To Use The Hyperparameter Optimization Tool From Clear Ml, For Different Algorithms I Build. The Idea Is, That I Can Use A Command Line To Specify Which Algorithm I Want To Optimize, And Let Clear Ml Do The Rest. The Issue

Hi @<1649946171692552192:profile|EnchantingDolphin84> , what about this example?
None
Add argparser to change the configuration of the HyperParameterOptimizer class.

What do you think?

one year ago

0 We Use Environment Variables In Our

You don't load the configuration during from clearml import Task config is loaded during Task.init() So you can make all your configuration additions up to the point Task.init() is run

3 years ago

0 Hey, I Use

Does this reproduce if you run it as a single task and not a pipeline?

6 months ago

0 Hi All, I’M Running Experiments Using Clearml. The Training Is Very Slow, And I’M Getting The Following Errors And Warnings:

docker-compose.yml file you used to set up the server

3 years ago

Exactly 🙂

2 years ago

0 I Have The User/Pass Set Up On The

Did you set your password or an access token? Also, please try sticking to a single thread per topic and not multiple messages, it spams the channel

11 months ago

0 Hi, Dear All, I Have A Quick Question Regarding The Scalar Graph. As You Can See In The Picture Down Below, The Experiment Names Are Too Short When You Hover And Illustrations Are Not So Useful When You Have To Scroll To Check The Meaning Of Each One.

ColorfulRaven45 Hi!

I'm afraid this is kind of a plotly limitation. Currently you can switch to full screen view OR hit the maximize graph button (it shows on over) for a better view.
We'd be happy to take a suggestion though 🙂

4 years ago

0 I Have The User/Pass Set Up On The

and each individual machine in the process

11 months ago

0 Hi Guys, I Have Been Pondering How Does Clearml Generate The "Installed Packages" List. I Triggered My Training Through Machine A (With Some Python Packages) And The Actual Training Is Done In A Docker Container (With Both Global Packages + Packages Insta

You need to use a docker image that already has the cuda package installed. Also don't forget to run the agent in --docker mode 🙂

4 years ago

0 Hey, When We Change In Our Clearml Conf Local Cache To Our Mounted Nas Drive (Default_Base_Dir: "/Nfs_Client/.Clearml/Cache") Download Speed Is ~50 Times Slower. Did Anybody Encountered This Issue And Or Know How To Fix It ?

Did you download the same data directly to the NAS and it took 5 secs?

one year ago

0 Hello, Is There A Way To Pull Dataset From A Local Hdd When Using Pipeline As Function?

I think it's the same usage as it were a regular task. Did you encounter any issues?

2 years ago

0 Hi Everybody! I Am Currently Having Trouble With Clearml Remote Agents Not Getting The Latest Version From My Git Repo. I'M Running My Pipeline Controller Locally, From Inside The Repo, And Clearml Seems To Detect This Correctly. When The Steps Run, Th

Hi @<1760474471606521856:profile|UptightMoth89> , what if you just run the pipeline without run locally and then enqueue it (assuming you have no uncommitted changes)

one year ago

Show more results