CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 I Am Using Clearml Pro And Pretty Regularly I Will Restart An Experiment And Nothing Will Get Logged To Clearml. It Shows The Experiment Running (For Days) And It'S Running Fine On The Pc But No Scalers Or Debug Samples Are Shown. How Do We Troubleshoot T

@<1719524641879363584:profile|ThankfulClams64> , if you set auto_connect_streams to false nothing will be reported from your frameworks. With what frameworks are you working, tensorboard?

one year ago

0 Clearml_Agent: Error: Command '['/Root/.Clearml/Venvs-Builds/3.8/Bin/Python', '-M', 'Pip', '--Disable-Pip-Version-Check', 'Install', '-R', '/Tmp/Requirements_Hhemiomd.Txt']' Died With <Signals.Sigkill: 9>.

Well it sounds like it makes some sense. Try the following on the machine running the agent - In ~/clearml.conf
edit the following section:
agent.vcs_cache.enabled=False

3 years ago

0 Is The

I don't think it's currently updated but the team is working on updating it. Hopefully it will be updated very soon 🙂

2 years ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

When looking at the base task, do you have that metric there?

3 years ago

0 Hello Everyone, When I Try To Connect To My Clearml Server Using Clearml-Init, I Encounter This Error.

Hi SourLion48 , what if you try inserting the credentials etc individually? Are you using a self hosted server? Is it behind a proxy by chance?

3 years ago

0 Hi I Am Creating A Custom Image Dataset And Does Anyone Know How To Upload Files Into Remote Uri (S3) Without Compressing The Data?

Hi @<1698868530394435584:profile|QuizzicalFlamingo74> , Try compression=False

one year ago

0 Hi All! I Am Trying To Run The Notebook From The Remote Server Using Aws. It Seems Like I Successfully Installed Clearml Using !Pip Install Clearml Command, But When I Am Trying To Run !Clearml-Init I Got The Following Error: /Bin/Bash: Clearml-Init: Comm

Also please note that your path is wrong

3 years ago

0 Traceback (Most Recent Call Last): File "/Root/.Clearml/Venvs-Builds/Task_Repository/Slot-Filler.Git/2_Engineer_Prompts.Py", Line 159, In <Module> Trainer.Train() File "/Root/Miniconda3/Envs/Ml-Training/Lib/Python3.9/Site-Packages/Transformers/Tra

Can you please elaborate more on what is happening in your code while this occurs, Can you add the full log?

2 years ago

0 Hi Team, I Am Trying To Start The Clearml With Opensearch As Backend Instead Elastic Search , When I Started The Service I Am Seeing Partial Web Ui As Below Kindly Help Me In Which Module I Should Look Into It To Get Complete Functionality. No Errors I A

Hi @<1727859576625172480:profile|DeliciousArcticwolf54> , I'd suggest debugging using developer tools in the webUI. Also, are you seeing any errors in the API server or webserver containers? I'd suggest first testing with elasticsearch to make sure that the deployment went through OK and this is not related to something else.

Out of curiosity, why do you want to use opensearch instead of elasticsearch?

one year ago

0 Hi I’M Trying To Schedule The Tasks Execution Using

Hi @<1706116294329241600:profile|MinuteMouse44> , is there any worker listening to the queue?

12 months ago

0 As Soon As I Refactor My Project Into Multiple Folders, Where On Top-Level I Put My Pipeline File, And Keep My Tasks In A Subfolder, The Clearml Agent Seems To Have Problems:

Hi @<1724960468822396928:profile|CumbersomeSealion22> , what was the structure that worked previously for you and what is the new structure?

one year ago

0 Hi, May I Ask If There Is A Good Way To Get The Details Under Clearml Task "Info" Tab (Output As Json/Python Dict) Using Python Codes?

Hi OddShrimp85 , you sure can! You can use the API. This one is useful for getting data about specific tasks. I think you'll have to sift through the response to find what you need 🙂

2 years ago

0 Hey Everyone Looking To Get Some Input How Clearml Server Set Tasks Status How Does Server Differentiate Between Tasks In Different States:

Hi @<1523701842515595264:profile|PleasantOwl46> , what do you mean more details about the state? Usually in the INFO section of the task you have all history of actions

5 days ago

0 Hi, I'M Using Fractional Gpu Container, But I Can'T Profile Any Thing, The Nsys Says Only "Segmentation Fault (Core Dumped)" Can You Guys Help Me And Do You Know What Is Wrong With This?

Can you provide the log though? Where you got there error?

one month ago

0 Hi, I'M Using Fractional Gpu Container, But I Can'T Profile Any Thing, The Nsys Says Only "Segmentation Fault (Core Dumped)" Can You Guys Help Me And Do You Know What Is Wrong With This?

Hi, can you provide the full log?

one month ago

Try setting the following environment envs:
%env CLEARML_WEB_HOST= %env CLEARML_API_HOST= %env CLEARML_FILES_HOST= %env CLEARML_API_ACCESS_KEY=... %env CLEARML_API_SECRET_KEY=...and try removing the clearml.conf file 🙂

3 years ago

0 Hi Everyone, I'M New To Clearml And I Want To Run A Task On A Remote Host Inside A Docker Container. The Python Interpreter I Need To Use Is Located At

@<1564060263047499776:profile|ThoughtfulCentipede62> , you can run the agent twice on different queues - one with docker one without

2 years ago

0 Clearml Hyperparameters Optimization App Produces "Summary" Table With 'Task Id', Hyperparameters Values And 'Obective'. Is There A Way (== Function) For Adding Some Custom Data For This Table?

Hi @<1523701062857396224:profile|AttractiveShrimp45> , I'm afraid not. But you can always export these tables and plots into a report and add your custom data into the ClearML report as well

2 years ago

0 Hello Everyone Again! So, I Have A Bit Of An Issue This Time Where Sometimes Clearml Won'T Be Able To Find A File On S3, Occasionally It Logs A 503 Error Too Where It Has Exceeded Its 4 Max Retries. So, Essentially, It'S A Server Problem In A Way. Howeve

Hi @<1724235687256920064:profile|LonelyFly9> , what is the reason you're getting 503 from the service ?

one year ago

0 Here'S My Question. I Have A Free Account On App.Clear.Ml And I'M Trying To Create A Dataset Consisting Of Images And Masks (Jpgs And Pngs). I Use The Following Commands:

Hi @<1864479785686667264:profile|GrittyAnt2> , for that you would need to specify --output-uri in the create command - None

This will point all previews also to the storage of your choice. Note, however as a NAS is considered part of your local disks, the browser cannot access local disk and therefor previews will not work.

For local storage solutions I suggest using something like MinIO

one month ago

0 Is It Possible To Use The Resource Configuration (

Hi @<1578555761724755968:profile|GrievingKoala83> , I'm afraid that's an Enterprise/Scale only feature

5 months ago

0 The Comparison Page Seems To Resize The Experiments So That All Tags Will Fit In The Screen, But Then The Experiments Are Pretty Much Impossible To Compare

Huh, what an interesting issue! I think you should open a github issue for this to be followed up on.

If you remove the tags the page resizes back?

3 years ago

0 Hi, I Am Using Spot Instances (Launched By Auto-Scaler Pro Service), But I See That Sometimes The Instance Is Suddenly Terminated And The Task Status Is Still 'Running' ( And Not 'Failed' Or Something Else

Hi SmugTurtle78 , this issue is handled in the coming update of ClearML PRO

3 years ago

0 Monitoring Related Question

Hi @<1607909176359522304:profile|UnevenCow76> , I suggest you review the following video on serving - None

This also explains how to visualize different metrics in Grafana

2 years ago

0 Hi, When Running A Training Script From Pycharm, It Seems That Clearml Logs Only Those Packages That Are Explicitly Imported By My .Py Files; It Seems To Not Take The Pacakges That Are In The Requirements.Txt My Training Uses Keras

RoughTiger69 Hi!

Regarding your questions:
You can use the following: Task.force_requirements_env_freeze(requirements_file='repo/some_folder/requirements.txt') before your task=Task.init(...) You can configure sdk.development.detect_with_pip_freeze=true in your ~/clearml.conf file for full env detection from the environment you're running from

4 years ago

0 Hi, Can We Specify The Limit And Request Resource Differently For The Workers Spawned By The Clearml Agent? So Some Tasks May Require A Lot Of Ram, But Other Tasks Don'T. So I Don'T Them To All Request The Same Amount Of Resource To Run. Edit: My Clearml

Hi GrittyCormorant73 ,

Did you define a single queue or multiples?

3 years ago

0 Hi Everyone!

Hi @<1820993248525553664:profile|DisturbedReindeer69> , I think you're looking for the --output-uri parameter in clearml-data create - None

5 months ago

0 Hi All, The Version Of Clearml Published On The Web Is 3.13.

Hi SucculentWoodpecker18 ,

The two are a bit different, this is why the versions are different. Functionality wise they should be almost the same - And bugs shouldn't be present in either. Do you have a code snippet that reproduces this behavior?

2 years ago

0 Hi Clearml, I Tried To Upgrade The Clearml Server Following This

SarcasticSparrow10 , please note that during the upgrade you do NOT copy /opt/clearml/data/mongo into /opt/clearml/data/mongo_4 , you create the folder like in the instructions: sudo mkdir /opt/clearml/data/mongo_4

This is the reason that it is giving out errors - You've got old mongo data in your mongo 4 folder...

Please follow the instructions to the letter - this should work 🙂

3 years ago

0 Hi Clearml, I Tried To Upgrade The Clearml Server Following This

SarcasticSparrow10 , it seems you are right. At which point in the instructions are you getting errors from which step to which?

3 years ago

Show more results