CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 How Is This Possible. Gpu_Mem_Used Gb Is 0 But Usage In % And Gpu Utilization Is High.

Hi DrabCockroach54 , what version of ClearML are you using? What OS is this running on?

2 years ago

0 Hi, Is There A Way To Add The Sdk

I'm reading on task.set_credentials at the moment. What exactly are you trying to do?

3 years ago

0 Hey All, Im Using S3 As Files_Server. When I Run A Task Not In A Docker Everything Works, That I Run The Same Task In A Docker I Get: Raise Valueerror("Could Not Download Dataset Id={} Entry={}".Format(Self._Id, Data_Artifact_Name)) Valueerror: Could Not

Are you running both locally? Is the agent's clearml.conf configured with the credentials as well?

3 years ago

What was the problem?

3 years ago

Cool, let me take a look and see what can be done 🙂

3 years ago

Are you running it inside a docker yourself or is it run via the agent?

3 years ago

When the docker runs, does it print out the aws user key correctly?

3 years ago

You ran the same exact command for agent one with --docker and one without --docker and the one without managed to reach the files?

3 years ago

0 Hi Everyone! I'M Trying To Make Use Of Remote Execution In Clearml, But I Keep Getting An Error After The Agent Clones The Repo On The Remote Machine:

Hi @<1625666182751195136:profile|MysteriousParrot48> , how did you run the original experiment? Can you add the full log and also the agent configuration?

one year ago

0 Once I Set Up A Clear Ml Server On A Machine. I Understand I Need An Agent Listening On A Queue To Run Code. Do I Absolutely Have To Have An Agent And The Gpu On The Same Machine As The Server? Also Do The Gpu And Agent Have To Be On The Same Machine?

Yes 🙂

3 years ago

0 Hi, I'Ve Been Using Your Saas Platform For Over A Month Now, But Today I Suddenly Noticed Most Of My Data Is Missing, I See That I Have 40 Tasks In My Data Project From The Dashboard As It Should Be, But Inside The Project I Can Only See 6, I Couldn'T Fin

What command are you trying to run?

3 years ago

0 Hi, I Am Running An Optimization Task With Optimizeroptuna (Using Your Doc

Which file are you referring to? Can you link it?

3 years ago

0 Is Is Intended That Restarting The Server Somestimes Leads To Abortion Of Experiments On Clearml-Agents

I don't think this the intended behavior. Can you please elaborate how it happens exactly?

3 years ago

0 Hi! I Am Implementing A Cleanup Service. After Completing Several Training Tasks, I Am Only Interested In The Trained Models And Some Artifacts Resulting From The Training Process (Such As Scalers, Etc.). Therefore, I Would Like To Remove All The Tasks Th

GiganticTurtle0 Hi 🙂

You could try saving them as OutputModel ( https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel ) thus saving them 'outside' of the task object. Regarding if it's considered a good practice or not maybe AnxiousSeal95 can add up on that.

3 years ago

0 How Can I Start The Clearml Server After Creating Ec2 Instance From Ami? Running

This is strange. Can you take a look inside the apiserver & webserver to see if there are any errors?

3 years ago

0 Hi Everyone, I’M Playing With Datasets In Clearml. I Can Successfully Register Them, But I’M Not Entirely Clear How To Attach A Plot To It. If I Create A Task, My Plots Are Auto-Logged, But To Attached The Task, Not To The Dataset As I Would Like To.

You can add scalars/plots manually with the following:
https://clear.ml/docs/latest/docs/references/sdk/logger#report_scalar
And you can see usage in the following example:
https://github.com/allegroai/clearml/blob/master/examples/reporting/scalar_reporting.py

You can also report various plots as shown in the following examples as well:
https://github.com/allegroai/clearml/blob/master/examples/reporting/scatter_hist_confusion_mat_reporting.py
https://github.com/allegroai/clearml/blob/...

3 years ago

0 Is There A Way To Serve A Model Via The Sdk Or Rest Api? I Want To Programmatically Serve The Model After Finishing Training It Via The Pipeline. Or Is It A Bad Practice To Do So, Hence Why It'S Not Really Exposed?

Hi @<1567321739677929472:profile|StoutGorilla30> , this is a good question. I would assume that the CLI tool uses API calls under the hood. I think you can either look at the code and see what is being sent or simply do CLI commands from the code

2 years ago

0 Hi! I'M Using

MagnificentSeaurchin79 , can you please describe how you created the dataset?

3 years ago

0 Hey. Seeing A Strange Error When Trying To Install A Private Python Package When The Agent Executes The Task. We Use Aws Codeartifact As The Private Pypi Repository. The Agent Attempts To Install The Package From Git, Rather Than A Regular Pip Install And

Hi 🙂

How do you provide the package path to the agent? Also can you attach the log of the agent?

3 years ago

0 Hi All, I Would Like To Put Table With Url Links And Image Thumnails. I Was Able To Get Url As Hyper Link However I Couldn'T Get Thumnails. Any Idea? My Code :

Hi StraightParrot3 ,

I'm not sure if thumbnails are supported inside tables. AgitatedDove14 , what do you think?

3 years ago

0 I Get An

I just want to make sure that the file itself is valid first 🙂

3 years ago

0 Hi Clearml! Our It Department Setup A Clearml Server On Aws Now I Would Like To Export The Tasks And Data From The Private Local Server To The New One. The Problem Is That There Is Already Users, Tasks And Data On The New Server - How Can We Do That?

BattyLizard6 Hi!

In the basic scenario where the database is empty on the new server you'd simply need to copy /opt/clearml/ from the old server to the new. In the case that a data merge is needed I'm not sure, let me check 🙂

3 years ago

0 Hi, I Just Started Working With Clearml And I Have A Question About One Of My Plots. Fig 1 Is What It Looks Like In My Pycharm Output. Fig 2 Is What Is Logged In The Clearml Server. Why Does The Figure Change So Drastically? And How Can I Solve It? Sideno

TartSeagull57 , you said the problem was with automatic reporting. Can you give an example of how you solved the issue for yourself?

3 years ago

0 Hi All! When I Try To Run Tasks For A Agent On Machine Without Gpu This Error Occurs:

Please do 🙂

2 years ago

0 Hello, I Had A Setup For Training Ml Model Of Multiple Sub-Modules, Used Pipelines From Task. Didn'T Run It For 4 Months, Was Working Fine Back Then, Now When I Run Pipeline, Steps Are Being Run And Completed Emty, No Console Log, No Stats, Nothing, What

the container logs that is

one year ago

0 I Think There Is Some Bug With Clearml==1.7.1. I’M Working With Pipelines And After Updating To

Hi PricklyRaven28 , do you have a small snippet to play with?

2 years ago

BattyLizard6 , I'm afraid that the data merge between servers is not supported in the open source version 🙂

3 years ago

0 Hi, Does Anyone Know If There Is A Way To Have The Dataset Graph That Tells Us Which Dataset Was Created From Which Other Ones Without Setting The Previous Datasets As Parents? We Have Large Raw Datasets That Are Used To Create Several Smaller Ones, And I

Hi @<1523703397830627328:profile|CrookedMonkey33> , not sure I follow. Can you please elaborate more on the specific use case?

Currently you can add plots to the preview section of a dataset

one year ago

0 Hi, We Are Storing Lots And Lots Of Scalars On Worker Resource And Queue Stats. This Totals To About 29 Gb. Is There Any Way Of Limiting The Amount Of Stats Being Logged? We Are Not Very Interested In The Worker Stats And 11G For Just Monitoring The Queue

Hi @<1523701601770934272:profile|GiganticMole91> , I think you can delete those indices

5 months ago

Hi @<1623491856241266688:profile|TenseCrab59> , are you self deployed? Can you provide some logs/screenshots? If you go directly into the task information of each step there console is empty?

one year ago

Show more results