CostlyOstrich36

0 Questions, 3694 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3694

0 Hey, I Tried To Use

Which version for clearml-data are you using?

2 years ago

0 Hello Everybody, I'M Seeking For A Clarification On The 'Metrics' Quote For The Saas Platform. My Workspace Only Uses Self S3 Storage As The File Server To Store Artifacts, Datasets And Models. For Some Reason, My 'Metrics' Quota Is Blown Up By > 30Gb Of

Hi @<1523703961872240640:profile|CrookedWalrus33> , metrics are considered as scalers, logs, plots, and the experiment objects themselves that are saved in the backend databases.

You must be reporting some very metric heavy experiments 🙂

one year ago

0 Hey Guys, First Of All Clearml Rocks! I Love It

Strange, maybe @<1523701087100473344:profile|SuccessfulKoala55> might have an idea

one year ago

0 Hi Everyone! How Do I Disable Automatic Reporting Of Matplotlib Plots And Images?

Hi @<1523707653782507520:profile|MelancholyElk85> , in Task.init() you have the auto_connect_frameworks Parameter.

None

one year ago

0 Got Something Very Wrong With My Pipeline, The Pipeline Plot Shows It Has An Experiment

Can you provide a snippet to try and reproduce?

2 years ago

0 Hi, I Am Able To Execute The Task Locally, But The Same Task Fails When Executed On Remote Cloud Machine, I Think The Error Is Due To The Fact That Local Machine Is Windows And Remote One Is Linux Because The Error Is Around Pywin Which Can'T Be Installed

You can add it manually to the requirements

one year ago

0 Using

WackyRabbit7 ,I am noticing that the files are saved locally, is there any chance that the files are over-written during the run or get deleted at some point and then replaced?

Also, is there a reason the files are being saved locally and not at the fileserver?

I couldn't manage to reproduce it on my end. But also in my cases it always saves the files to the fileserver. So I'm curious what's making it save locally in your case

3 years ago

0 Good Day To All. I Am Moving From One Mlops Framework To Clearml And Have A Question On Git Integration. In My Prev Framework Each Ml Project Had A Specified Git Repository Url To Keep Track Of Changes In Train.Py, Score.Py And So On. How Is Git Integrati

Hi GentleSwallow91 ,

ClearML has seamless integration with git. ClearML automagically detects the repository the code was run from, specific commit AND uncommitted changes. Each experiment has it's git data logged individually. You can see this in the 'Execution' section in the webUI.

2 years ago

0 Hey Clearml, Pipeline From Tasks: Following This Example

Hi @<1523701283830108160:profile|UnsightlyBeetle11> , I think you can store txt artifacts so you can store the string there. If it's not too long, you can even fetch it from the preview

one year ago

0 Hello, Clearml! Let'S Say That I Have A Git Repository In Format

What about if you specify the repo user/pass in clearml.conf?
I think it removes the user/pass so it wouldn't be shown in the logs

one year ago

0 Hi Again:) Is There A Similar Way Like

Hi 🙂
I think you can do it quite easily through the API

2 years ago

0 Hi I Am Having Issue With Pipeline. Even My Every Task Of Pipeline Is Completed, My Core Pipeline Controller Is Still Running. I Have Added Pipe.Wait() And Pipe.Stop() As Well. Attached Pic Shows The Pipeline In Running State, And Tasks In Completed Stat

Hi @<1585078763312386048:profile|ArrogantButterfly10> , does the controller stay indefinitely in the running state?

one year ago

0 Weird Error; My Local Execution Hung With

And when you run it again under exactly the same circumstances it works fine?

2 years ago

0 Is There Any Way To Change The X-Axis On The Charts For Scalars, To Say E.G. "Epochs" Instead Of "Iterations"? Or Is That Hardcoded?

What is the best way to achieve that please?

I think you would need to edit the webserver code to change iterations to epochs in the naming of the x axis

one year ago

0 Is There Any Way To Change The X-Axis On The Charts For Scalars, To Say E.G. "Epochs" Instead Of "Iterations"? Or Is That Hardcoded?

Yeah, I understand the logic of wanting this separation of iteration vs epoch since they sometimes correlate to different 'events'. I don't think there is an elegant way out of the box to do it currently.

Maybe open a GitHub feature request to follow up on this 🙂

one year ago

0 Hi Everyone! I Have A Question Regarding Running A Script Inside Docker Container With Clearml: I Build An Image Containing All Requirements To Run Some Python Script That Is Getting Arguments Via Argparse. When I Build A Wrapper Script That Will Run This

I would suggest structuring everything around the Task object. After you clone and enqueue the agent can handle all the required packages / environment. You can even set environment variables so it won't try to create a new env but use the existing one in the docker container.

one year ago

0 Hi Everyone! I Have A General Wondering - I'M Trying To Use Rest Api For Searching Tasks By Tasks Parameters (Hyperparameters In Task Configuration). I Didn'T See Which Query-Params To Send For Getting The Matching Task(S). Does Someone Knows The Answer?

Hi @<1539417873305309184:profile|DangerousMole43> , I would suggest opening developer tools (F12) and then doing the specific search you're interested in through the UI. Then you can simply send the same via the REST API

one year ago

0 Hi Everyone, I Have A Task That Installs A Python Requirement From Bitbucket Over Ssh. The Requirement Are Defined In A Requirements.Txt File. In The Agent, That Task Fails Buiding The Environment With The Following Error:

@<1523703961872240640:profile|CrookedWalrus33> , pip instal clearml==1.5.3rc1

one year ago

0 Dear All, Great To Join Your Community. We Are Working On Plant Growth Stage Models At Basf For Farmers And I Was Wondering If Clearml Can Be Used Also For Data Versioning Of Tabular Data, Structured Data. I Would Like To Track If This And That Row Is Par

Hi @<1543766544847212544:profile|SorePelican79> , ClearML can certainly do that. For this you have the Datasets feature.
None
This will allow you to version and track your data super easily 🙂

one year ago

0 Is It Possible To Get The List Of Running Agents In My Machine? I’M Starting Multiple Agents Using

@<1570220858075516928:profile|SlipperySheep79> , you can use top or htop to see running processes on your machine...

one year ago

0 Hey Guys Trying To Run A Task On An Agent Using Docker Mode (Machine Has Only Cpu) I Always Get This Error (No Matter The Docker- Image Im Using, I Tried Several): Docker: Error Response From Daemon: Failed To Create Shim: Oci Runtime Create Failed: Runc

Hi @<1544853695869489152:profile|NonchalantOx99> , can you run that docker with the docker run command?

one year ago

0 Hi Everyone ! :) I'M Trying To Test The "One Click Reproducibility" Feature But It Keeps Failing. My Question Is On A High-Level: Is It Normal That This Happen, If Yes, What Are The Common Reasons That Make An Experiment Not One-Click Reproducible ?

I think this is what you're looking for

one year ago

0 I Am Trying To Test And Show The Results On My Local Machine. ( Clearml-Server With

EcstaticBaldeagle77 , please lower all the dockers then run the following commands and then try raising them again.
` sudo mkdir -p /opt/clearml/data/elastic
sudo mkdir -p /opt/clearml/data/mongo/db
sudo mkdir -p /opt/clearml/data/mongo/configdb
sudo mkdir -p /opt/clearml/data/redis
sudo mkdir -p /opt/clearml/logs
sudo mkdir -p /opt/clearml/config
sudo mkdir -p /opt/clearml/data/fileserver

sudo chown -R 1000:1000 /opt/clearml `
Also, where did you find the instructions with 'trains' in it?

2 years ago

0 Hello, Clearml! Let'S Say That I Have A Git Repository In Format

Hi VexedElephant56 , does it fail when it runs on the agent?

one year ago

0 How Do I Disable

Hi @<1523701099620470784:profile|ElegantCoyote26> , what happens if you define the cache size to be -1?

one year ago

0 Weird Error; My Local Execution Hung With

Can you look in the UI if the execution parameters were logged?

2 years ago

0 After Saving Models During Training I Cant Reuse The Same Task To Continue Training Is There Any Way To Continue Task Even Though There Are Models Saved? Alternatively Is There Any Way To Make Torch.Save Not Automatically Save The Model?

StaleButterfly40 Hi!
You could clone the original task and edit the input model of the new task as the output model of the previous task 🙂

3 years ago

0 Hi Again:) Is There A Similar Way Like

You can use the API to call tasks.get_by_id and get that specific information. In the response it sits in
data.tasks.0.completed

2 years ago

0 Hi, I Hope Someone Can Help Me With The Following Problem: I Have Been Using Clearml For Some Time And Have Many Projects And Experiments. Today, For The 1St Time, I Tried Cloning An Experiment. After Enqueueing The Cloned Experiment (As Explained

BTW - did the agent print out anything? Which version of clearml-agent are you using?

2 years ago

0 Hi, When Running A Task To Training On The Clearml Agent It Installs Packages Not With The Correct Version That My Requirments.Txt Has, I'Ve Installed A Environment Manually For The Requirements.Txt And It Installs The Correct Versions However On The Agen

By default the agent will try to install packages according to what was logged in the 'installed packages' section of the task in 'execution' tab

one year ago

Show more results