CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Hello, Is There A Way To Check Whether The Experiment Was Run From Cli (E.G. Using Clearml-Task) Or By Clone+Enqueue From The Api, I Mean From The Code While The Experiment Is Running?

ResponsiveHedgehong88 , please look here:
https://clearml.slack.com/archives/CTK20V944/p1660142477652039
Is this what you're looking for?

3 years ago

0 Hi! My Agent Has Very Limited Disk Space. And When A New Task Is Launched And The Loading Of New Data Begins, There May Not Be Enough Space. Is There A System For Automatically Clean Up Old Currently Unused Data In

DepressedFish57 , I'm not sure there is something for this. There is a cleanup service to kill old failed/aborted tasks but to clear caches you'd have to handle it manually 🙂

3 years ago

0 Please Explain The Forward Steps To Continue

Hi @<1557174909573009408:profile|LargeOctopus32> , I suggest you through the introduction videos on ClearML's youtube channel
None

2 years ago

0 Hi There, I Have A Bit Of A Problem With Aws Secrets: I Pass Keys As Env Var To Clearml-Agents To Retrieve Data From A Bucket In Us-East-1 But I Use A Bucket To Store Task Artifacts In A Bucket In Eu-Central-1. So When I Pass Aws Keys As Env Vars, The Tas

JitteryCoyote63 , can you try upgrading to the latest versions? Is there any reason why you stayed on older versions?

3 years ago

0 Hello! I Have A Problem:

Hi DeliciousKoala34 , is there also an exceptionally large amount of files in that Dataset? How do you create the dataset? What happens if you use something like s3 if you have available?

2 years ago

0 Hello All! I'M Writing To Express My Gratitude For Supporting Such A Great Platform As Clearml, Which I'Ve Been Actively Using Lately. I'M Running Experiments Based On Yolov5, And This Code Is Automatically Sending Various Information To The Clearml Serv

Hi @<1547752799075307520:profile|ZippyCamel28> , to address your points

What do you mean by 'reload'?
You need to go into the project and archive the experiments in order to delete the project + experiments in the archive
There are some configurations you can play with to report 'less' metrics. For example sdk.metrics.plot_max_num_digits You should read here - None . To get an idea of the size of an experiment think of an...

2 years ago

0 How

Hi HappyDove3 ,

I think you would need to go through the various sections of the API ( https://clear.ml/docs/latest/docs/references/api ) and see what needs to be moved. Basically you need to export all tasks and their events and everything else that might be on your workspace

2 years ago

0 Clearml Hyperparameters Optimization App Produces "Summary" Table With 'Task Id', Hyperparameters Values And 'Obective'. Is There A Way (== Function) For Adding Some Custom Data For This Table?

The reports is a separate area, it's between 'Pipelines' and 'Workers & Queues' buttons on the bar on the left 🙂

2 years ago

0 Hi All! Please Tell Me What Will Happen If You Set The File Store Address The Same As On The Web? If I Set Different Addresses, Then The Link That Is Generated When Creating The Task Is Not Clickable And I Need To Change The Port To The One On The Web.

Also, is there a reason you don't want to work with the default ports provided in the docker-compose.yml ?

3 years ago

0 Question About Pipeline And Long-Waiting Tasks: Say I Want To Generate A Dataset. The Workflow I Have Requires

Hi RoughTiger69 ,

Have you considered maybe cron jobs or using the task scheduler?

Another option is running a dedicated agent just for that - I'm guessing you can make it require very little compute power

3 years ago

0 I'M On The Machine With Clearml Server Hosted. Is There Any Way To See Datasets Uploaded To Clearml Data Without Downloading Them Using Clearml Data?

Do you mean see the datasets in the UI?

3 years ago

0 Hi! Once Again, I'M Having Trouble With The Autoscaler. If The 'Setup Shell Script' Field Is Present, The Task Won'T Start. It Woulf Install All The Requirements In The Newly Created Instance And Then Stop. My Setup Script Is:

Hi @<1564785037834981376:profile|FrustratingBee69> , you can simply run the agent without the --docker command

one year ago

0 Hi Clearml Team, I Am Trying To Figure Out The Best Practice To Keep Track Of Different Models. The Lineage Functionality In The Models Tap Is Generally Helpful. But First Of All, I Need To Be Able To Find Which Project A Model Belongs To, Then Navigate T

My bad, you're looking for the project attribute

6 months ago

0 Hi, I Want Clearml To Not Install Packages From My Pycharm Environment, But Activate An Environment I Have Locally On The Computer The Agent Is Installed On, Is The Variable Clearml_Agent_Skip_Pip_Venv_Install Relevant To This, And If So Can I Configure I

You're running your experiment from pycharm? Are you using the same environment in pycharm for all your experiments and you want the task to take packages from your 'agent' environment?

3 years ago

0 Hello Everyone. I Was Following The Docs About Creating Pipelines Using Decorators (As It Looked Really Neat). Everything Worked Well For My Example, But I'Ve Noticed That Much Time For Building The Container Was Taken By Installing Packages That Weren'

I was also curious if I've missed an easy way to mention required packages for the controller, like you can do that in components (by providing

packages=[...]

).

I think you can do this using https://clear.ml/docs/latest/docs/references/sdk/task#taskadd_requirements
I'm not sure how the pipeline controller is handled but it still should be regarded as a task on a deeper level.

Meaning that you might need to use task = Task.current_task() and then ` task.add_r...

3 years ago

0 Hi, Is There A Way To Access The Clearml File Server? I Would Like To Check If An Artifact Object Has Been Deleted Or Not.

Hi @<1679661969365274624:profile|UnevenSquirrel80> , are you running a self hosted server?

one year ago

0 Hi Team, I Have A Hosted Clearml Server. When I Upload A Large Artifact (Around 25Mb) To The

Maybe @<1523701087100473344:profile|SuccessfulKoala55> or @<1523701827080556544:profile|JuicyFox94> might have some insight into this 🙂

2 years ago

0 Hey Currently Trying To Run A Pipeline Locally To Test A Pipeline Component With

Didn't have a chance to try and reproduce it, will try soon 🙂

2 years ago

0 Hpo Question: I Created Hpo App In Clearml Ui, With Certain Parameter To Optimize, With Minumal Value=0.0, Max=1.0 And Step=1.0. So As Far As I Understand This Hpa Should Launch 10 Experiments. In Fact, It'S Launching Tens Of Experiments (>30 And Still

Hi AttractiveShrimp45 . You input min value as 0, max value as 1 and step as 1?

2 years ago

0 Hello, Is It Possible To Use Clearml-Serving To Serve A Model Built With Scikit-Learn'S Gridsearchcv Pipeline? I'M Asking This Question Because When I Test It, I Get An Error.

Hi @<1673501397007470592:profile|RelievedDuck3> , should be possible. What errors are u getting?

one year ago

0 Is There More Info On How To Set Up Clearml-Agent In Kubernetes Than At These Links?

Also, is the Pro plan autoscaling option the only way to run clearml in the cloud without having a dedicated VM that’s running all the time?

Yes, GCP autoscaler is only available in the PRO & Scale/Enterprise

2 years ago

0 Is There A Way To Clear Clearml Caches, Maybe Some Command? My Server Ran Out Of Space And I Lost A Whole Weekend Of Training. My

Hi @<1523702786867335168:profile|AdventurousButterfly15> , I think this is what you're looking for - None

2 years ago

0 Hi, Community! How I Can Manage Accesses Of Different Users To Warkspaces Or Projects In Clearml Server?

Hi AbruptHedgehog21 ,

Access controls appear only in the enterprise version

3 years ago

0 I Am Doing Port Forwarding Of Ports From Localhost Clearml Server In Ec2 Instance To The Ports In Laptop Locally. I Am Able To Login To The Server And Generate The Credentials But I Am Not Able To Create Task

Or when running something and uploading to a s3?

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

And orchestration 🙂

3 years ago

0 Hi Everyone! I Have A Question Regarding Events-Training_Stats_Scalar-D1Bd92A3B039400Cbafc60A7A5B1E52B Index Its Size Is 93 Gb And It Initialises For 6 Hours. Can I Decrease Size Of This Index?

Hi @<1579280543999070208:profile|SourFly7> , this index holds scalars of some experiments. You can reduce it by deleting some experiments. Do you have any other large scalar indices?

2 years ago

0 Hello All, I'M Trying To Adapt Clearml With My Workflow. I Installed A Server At My Server, With Workers Attached To It. I'M Trying To Execute A Task From My Local Within One Of My Workers. Trying To Use Docker Mode And A Custom Image. I Also Have A Local

However, when I try to bind a volume and run the code, everything runs perfectly.

Can you please elaborate on what this means?

3 years ago

0 Hello, I Want To Use Custom Packages In My Code.It Works Fine When I Run It Locally.But When I Clone The Experiments And Run On Agent It Shows Package Not Found Error In Agent. Can Anyone Help Me Out How To Use Custom Packages In Clearml? Which Parameter

Sorry, not available for calls

2 years ago

0 Hi Folks, Happy New Year! I'M Running Into A New Bug In The Webapp Where I Compare Two Or More Experiments, But The Plots Only Show One Of Them (I.E. There'S Two Plots Shown Side-By-Side But They'Re Actually Both Just The First Experiment That Was Selec

Hi @<1618780810947596288:profile|ExuberantLion50> , do you have any sample code that reproduces this issue?

one year ago

0 Hi Team,Could We Schedule The Pipeline Execution For Particular Time In Clearml ?If So Please Provide Some Example Codes.

Hi @<1542316991337992192:profile|AverageMoth57> , I think this is what you're looking for 🙂
None

2 years ago

Show more results