CostlyOstrich36

0 Questions, 3782 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3782

0 Hi Everyone, Is It Possible On Clearml, Before Run A Task Using By Agent/Remotely We Can Implement Some Script Python? The Usecase Here I Want To Export Some Env Settings Before Task Started Execute.

Hi @<1523701260895653888:profile|QuaintJellyfish58> , if you run in docker mode you can easily add environment variables.

Can you elaborate a bit on your use case? If it's python code, why not just put it in the original file or import from the repo?

one year ago

0 Hi All - I Am Using The Experiment Tracker And I See That Scalars View Is Not Updated After Some Time? In The Console View I See That My Training Job Terminated At Step 708000, Having Logged Scalar Metrics Every 4 Steps, However In The Scalars Pane I See

So early/mid experiment run everything aligned fine?

9 months ago

0 Hi There, I Have A Bit Of A Problem With Aws Secrets: I Pass Keys As Env Var To Clearml-Agents To Retrieve Data From A Bucket In Us-East-1 But I Use A Bucket To Store Task Artifacts In A Bucket In Eu-Central-1. So When I Pass Aws Keys As Env Vars, The Tas

Do you explicitly specify the region?
Also, please try specifying the buckets directly in your ~/clearml.conf

The relevant section is sdk.aws.s3.credentials

It would look something like this:

{ host: "<BUCKET_A_HOST>" key: "<KEY>" secret: "<SECRET>" region: "<REGION>" }

3 years ago

0 Hi Everyone! I Have A Question About

Hi @<1569496075083976704:profile|SweetShells3> , do you mean to run the CLI command via python code?

one year ago

0 Hi All Can You Help Please, I Can’T Find This Information On Official

Hi @<1554638179657584640:profile|GlamorousParrot83> , yes it is supported just like in the AWS autoscaler 🙂

10 months ago

0 Is There A Way To Programatically Access The Tasks A

In the UI you can add 'parent' column and filter by parent

3 years ago

0 Hello, Is It Possible To Install Clearml-Agent Without Using Pip? I Want To Use Docker, But Worried About When Clearml-Agent Execution In Docker Mode Cannot Create Container.

Not sure, let me know what works 🙂

one year ago

0 Good Week, I Tried To Follow The Following Repo

What version of ClearML are you using?

2 years ago

0 Hello, Is It Possible To Install Clearml-Agent Without Using Pip? I Want To Use Docker, But Worried About When Clearml-Agent Execution In Docker Mode Cannot Create Container.

I don't think there should be an issue to run the agent inside a docker container

one year ago

0 Is There More Info On How To Set Up Clearml-Agent In Kubernetes Than At These Links?

Also, is the Pro plan autoscaling option the only way to run clearml in the cloud without having a dedicated VM that’s running all the time?

Yes, GCP autoscaler is only available in the PRO & Scale/Enterprise

one year ago

0 Hi All I Am Would Like To Somehow Prevent Clearml Caching From Caching A Task That Hasn'T Uploaded Artifacts (Using Cache_Executed_Step In

Hi @<1533619716533260288:profile|SmallPigeon24> , can you please elaborate on your usecase ?

one year ago

0 Good Week, I Tried To Follow The Following Repo

Hi! Are you working on a self deployed server?

2 years ago

0 Hi Guys! Is There Any Way To Get Full State Of Dataset From Somewhere, Except My S3 Bucket? I Need A Mapping Of Files And Batches That Were Uploaded As A Dataset. Maybe This Information Is Also Available In One Of The Clearml Databases?

Hi @<1584716355783888896:profile|CornyHedgehog13> , you can only see a list of files inside a dataset/version. I'm afraid you can't really pull individual files since everything is compressed and chunked. You can download individual chunks.

Regarding the second point - there is nothing out of the box but you can get a list of files in all datasets and then compare if some file exists in others.

Does that make sense?

one year ago

0 Hello, I Would Like To Ensure, The Comparison Of Hyperparameters Is Supposed To Work As It Is Depicted In The Screenshot? Following The Example, I Would Suppose To Mark In Red The Change In

Hi CurvedHedgehog15 ,

Can you please provide a short snippet to reproduce this?
In which section are we looking at currently in the comparison?

2 years ago

0 Hi, I Am Still Testing Clearml And Checking If It Is A Good Fit For The Use-Case I Have In Hand And I Was Checking

Hi @<1729309137944186880:profile|GrittyBee73> , It has a python API used under the hood indeed:
None
examples on how to use it: None
[None](https://github.com/allegroai/clearml-serving/blob/724c99c605540cdae25e4ef504c09f705cd53503/clearml_serving/serving/model_request_proces...

4 months ago

0 Hello, Is It Possible To Install Clearml-Agent Without Using Pip? I Want To Use Docker, But Worried About When Clearml-Agent Execution In Docker Mode Cannot Create Container.

Hi QuaintJellyfish58 , you mean like through conda?

one year ago

0 Hi, I Have A Pipeline Designed Whenever I Run That All The Steps Will Be Present In All Experiment But I Want That To Be In The Project That I Have Specified Can Anyone Help Me With This

Yes you can, see the examples here 🙂
None

one year ago

0 Rolling Back To 1.15.0 Seemed To Fix The Error For Now. Is There Something One Should Be Aware Of Between Server Versions 1.15 And 1.16 Related To Versions Of The

I think its possible there was an upgrade in Elastic, I'd suggest going over the release notes to see if this happened with the server

3 months ago

0 Hi Everyone, I’M New To Clearml And Server Administration. We Are Considering Tools To Manage A Dgx H100 Server. Ideally, The Tool Could Provide "Sandboxes" That Are Already Equipped With All The Necessary Tools And Frameworks. This Way, Each Team Member

@<1756488209237282816:profile|IdealCamel64> , to address your questions:

Yes
Yes, but as @<1576381444509405184:profile|ManiacalLizard2> said, let your users try and I'm sure they'll prefer ClearML 🙂

2 months ago

0 Is There A Way To Generate Usage Stats And Reports For Queues? For Example, How Often Is A Queue Used, How Much Cpu Does

I think this might be what you're looking for:
https://clear.ml/docs/latest/docs/references/api/workers
https://clear.ml/docs/latest/docs/references/api/queues
You can access all reports through the REST API

2 years ago

0 Hi Everyone! I Have A Question About

How are you currently trying to wrap it up in python?

one year ago

0 What Could Be Causing This?

Wait I might be missing something. Are you running a self hosted server?

2 years ago

JitteryCoyote63 Hello 🙂

So That I understand correctly you have a task where you pull data from us-east-1 and then want to upload the data on eu-central-1 but it's failing due to the region change, correct? Can you please give an example of the failure in console?

3 years ago

0 Hi All, I Have A Question - Is There A Way To Upload A Local (

Hi @<1539417873305309184:profile|DangerousMole43> , I don't think such a capability exists. You can however add a link to a file as a parameter and then run it from the GUI.

Regarding the drag and drop capability I think it's a really cool idea! Maybe open a feature request on GitHub?

one year ago

JitteryCoyote63 , well I'm happy to hear that everything worked out in the end 🙂

3 years ago

0 Hello Again

Hi WickedCat12 ,

During Task.init() you can specify auto_connect_frameworks=False for the framework you're working with. However please note that this will stop auto reporting scalars etc

https://clear.ml/docs/latest/docs/references/sdk/task#taskinit

2 years ago

0 Hi! Once Again, I'M Having Trouble With The Autoscaler. If The 'Setup Shell Script' Field Is Present, The Task Won'T Start. It Woulf Install All The Requirements In The Newly Created Instance And Then Stop. My Setup Script Is:

Hi @<1564785037834981376:profile|FrustratingBee69> , you can simply run the agent without the --docker command

one year ago

0 Hello! I’M Using Clearml On A Kubernetes Cluster And Have Encountered A Strange Behavior When Training A Model From A Non-Main (Master) Branch. In My Code (

Hi @<1743079861380976640:profile|HighKitten20> , can you please provide the log of the job itself in ClearML(Console section of the experiment)?

one month ago

0 More An Internal Utilities Usage Question - If I Have A Script (.Py) Can I Use An Utility That Clearml Uses To Get The Packages Used By The Script? Was Looking At

TrickySheep9 , what is the use case? If I understand correctly, you want to use ClearML's package detection in a script to get the imports or do you want all the packages in the environment you're running?

3 years ago

0 Hi, Is There A Solution For User-Roles? I Want To Give Access To Clearml To A User Outside The Ds Team, But Only To View Experiment Results. I Don'T Want Them To Accidently Clone/Archive/Enqueue Anything. Is This An Option?

Hi @<1523701235335565312:profile|HugeArcticwolf77> , user roles & permissions are only available in the Scale & Enterprise versions

one year ago

Show more results