CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 I Have A Question Related To Pipelinev2 (Using Decorator) Is Pipelinev2 Support Uploading Artifacts To S3 (Instead Of Fileserver)?

Try configuring the following and tell me if this helps 🙂
In your ~/clearml.conf configure the following:
sdk.development.default_output_uri: "<S3_bucket>"

3 years ago

0 Hi, When I Read An Argument From The Configuration Tab In The Clearml Using The

I think I found what you need 🙂
https://clear.ml/docs/latest/docs/references/sdk/task#get_parameters
get_parameters(cast=True)

3 years ago

0 Hello Everyone. If I Use Self-Hosted Clearml, Am I Limited By The Number Of Users, Artifact Storage, Or Api Calls?

Hi @<1673501397007470592:profile|RelievedDuck3> , no 🙂

one year ago

0 Hi, We Have Clearml Version Webapp: 1.3.0-165 • Server: 1.3.0-165 • Api: 2.17 Suddenly All Experiments Were Removed. After Checking Logs We See That Before 6 Days Elasticsearch Container Was Terminated Due To Out Of Memory And New One Was Created Instead

You can restore these tasks by copying or moving them from task__trash into task collection. But the events for these tasks cannot be restored. About the user who deleted them unfortunately ClearML does not record this info in Mongo and without logging to ES there is no place to retrieve it (I can suggest using Kibana to monitor ES). You can try to inspect the mongo collection url_to_delete. It contains all the links from the deleted tasks that should be removed from the fileserver. If you se...

2 years ago

0 Is There An Autoscaler Equivalent For K8S? That Is, A Service That Will Launch Pods Based On Incoming Requests?

Hi @<1523701083040387072:profile|UnevenDolphin73> , this is the K8s integration. You can find more here:
None

2 years ago

0 Hi! Any Idea Why Clearml Fails To Detect Iteration Reporting?

GrievingTurkey78 , can you try disabling the cpu/gpu detection?

3 years ago

0 Any Reason That Clearml Pycharm Plugin Is Not Available On Plugins Marketplace, But Only Directly From [1]? [1]

Hi @<1529271098653282304:profile|WorriedRabbit94> , I'll ask the guys to take a look at this and what is required for it.

11 months ago

0 Hi, In The Clearml-Server Web-Ui, Under Debug Sample, Would It Be Possible To Improve The Logic For Fetching The Images? If I Have Say 200 Iteration, It Will The Last By Default. If I Want To See Iteration 50, I Will Have To Manually Click On The Arrow Un

Hi JitteryCoyote63 , I think you can click one of the debug samples to enlarge it. Then you will have a scroll bar to get to your needed Iteration. Does that help?

2 years ago

0 Hi All

Also, the repo itself is cached, so each time it will only fetch the delta.

3 years ago

0 Hi Everyone, Has Someone Of You Tried To Track Your Shap Plots With Clearml? Somehow In My Dashboard The Tracked Plots Are Empty. Might They Be Too Complex Or Something? Br Sophie

Hi @<1787291173992271872:profile|BlandCormorant75> , how are you logging those plots? Can you provide a stand alone snippet that reproduces your behaviour?

8 months ago

0 Hello Everyone! I Launched An Ec2 Instance That'S Free Tier (

CluelessElephant89 , did you run the vm.max_map_count command for elastic? Also what amount of RAM memory do you have on the machine you're running on?

3 years ago

0 Hello ! When Running

Can you try going into the docker and verifying you have the same clearml.conf inside?

3 years ago

0 I Setup A Dedicated Mongo Instance With A

Hi @<1585441130525233152:profile|TrickyGoose45> , you mean that the mongodb you set up is not part of the docker compose?

2 years ago

0 Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

Can you share the elastic part of your docker container? Are you using any overrides?

5 months ago

0 Hi, Does Anyone Know If

There is an options for a configurations vault in the Scale/Enteprises licenses - basically applying global settings without having to edit clearml.conf

2 years ago

0 Hello Everyone, I’M Currently Facing An Issue While Using Cloud Clearml With Aws_Autoscaler.Py. Occasionally, Some Workers Become Unusable When An Ec2 Instance Is Terminated, Either Manually Or By Aws_Autoscaler.Py. These Workers Are Displayed In The Ui W

Hi @<1571308079511769088:profile|GentleParrot65> , ideally you shouldn't be terminating instances manually. However you mean that the autoscaler spins down a machine and still recognizes it as running and refuses to spin up a new machine?

2 years ago

0 Hi, I Have An Artifact Which Is A Path To The Outputs Of The Model That Was Trained And Its Used In Another Task Later On But As A String, But When I Use Upload Artifact It Uploads The Whole Folder And Not Just As A String, Is There Are Way To Just Upload

@<1523701295830011904:profile|CluelessFlamingo93> , just so I understand - you want to upload a string as the artifact?

2 years ago

0 Hey There! I Was Wondering If There Is Any Existing Support For Integration Between A Self-Hosted Clearml Server And A Slurm Cluster. I Can Certainly Queue Up A Slurm Job For Any Given Task, But Is There An Easy Way To Do This Automatically Whenever A Tas

Hi @<1569133676640342016:profile|MammothPigeon75> , I believe such SLURM integration of what you described is supported on ClearML Scale/Enterprise versions

2 years ago

0 Hi, Folks !! Is There A Selective Migration Of Experiment’S Output Files From Local Clearml Db To Remote Clearml Hostings?? A Possible Use-Case In My Team Is As Follows: 1: A Research Team Often Creates “Failed” Experiments Which Have Bad Results. 2: Ea

Hi EcstaticBaldeagle77 ,
I'm not sure I follow. Are you using the self hosted server - and you'd like to move data from one self hosted server to another?

3 years ago

0 Hello, I'Ve Been Using Clearml For A Month Now, And Must Say It'S A Really Good Product! I'M Mostly Working With Huggingface Transformers, I Integrated Clearml In My Solution:

Hi HungryArcticwolf62 ,
from what I understand you simply want to access models afterwards - correct me if I'm wrong.
What I think would solve your problem is the following:
task = Task.init(...., output_uri=True)This should upload the model to the server and thus make it accessible by other entities within the system.
Am I on track?

3 years ago

0 Hello, Does Anybody Here Work With Clearml On Preemptible Instances? I'D Like To Achieve The Following:

Hi @<1523701122311655424:profile|VexedElephant56> , I think is achievable with Slurm + ClearML, however I don't think something like this out of the box exists

2 years ago

0 Is There Any Way To Change The X-Axis On The Charts For Scalars, To Say E.G. "Epochs" Instead Of "Iterations"? Or Is That Hardcoded?

What is the best way to achieve that please?

I think you would need to edit the webserver code to change iterations to epochs in the naming of the x axis

2 years ago

0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

CrookedWalrus33 , Hi 🙂
Can you please provide which packages are missing?

3 years ago

0 Hey, Guys! I Have A Problem. I Launched Clearml Server And Trying To Run A Worker On Another Machine. When I Run

I think so, yes

2 years ago

0 Hi, Our Server Ip Address Has Changed, And This Breaks All The Paths To Artifacts / Datasets. Is There A Way To Fix The Old Paths So That They Can Be Accessed Again? Thank You!

SucculentBeetle7 please give an example of the path that is given to you by the web interface :)

4 years ago

0 I Am Getting Certificate Warning When Running Clearml:

LethalCentipede31 , it appears we had an internal issue with a load balancer, it was fixed a couple of minutes after your comment 🙂

3 years ago

0 Hey, Has Anyone Played With Lifecycle Policy On Their Clearml Aws S3 Storage ? I Had To Rollback A Simple Lifecycle Policy Changing The Access Tier Of Some Object After Some Time To Save Cost Because Dataset Uploading Was Completely Frozen After That (St

Does it go back to working if you revert the changes?

2 years ago

0 Hi, I Hope Someone Can Help Me With The Following Problem: I Have Been Using Clearml For Some Time And Have Many Projects And Experiments. Today, For The 1St Time, I Tried Cloning An Experiment. After Enqueueing The Cloned Experiment (As Explained

I would guess so
sudo docker logs --follow trains-webserver

3 years ago

0 Hpo App Question: My Config Includes 11 Parameter Values (0 - 1, Step 0.1). I'Ll Expect To See 11 Experiments, But I Fact It Was "52 Iterations". What I'M Missing (Last Time I Asked Similar Question, But This Time There Is No Issue With Hpo-App Integratio

What is your configuration?

2 years ago

0 Hi All, General Wondering - Suppose I Have A Pipeline That Is Constructed Out Of Several Tasks And One Of The Tasks Fails. I Want My Users To Check Out The Error Message. For That, They Need To Press On The Failed Step And Review The Console. Is There A W

Hi @<1539417873305309184:profile|DangerousMole43> , I think you can do it if add some code to the pipeline controller to extract the console logs from a failed step

2 years ago

Show more results