CostlyOstrich36

0 Questions, 3719 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3719

0 Hey Guys, Running A Clearml Pipeline, We Keep Getting An 'Abort By User' Message:

You can see the version if you go to settings page. It is in the bottom right of the screen 🙂

one year ago

0 Hello, Does Anybody Here Work With Clearml On Preemptible Instances? I'D Like To Achieve The Following:

Hi @<1523701122311655424:profile|VexedElephant56> , I think is achievable with Slurm + ClearML, however I don't think something like this out of the box exists

one year ago

0 Hi Everyone! How Do I Disable Automatic Reporting Of Matplotlib Plots And Images?

Hi @<1523707653782507520:profile|MelancholyElk85> , in Task.init() you have the auto_connect_frameworks Parameter.

None

one year ago

0 Hello, I Am Using A Nas Storage To Save My Models And Dataset Artifacts. My Pipeline Consists Of Two Steps:

And how is the model being saved?

2 years ago

0 Hi, Forgive Me If This Was Asked Before In A Different Way, What’S The Recommended Way To Pass Different Git Credentials To An Agent Running On A Shared Machine (Meaning 2 People Are Queueing Different Jobs, Pulling From Different Git Remotes). Should I

You have a self hosted server, several agents that are running and two users developing on their own machines but the training is done elsewhere?

2 years ago

0 Hi Guys, I'M Looking For Where The Docker Images That Clearml Pull From The Docker Hub (When Create Worker) Is Stored On My Remote Machine But Have No Ideas Where They Are. Really Appreciate If Someone Tell Me Where They Are. Thanks So Much

Hi @<1570220852421595136:profile|TeenyHedgehog42> , the docker images are stored together with all images - this is managed by docker and not clearml

one year ago

0 Hi Everyone, Quick Question: When Clearml-Agent Sets Up The Virtual Environment With Pip, Is Finding The Correct Cuda Version For Pytorch Something That Pip Or That Clearml Does?

You're right, I forgot, ClearML-Agent also tries to match a version to something that will work on the system it's running on

2 years ago

0 Pipelines Suddenly No Longer Appear In The Pipelines Tab, What Could/Should I Look Into? Edit: Using Latest Clearml (Agent, Server, Sdk), And Creating The Pipelines Via The Pipelinecontroller Sdk (

@<1523701087100473344:profile|SuccessfulKoala55> , what is the intended behavior?

one year ago

0 Do I Understand Correctly That Python Versions Must Match Between Client (My Mac, Sends Task For Remote Execution) And Clearml-Agent? I Don’T Really Get How The Environments Are Managed. All I Want To Do Is Take My Code And Execute It On The Agent Machin

Hi AdventurousButterfly15 ,

When running code locally, how are the installed packages detected? Does it detect your entire venv or does it detect only the packages that were used?

2 years ago

0 I Know At Least One Other Person Has Posted About This Previously, But When I Interact With

Hi @<1533620191232004096:profile|NuttyLobster9> , what version of clearml SDK are you using and is it a self hosted server or not?

one year ago

0 Hi. We Have Task That Generate Trained Model In

Hi @<1576381444509405184:profile|ManiacalLizard2> , I don't think such a capability currently exists. I would suggest opening a github feature request for this. As a workaround you could zip them up together and then bind them to an output model.

What do you think?

one year ago

0 Hi All, I'M Trying To Setup A Pipeline Based On The Asteroid_Example(

Hi @<1587615463670550528:profile|DepravedDolphin12> , can you please add the full log?

one year ago

0 Hi All, I'M Trying To Clone And Run The

Hi @<1587615463670550528:profile|DepravedDolphin12> , can you please provide a link to the doc you read?

one year ago

0 Hey Everyone! I’M Currently Trying To Set Up Hyperparameter Optimization With Clearml On A Base Experiment Using Hydra. I Got Everything Working From The Examples. However, The Child Experiments Started By The Optimization Don’T Seem To Actually Get The N

Just making sure we cover all bases - you changed updated the optimized to use a base task with _allow_omegaconf_edit_ : True

2 years ago

0 I Installed My Own Clearml-Server And Things Seems To Work Fine, But When I Delete An Experiment (I First Archived It Using Web Interface Popup Menu) Then Delete It Using The Web Inferface Popup Menu In Archive View)... Experiment Disapears From Web Inter

Usually the location is on the file server at opt/clearml/data/fileserver

The addresses seems strange, is this the hostname?

It seems like a mix between hostname and IP?

2 years ago

0 Hi, All. How Do I Add Accuracy And Loss Metrics For Tracking In Clearml For Yolo8? And Model Registry After Each Epoch?

Make sure to fetch the logger manually and not construct it yourself 🙂

one year ago

0 Hpo Question: I Created Hpo App In Clearml Ui, With Certain Parameter To Optimize, With Minumal Value=0.0, Max=1.0 And Step=1.0. So As Far As I Understand This Hpa Should Launch 10 Experiments. In Fact, It'S Launching Tens Of Experiments (>30 And Still

What optimization method did you use? Can you add a log of the HPO app? It's in hidden projects (Go to settings and enable viewing hidden projects).

Also, what are the values that the cloned experiments get?

And finally 🙂
Can you try with values 0 and 1 without the decimal points at the end?

one year ago

0 Hello All, I Am Trying To Have A Grasp On Clearml Agents, And I'M Struggling With Docker Mode. Let'S Say, I Have A Dockerfile For My Custom Made Docker Image. However, I Want To Build That Image On The Fly, Just Because Of Having The Freedom To Have Full

ZanyPig66 , Hi.

To use a custome docker image with ClearML you need to have that image locally on the machine that is runing the agent. In the experiment you can specify the docker image either via UI (in the Execution -> Container sections)

Or in code like this:
task.set_base_docker(docker_image="python:3.9-bullseye")

2 years ago

0 Hi! I'M Using Func

DepressedFish57 , Hi 🙂

What do you mean by downloading a previous part of the dataset? get_local_copy fetches the entire dataset if I'm not mistaken. Am I missing something?

2 years ago

0 Hey, I Tried To Use

Which version for clearml-data are you using?

2 years ago

0 Hello All, After I Run Training Task And Output Model To S3, Is There A Way For Clearml Server To Send Out Notification Of Some Sort To Trigger Our Continuous Deploy Process? I'M Thinking When I Assign A Certain Tag To The Experiment Result, It Could Send

PunyWoodpecker71 , regarding the REST API:
The format would be something like this:
base_url/endpoint
Where base_url would be the api_server as configured in your ~/clearml.conf and the endpoint is any endpoint you choose from the docs 🙂

Username/password are the access_key / secret_key as also configured in ~/clearml.conf (You can get it from the UI)

content-type is application/json

And of course it's a POST 🙂

2 years ago

0 Hi, I Configured An On-Prem File Server For Clearml Which Is Mounted On My Pc. I Am Trying Retrieve An Artifact From A Previous Run . Because This File Is Big I Want To Bring It To The Local Cache (On My Pc). However, When I Do The Following Artifact =Tas

Hi @<1546303277010784256:profile|LivelyBadger26> , can you provide a snippet that reproduces this?

one year ago

0 Clearml.Log - Warning - Failed Logging Task To Backend (1 Lines, <400/68: Events.Add_Batch/V1.0 (The Usage Quota Was Exceeded: Type=Metrics_Storage)>) Deleted Some Old Experiments Also But Whenever I Start The Training Of Ml Model, It Is Showing This, An

Hi @<1754676274460102656:profile|CurvedStarfish68> , it takes some time until metrics are updated. I suggest deleting a few more experiments and waiting.

one month ago

0 Hi, I'M Using Clearml Over Aws And I Can See That My Ec2 Instance Disk Space Is Filling Up Really Fast. I First Started With 100Gb Disk Space And Once It Filled Up I Increased The Size To 150Gb Which Is Soon To Be Filled Up As Well. I Wanted To Check If T

I see. I'm guessing you have pretty extensive use in the form of artifacts/debug samples. You can lower the storage usage by deleting some experiments/models though the UI. That should free up some space 🙂

2 years ago

0 Hello, I'M Running Clearml Server On My Server. I Archived And Deleted Experiments And Project. But The Files Are Remain On Fileserver'S Volume On My Server(/Opt/Clearml/Data/Fileserver/..). When It Will Be Deleted? Or Should I Delete It Manually?

Does it give you any error while deleting the experiments?

2 years ago

0 Hi All, We Are About To Setup The Ml Infra On One Of The Ongoing Projects Where We Used Clearml Server For Cv Models Training. The Parts Of The Infra Should Be:

Hi @<1666253626772819968:profile|SmoggyDog77> , this is indeed a very interesting and somewhat complicated use-case! I think ClearML can support all of your current needs and any that might rise in the future.

I would suggest to contact ClearML directly to get a better idea of how ClearML can assist your MLOps efforts.

The suggested method from my experience would be via the contact form - None

9 months ago

0 As Soon As I Refactor My Project Into Multiple Folders, Where On Top-Level I Put My Pipeline File, And Keep My Tasks In A Subfolder, The Clearml Agent Seems To Have Problems:

Hi @<1724960468822396928:profile|CumbersomeSealion22> , what was the structure that worked previously for you and what is the new structure?

4 months ago

0 Hello All! Is There Any Way To Attach To A Task/Worker In A Terminal? I Have Jobs Which Fall Into Pdb Upon An Error, And It Would Be Very Helpful To Be Able To Connect To Them And Interact With The Debugger.

Hi @<1523701797800120320:profile|SteadySeagull18> , can you please elaborate on what you mean?

one year ago

0 Hi! I Have Some Agents On Gcp. Lately I Have Been Getting Some Experiments That Simply Stop Running (No Signs That The Experiment Crashed). Here Is A Plot That Shows The Resource Monitoring. Any Ideas On What Could Be Causing This?

GrievingTurkey78 Hi!

What versions of clearml and clearml-agent are you using? Also for how long were the experiments were going?

Seems like agent is still reporting iterations and usage for the experiment so what do you mean by stopped?

3 years ago

0 Hi, I Am Using Clearml Own Hosted Server On Aws Ec2. When I Am Creating A Task I Am Getting This Error "Retrying (Retry(Total=239, Connect=239, Read=240, Redirect=240, Status=240)) After Connection Broken By 'Connecttimeouterror(<Urllib3.Connection.Httpco

@<1624579015031394304:profile|JitterySeal56> , is it possible there are connectivity issues between the client and the server? Do you see anything in the logs of the apiserver?

one year ago

Show more results