CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Hello

Not that I know of 🙂

2 years ago

0 Hi Community, We'Re Trying To Move From App.Clear.Ml To A Self-Hosted Clearml Instance, And I Was Wondering If Anyone Figured Out A Way To Transfer Tasks From One To The Other. Specifically, I'D Like To Copy All Datasets (Which Internally Are Represente

Hi @<1618418423996354560:profile|JealousMole49> , I think you would need to pull all related to data via the API and then register it again through the API.

one year ago

0 In Task.Init I Got The Folloing Errror Message -- "Retrying (Retry(Total=239, Connect=239, Read=240, Redirect=240, Status=240)) After Connection Broken By 'Connecttimeouterror(<Urllib3.Connection.Httpconnection Object At 0X2Aaf57A2Cc50>, 'Connection To Xx

Is there a firewall in between or something stopping the connection?

2 years ago

0 Hi Guys, I Have My Experiment Running On Setup A. However I Need These Experiments Params And Output In Setup B For Comparison. Both Setup Are Not Linked. Anyway For Me To Copy The Outputs And Load It In Setup B Clearml?

OddShrimp85 , Hi 🙂

I'm afraid that the only way to load contents of setup A into setup B is to perform a data merge.

This process basically requires merging the databases (mongodb, elasticsearch, files etc.). I think it's something that can be done in the paid version as a service but not in the open one.

3 years ago

0 Hello

Hi FrothyShrimp23 , you can use Task.mark_completed() and use force=True
https://clear.ml/docs/latest/docs/references/sdk/task#mark_completed

2 years ago

0 Another Question: How Can I Make Clearml-Agent Use Pre-Installed Version From The Nvidia/Pytorch (

What's the docker image that you're using?

3 years ago

0 Hi All, Newbie Question Can I Take Some Models From The Models That I Have Uploaded On The Clearml Server Into My Project Such As A Notebook? And Can I Track The Performance Of Each Model That Has Been Deployed In Production, For Example A Notebook With M

Hey ItchySeahorse94 , I think this might be what you're looking for 🙂
https://github.com/allegroai/clearml-serving

3 years ago

0 Has Anyone Else Benchmarked Clearml? I'M Seeing Catastrophic Logging Overhead:

I tested how many resources ClearML consumes. The entire process of ClearML SDK consumes about 50mb of RAM memory on my side and it requires minimal amount of CPU.

Is it possible that your training steps are that inefficient?

6 months ago

0 Hello, Clearml! Let'S Say That I Have A Git Repository In Format

What about if you specify the repo user/pass in clearml.conf?
I think it removes the user/pass so it wouldn't be shown in the logs

2 years ago

0 Hey There I'M Currently Trying To Set Up Clearml Serving While Using Triton As My Engine. I'M Currently Experincing 405 Errors When Calling My Endpoint Or Triton Just Crashes. Can Anyone Help Out?

Also a newer version to the serving as well

one year ago

0 Hello, I’M A Beginner Of Clearml And Reading Documents, But I Have Some Questions.

Hi DiminutiveBaldeagle77 ,
Yes - https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_kubernetes_helm/ If you already have K8s cluster it is beneficial since you get scheduling capabilities which are not normally present in K8s

3 years ago

0 Hello! I Need To Run Clearml Pipeline With Caching Of Steps. I Specify Cache_Executed_Step=True For Each Step, But My Steps Are Not Cached And Ended With The Status - Completed.

How are you writing your pipelines?

5 months ago

0 Hi, I Want To Simultaneously Initialize A Task (From A Python Script) And Enqueue It To A Remote Machine With A Clearml Agent. However, I Didn'T Find How To Do It Yet. What I Tried:

Hi DullPeacock33 , I think what you're looking for is this:
https://clear.ml/docs/latest/docs/references/sdk/task#execute_remotely
This will initialize all the automagical stuff but won't require running the script locally.
What do you think?

3 years ago

0 In

When you run your code after you've added Task.init() into your code, you will get a link in the console. Following that link will take you to the console output of the experiment. From there you can go into 'Execution' tab and see it all there 🙂

2 years ago

0 Hi Everyone. I’M Struggling To Setup Minio Storage. Below Is What I’M Adding In My Credentials And When I Try To Create A New Dataset Using Below Command; I Get Errors: Configs:

with the combination of None :port/bucket for --storage ?

one year ago

0 In The Configuration Section Of An Experiment, I Can See The Args I Passed Via Argparse. Is There Any Way To Create Other Sections Other Than Args And Tf_Define

VexedCat68 I think this will be right up your alley 🙂
https://github.com/allegroai/clearml/blob/master/examples/reporting/hyper_parameters.py#L43

3 years ago

0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

I think it basically runs in offline mode and populates all the relevant fields (Task attributes) in some json (or some other config file). I think you could read this file and compare to something that is expected thus having an ability to run something offline and then verify it's contents.

2 years ago

0 Hi! I'M Trying To Set Up Clear Ml, I Don'T Know How To Setup Azure Container Storage, For Some Reason It Raises Errors. I Tried This

Also I think it should start with None

one year ago

0 Hi, Is There A Possibility To Switch Off The Agent Just After If Finishes Current Task (Not To Fail The Task, But To Wait Minimal Time)?

Do you mean to kill the clearml-agent process after the task finishes running? What is the use case I'm curious

2 years ago

0 Hi, Can I Run A Single Hyperparameter Optimization Task With At Least 100 Experiments On Multiple Machines By Using Clearml-Agent And Queue?

Hi @<1664079296102141952:profile|DangerousStarfish38> , you can control it in the agent.default_docker.image section of the clearml.conf where the agent is running. You can also control it via the CLI when you use the --docker tag and finally, you can also control it via the webUI in the execution tab -> container -> image section

one year ago

0 Hi, All. How Do I Add Accuracy And Loss Metrics For Tracking In Clearml For Yolo8? And Model Registry After Each Epoch?

Hi @<1590514572492541952:profile|ColossalPelican54> , you can use the Logger module to manually report metrics - None

2 years ago

0 Hi Everyone! I’M Trying To Set Up Clearml Server Behind Aws Cloudfront (This Is A Kinda Standard Solution For Our Company), And When I Try To Run Some Agent Python Script From My Machine (Like One Below)

Hi @<1686184974295764992:profile|ClumsyKoala96> , you can set CLEARML_API_DEFAULT_REQ_METHOD to POST and that should work - None

one year ago

0 Ahoy! I Have A Pro Account Which I Need To Downgrade. The Account Page Says I Have 8 Gb Of Metrics Data, Preventing The Downgrade. However, No Matter What I Do -- Archiving Many Experiments & Models And Then Deleting Them From The Archive -- This Number D

Do you have the associated email to the account or the workspace ID?

6 months ago

0 Hi. Is There A Way To Pass Multiple Pre/Post Execution Callbacks For A Step?

None

one year ago

0 Bug Report? We Noticed That The Aws Autoscaler Will Lose Track Of Instances Crashing Due To No Space Left On Device, And The Ec2 Instance Will Remain Running Indefinitely.

I see, maybe open a GitHub issue for this to follow up

2 years ago

0 Hi Team,In Clearml.Config File Can We Change This

Hi @<1533159639040921600:profile|JoyousReindeer30> , the pipeline controller is currently pending. I am guessing it is enqueued into the services queue. You would need to run an agent on the services queue for the pipeline to start executing 🙂

2 years ago

0 Hi Clearml Team! Im Exploring The Option To Install Clearml On Kubernetes And Take Advantage Of More Features Clearml Offer And I Have Few Questions:

Hi SharpSeal87 ,

Please check the following docs for Kubernetes 🙂
https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_kubernetes_helm/
I would suggest moving each database separately and very carefully and set it in parallel with working server. It is very easy to make mistakes and end up with an empty database

Also, were you looking to use your agents on K8s or only the ClearML server?

3 years ago

0 Hello, Is It Possible To Install Clearml-Agent Without Using Pip? I Want To Use Docker, But Worried About When Clearml-Agent Execution In Docker Mode Cannot Create Container.

I don't think there should be an issue to run the agent inside a docker container

2 years ago

0 Hey There I'M Currently Trying To Set Up Clearml Serving While Using Triton As My Engine. I'M Currently Experincing 405 Errors When Calling My Endpoint Or Triton Just Crashes. Can Anyone Help Out?

@<1739455989154844672:profile|SmarmyHamster62> , I suggest updating your versions. The server is a bit old

one year ago

0 I Am Using Hydra. When Running Locally The Code Takes Into Consideration Any Hydra Override Arguments I Pass In The Command Line. But When I Run The Same Task In Remote (Using Clearml-Agent).... It Uses Only The Default Values. Is This Behaviour Reasonab

@<1546303277010784256:profile|LivelyBadger26> , it is Nathan Belmore's thread just above yours in the community channel 🙂

2 years ago

Show more results