ManiacalLizard2

40 Questions, 298 Answers

Active since 05 June 2023

Last activity 2 months ago

Reputation

Badges 1

113 × Eureka!

Answers 298

0 Hi All, I Have Deployed A Clearml Server With Docker To One Of Our Local Machine. I Had Set Up The Filesserver Folder As Mount Point To The Cloud. How Easy Is It To Migrate Our Existing Experiments Later On To A Clearml Server That We Deploy In The Cloud

I understand to from the agent, point of view, I just need to update the conf file to use new credential and new server address.

2 years ago

0 Hello, What Happens To Running Experiments When The Clearml Agent Is Killed (And Restarted A Few Minutes Later)?

If the agent is the one running the experiment, very likely that your task will be killed.
And when the agent come back, immediately or later, probably nothing will happen. It won't resume ...

one year ago

0 I Want To Run

@<1523701205467926528:profile|AgitatedDove14>
What is the env var name for Azure Blob storage ? That the one we use for our Artifiact.

Also, is there function call rather than env var ?
It would be simplier in our case to call a function to set credential for clearml rather than fetch secret and set env var prior to running the python code.

If there is only the option of using env var, I am thinking fetchcing secrets and set env var from python, eg: os.environ["MY_VARIABLE"] = "hello" ...

2 months ago

0 Hello, I'M Trying To Use The Agent To Orchestrate Tasks - Our Install Is Quite Complicated And I'Ve Wrapped It All Up With The Code In A Docker Container; Is There A Way To Get The Agent To Just Run A Command In The Container Rather Than Try To Build/Inst

I use CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/path/to/my/vemv/bin/python3.12 and it work for me

2 years ago

0 Another Quick Question About Fileservers And Clearml-Agent: Clearml-Agent Seems To Ignore The Output Destination Set In The Task Config

so in your case, in the clearml-agent conf, it contains multiple credential, each for different cloud storage that you potential use ?

2 years ago

0 I Am Trying To Run One Agent On My Local Machine And One Agent On A Vm

I use ssh public key to access to our repo ... Never tried to provide credential to clearml itself (via clearml.conf ) so I cannot help much here ...

2 years ago

0 How Do You Disable Auto Upload Pth File ? I Still Want To Have Debug Sample And Manual Upload Artifact, Just Not Uploading All The Pth File. I Think I Saw This In The Chat Somewhere But Could Not Find It Now. Use-Case: We Are Experimenting With New Framew

we are usign mmsegmentation by the way

one year ago

0 Hi Everyone, I Am Running A Pipeline Using The Autoscaler, I Am Able To Spin Up The Vm Instance Using The Autoscaler And The Docker Is Also Getting Installed In There Perfectly. The Issue I Am Facing Is That During Executing A Pipeline Task While Cloning

what is the command you use to run clearml-agent ?

2 years ago

Are you talking about this: None
It seems to not doing anything aboout the database data ...

2 years ago

0 Another Questions Related To

that format is correct as I can run pip install -r requirements.txt
using the exact same file

2 years ago

0 I Am Trying To Run One Agent On My Local Machine And One Agent On A Vm

there is a whole discussion about it here: None

2 years ago

What about migrating existing expriment in the on prem server?

2 years ago

0 Hello Everyone, We Would Like To Install Clear Ml In Closed Environment Where There Wont Be Any Access To The Internet, In Such Cases, What Will Be The Best Way To Keep The Application Updated?

Clearml don't auto update ....

5 months ago

Mongo db data migration?

2 years ago

0 I Have Set

Please refer to here None
The doc need to be a bit clearer: one require a path and not just true/false

one year ago

0 I Have Set

1.12.2 because some bug that make fastai lag 2x
1.8.1rc2 because it fix an annoying git clone bug

one year ago

0 Hi People When I Try To Use Docker Agents They Fail. If I Run The Command Clearml-Agent Daemon --Gpus 0 --Queue Default --Foreground Inside A Docker Prepared With All The Requirements Installed. It Tells Me:

eg: None

one year ago

0 For Some Reason, The Http Library Used By Clearml Does Not Like My Server'S Ssl. I Have Installed Clearml As A Docker Compose On My Truenas Scale With A Valid Certificate. When I Login Using Curl, All Is Good:

python library don't always use OS certificates ... typically, we have to set REQUESTS_CA_BUNDLE=/path/to/custom_ca_bundle_crt because requests ignore OS certificates

11 months ago

0 Hi, I Want To Integrate My Ml Tasks As A Complete Mlops Pipeline. I Am Planning To Create New Tasks By Pulling The Repo From Github. As, Some Of The Models And Utils Packages Are Not Stored In Github, How Can I Use These Packages In My Code To Ensure Tha

you an use a docker image that already have those packages and dependencies, then have clearml-agent running inside or launching the docker container

8 months ago

0 Hello Everyone, I Have An Video Classification Model. I Have A Lot Of Metadata About The Videos In A Csv File, I First Preprocess The Metadata And In Pandas Df. (There May Be Lost Videos, Invalid Videos Etc, So I Remove Those From The Df). I Want To Log T

I also use this: None
Which can give more control

one year ago

0 Hi! I'M Running A Clearml Task Remotely. It Runs A Python Machine Learning Evaluation Script In Repo A. The Script Depends On A Module Which Is Defined In Another One Of My Company'S Repos: Repo B. The File Structure Of The Module In Repo B Is As Follows

or simply create a new venv in your local PC, then install your package with pip install from repo url and see if your file is deployed properly in that venv

2 years ago

0 We Have This Issue With Our Oss Deployment: One Azure Container App For

I did.
I am now redeploying to new container to be sure.

4 months ago

0 Hi, Is There A Way To Fully Reproduce The Experiment Environment Locally Without Executing It ? Clearml Agent Do Setup A Venv And Install All The Package, Install Diff, .... Then Execute The Training Code. Is It Possible To Tell Clearlml-Agent To Stop Th

@<1523701087100473344:profile|SuccessfulKoala55> Yes, I am aware of that one. It build docker container ... I wanted to build without docker. Like when clearml-agent run in non-docker mode, it is already building the running env inside it caching folder structure. I was wondering if there was a way to stop that process just before it execute the task .py

2 years ago

all good. Just wanted to know in case I missed it

2 years ago

0 Hi, We Deploy Clearml In Azure And Have Used Azure Cache For Redis So Far. But That'S Retiring And The New Service Is Azure Managed Redis. I'Ve Managed To Connect

We are using this: WebApp: 2.2.0-690 • Server: 2.2.0-690 • API: 2.33

one month ago

0 Hello, We Have Noticed That Debug Images Takes Way Too Long To Load 6 To 8 Seconds When Requesting Events.Debug_Images We Also Notice That The Returned Object Is Quite Heavy, About 2-3 Mb, I Think It Contains A Lot Of Unnecessary Info We Also Have 20 Mill

Not a solution, but just curious: why would you need that many "debug" images ?
Those are images automatically generated by your training code that ClearML automatically upload them. May be disable auto upload image during Task Init ?

4 months ago

0 I'M Trying To Spin Up A Task On An Agent And Inside The Task I Have Two Packages That I'Ve Created Custom Versions Of And Specified A Git Repo For In The Requirements.Txt. Example With Hydra-Core And Omegaconf:

Can you paste here what inside "Installed package" to double check ?

2 years ago

0 Hi Team, Can Someone Help Better Understand The Prerequisites For Running A Cloned Task (If Any)? Background: I Was Able To Run And Complete A Task From Vscode. The Same Task, When Cloned And Enqueued Would Result In A File Or Directory Not Found Error. T

very hard to diagnose with this tiny bit of log ...

2 years ago

Show more results