ManiacalLizard2

31 Questions, 239 Answers

Active since 05 June 2023

Last activity one month ago

Reputation

Badges 1

92 × Eureka!

Questions 31
Answers 239

0 Votes

2 Answers

736 Views

0 Votes 2 Answers 736 Views

Just Want To Post It Here Before Raising A Github Issue: There Seems To Be A Regression Bug Since Clearml 1.13.0 Where Out Training In Gpu Is 2X Slower In Our Pipeline Based On

Just want to post it here before raising a github issue: there seems to be a regression bug since clearml 1.13.0 where out training in GPU is 2x slower in ou...

clearml

9 months ago

0 Votes

0 Answers

1K Views

0 Votes 0 Answers 1K Views

Can Azure Managed Identity (Equivalent To Aws Instance-Profile) Be Used By Clearml Web Server And Clearml-Agent ? If I Assigned The Appropriate Managed Identity To The Instance That Run The Clearml Web Server, It Can Access To The Corresponding Azure Blob

Can Azure Managed identity (equivalent to AWS instance-profile) be used by Clearml Web server and clearml-agent ? If I assigned the appropriate Managed Ident...

azure

one year ago

0 Votes

11 Answers

687 Views

0 Votes 11 Answers 687 Views

How To Use Zscaler (Or Custom Certificate) With Clearml ? I Installed The Zscaler Certificate Into The Os System.

How to use ZScaler (or custom certificate) with ClearML ? I installed the ZScaler certificate into the OS system. curl is happy with it. boto3 too but then c...

clearml

11 months ago

0 Votes

1 Answers

950 Views

0 Votes 1 Answers 950 Views

Is There A Way For Clearml To Assign Semantic Version To Model Automatically Like Mlfow Does?

Is there a way for clearml to assign semantic version to model automatically like mlfow does?

clearml

one year ago

0 Votes

9 Answers

1K Views

0 Votes 9 Answers 1K Views

I Am Struggling A Bit To Understand The Use Case Of A Pipeline: Let Say You Have Step1 -> Step2 -> Step3 What Is The Point To Use Pipeline Feature Versus Having A Single Task That Do Those Steps One After Another ???

I am struggling a bit to understand the use case of a pipeline: Let say you have step1 -> step2 -> step3 What is the point to use pipeline feature versus hav...

clearml

one year ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

Clearnl Failed To Detect Custom Packages

clearnl failed to detect custom packages livsdk installed from git. I have a dev venv where I start initial clearml task. In this dev venv, I have custom pac...

xgboost

one year ago

0 Votes

10 Answers

2K Views

0 Votes 10 Answers 2K Views

How To Tell Clearml Server To Use Cloud Storage (Azure)? I Have A Clearml Server Deployed With Docker-Compose. As Per Instruction

How to tell clearML server to use cloud storage (Azure)? I have a clearML server deployed with docker-compose. As per instruction here , I added the file /op...

clearml

one year ago

0 Votes

13 Answers

466 Views

0 Votes 13 Answers 466 Views

Question About Pipeline : My Setup Is As Follow:

Question about Pipeline : my setup is as follow: - Step1: train_foo.py (which import config from other .py) => generate a model.pt - Step2: gen_bar.py + mode...

clearml

6 months ago

0 Votes

10 Answers

1K Views

0 Votes 10 Answers 1K Views

Another Questions Related To

Another questions related to requirements.txt We use pip install with git commit. Eg: mylib @ When I do task.add_requirements("requirements.txt") I get # Pyt...

tensorboard

one year ago

0 Votes

5 Answers

595 Views

0 Votes 5 Answers 595 Views

I Have Weird Issue With Clearml Agent: When Queue A Job For A Second Time On The Same Agent, It Get

I have weird issue with clearml agent: when queue a job for a second time on the same agent, it get Executing task id [43cc0c9e1f794f53a148bde3fff03cc9]: rep...

mlops

8 months ago

0 Votes

6 Answers

789 Views

0 Votes 6 Answers 789 Views

Hi, We Have An Agent Running Inside A Nvidia Official Container. The Agent Seems To See The Gpu Driver But The Gpu Count Is 0 When I Join That Container,

Hi, We have an agent running inside a Nvidia official container. The agent seems to see the GPU driver but the GPU count is 0 When I join that container, nvi...

mlops

10 months ago

0 Votes

8 Answers

1K Views

0 Votes 8 Answers 1K Views

Also From The Python Sdk, Is There A Way To Specify The Clearml.Conf File To Use ? Like The Equivalent Of

Also from the python sdk, is there a way to specify the clearml.conf file to use ? Like the equivalent of --config-file for cleaml-agent ?

clearml

one year ago

0 Votes

15 Answers

1K Views

0 Votes 15 Answers 1K Views

Is There A Way To Tell The Agent To Use A Specific Venv Pre Installed ? Like The One Already Installed In The Developer Pc And The Agent Is Running Inside That Same Pc?

Is there a way to tell the agent to use a specific venv pre installed ? Like the one already installed in the developer PC and the agent is running inside th...

mlops

one year ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

What Are Project Default Output ? That The Default Output_Uri Set On The Server Side ? Can I Use Azure Blob Storage ?

What are project default output ? That the default output_uri set on the server side ? Can I use azure blob storage ?

azure

one year ago

0 Votes

1 Answers

869 Views

0 Votes 1 Answers 869 Views

Hi, With A Given Task Id, How Do I Get All The Information Of The Tab "Info" In The Python Sdk ? I Struggle To Find That In The Doc

Hi, with a given task ID, how do I get all the information of the tab "INFO" in the Python SDK ? I struggle to find that in the doc None

clearml

one year ago

0 Votes

1 Answers

978 Views

0 Votes 1 Answers 978 Views

Hi Team, How To You Use Micromamba And Pip Together With Clearml ?

Hi team, how to you use MicroMamba and pip together with ClearML ?

clearml

one year ago

0 Votes

6 Answers

126 Views

0 Votes 6 Answers 126 Views

Hi. From Python, Is There Away To Check How Many Worker Is There In A Given Queue ?

Hi. from Python, Is there away to check how many worker is there in a given queue ?

clearml

one month ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

I Had A Good Look At All The Introduction Video On Youtube And Had Some Questions. Context: If We Are Going To Deploy And Maintain Clearml Servers Our Self In Azure:

I had a good look at all the introduction video on youtube and had some questions. Context: if we are going to deploy and maintain ClearML servers our self i...

clearml

one year ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Do You Have A Documentation About How Clearml Detect Required Python Package ? In My Case, I Use

Do you have a documentation about how ClearML detect required python package ? In my case, I use mamba env and clearml seems to be mis-detect some packages ....

clearml

one year ago

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

Hi. We Have Task That Generate Trained Model In

Hi. We have Task that generate trained model in pth but our downstream pipeline is using omnx file and an custom generated yaml file. Currently, when the tra...

clearml

one year ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

Hi, Is There A Way To Fully Reproduce The Experiment Environment Locally Without Executing It ? Clearml Agent Do Setup A Venv And Install All The Package, Install Diff, .... Then Execute The Training Code. Is It Possible To Tell Clearlml-Agent To Stop Th

Hi, Is there a way to fully reproduce the experiment environment locally without executing it ? Clearml agent do setup a venv and install all the package, in...

mlops

one year ago

0 Votes

3 Answers

577 Views

0 Votes 3 Answers 577 Views

Hi, I Am Using

Hi, I am using mmpretain and wondering how do ClearML integrate with it ? I used: Runner( ..., visualizer=dict(type='Visualizer', vis_backends=[dict(type='Cl...

clearml

8 months ago

0 Votes

4 Answers

699 Views

0 Votes 4 Answers 699 Views

I Just Saw The New Release Of The Agent 1.8.1 :

@<1523701087100473344:profile|SuccessfulKoala55> I just saw the new release of the agent 1.8.1 : None > Fix git pulling on cached invalid git entry. On error...

mlops

7 months ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Experiment Environment Containers Tutorial : I Create A Docker Image With:

Experiment Environment Containers Tutorial : I create a docker image with: $ clearml-agent build --id d8162747eb2d4453bba9778851d1e120 --docker --target new_...

mlops

one year ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

We Have Deployed Our Own Clearml Server In Azure. We Have 2 Separate Address For The Api And Web Server. Both Serving At Port 443 In The Local Pc Config File We Have Something Like:

We have deployed our own ClearML server in Azure. We have 2 separate address for the api and web server. Both serving at port 443 In the local PC config file...

clearml

one year ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

From The Python Code Point Of View, How Do You Detect If It Is Running Locally Or Via Clearml-Agent ?

From the python code point of view, how do you detect if it is running locally or via clearml-agent ?

clearml

one year ago

0 Votes

2 Answers

234 Views

0 Votes 2 Answers 234 Views

How Do You Disable Auto Upload Pth File ? I Still Want To Have Debug Sample And Manual Upload Artifact, Just Not Uploading All The Pth File. I Think I Saw This In The Chat Somewhere But Could Not Find It Now. Use-Case: We Are Experimenting With New Framew

How do you disable auto upload pth file ? I still want to have debug sample and manual upload artifact, just not uploading all the pth file. I think I saw th...

clearml

3 months ago

0 Votes

5 Answers

1K Views

0 Votes 5 Answers 1K Views

I Have A Docker Container That Have Clearml-Agent Running Inside In Normal Mode. The Agent Take On A Task And Execute It Fine. I Just Want To Somehow Log The Docker Image Version That The Agent Is Running Inside. I Start My Container With Something Like:

I have a docker container that have clearml-agent running inside in normal mode. The agent take on a task and execute it fine. I just want to somehow log the...

mlops

one year ago

0 Votes

18 Answers

1K Views

0 Votes 18 Answers 1K Views

Hi All, I Have Deployed A Clearml Server With Docker To One Of Our Local Machine. I Had Set Up The Filesserver Folder As Mount Point To The Cloud. How Easy Is It To Migrate Our Existing Experiments Later On To A Clearml Server That We Deploy In The Cloud

Hi all, I have deployed a clearml server with docker to one of our local machine. I had set up the filesserver folder as mount point to the cloud. How easy i...

clearml

one year ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Security Issue: I Have Deployed A Clearml Server On Prem With Docker. I Set The User Credential In

Security issue: I have deployed a clearml server on prem with docker. I set the user credential in /opt/clearml/config/apiserver.conf That work fine: you nee...

clearml

one year ago

Show more results

0 How To Tell Clearml Server To Use Cloud Storage (Azure)? I Have A Clearml Server Deployed With Docker-Compose. As Per Instruction

Hi.
How do you tell the server to use my azure storage instead of local drive, on the host machine ? Isn't it by setting azure.storage in /opt/clearml/config/clearml.conf ?

one year ago

0 Hello, I'M Trying To Use The Agent To Orchestrate Tasks - Our Install Is Quite Complicated And I'Ve Wrapped It All Up With The Code In A Docker Container; Is There A Way To Get The Agent To Just Run A Command In The Container Rather Than Try To Build/Inst

depend on how the agent is launched ...

one year ago

0 Can Anyone Recommend A Good Workflow For

just saw that repo: who are coder ? That not the vscode developer team is it ?

one year ago

0 I Have Set

you should be able to see int the Console tab that show what is happening

8 months ago

0 Is There A Command Line Interface That Lets You Query And Download Models From The Clearml Model Registry The Way You Can With Mlflow? Example:

something like this: None ?

one year ago

0 Also From The Python Sdk, Is There A Way To Specify The Clearml.Conf File To Use ? Like The Equivalent Of

Thanks !!

one year ago

one specify the venv python, the other tell it to not do anything

one year ago

0 Hello! I Have A Small Question Regarding Storage Data Retrieval With Clearml

Just keep in mind my your bottleneck will be the transfer rate. So mounting will not save you anything as you still need to transfer the whole dataset sooner or later to your GPU instance.
One solution is as Jake suggest. The other can be pre-download the data to your instance with a CPU only cheap instance type, then restart the instance with GPU.

one year ago

0 Hi People When I Try To Use Docker Agents They Fail. If I Run The Command Clearml-Agent Daemon --Gpus 0 --Queue Default --Foreground Inside A Docker Prepared With All The Requirements Installed. It Tells Me:

Are you running within a zero-trust environment like ZScaler ?
Feels like your issue is not ClearML itself, but issue with https/SSL and certificate from your zero-trust system

4 months ago

0 Hi All, I Have Deployed A Clearml Server With Docker To One Of Our Local Machine. I Had Set Up The Filesserver Folder As Mount Point To The Cloud. How Easy Is It To Migrate Our Existing Experiments Later On To A Clearml Server That We Deploy In The Cloud

Mongo db data migration?

one year ago

0 Hi, I Noticed That My Experiments Fail If I Try To Clone Them And Enqueue Them After I Already Pushed Another Commits (Following The Commit Of The Cloned Experiment). I Am Getting The Error

Can you share the agent log, in the console tab, before the error?

one year ago

0 Is There A Way To Tell The Agent To Use A Specific Venv Pre Installed ? Like The One Already Installed In The Developer Pc And The Agent Is Running Inside That Same Pc?

@<1523701070390366208:profile|CostlyOstrich36> Is there a way to tell clearml to not try to detect the Installed package ?

one year ago

0 I Setup A Dedicated Mongo Instance With A

we are not using docker compose. We are deploying in Azure with each database as a standalone service

one year ago

0 Hi

I tried mounting azure storage account on that path and it worked: all files end up in the cloud storage

one year ago

0 Hi Everyone! I Discovered That Uploading Model Artifacts At Each Checkpoint To The Clearml Server Significantly Slows Down Training. So I Set

you should know where your latest model is located then just call task.upload_artifact on that file ?

one year ago

0 Hello Everyone, I Have An Video Classification Model. I Have A Lot Of Metadata About The Videos In A Csv File, I First Preprocess The Metadata And In Pandas Df. (There May Be Lost Videos, Invalid Videos Etc, So I Remove Those From The Df). I Want To Log T

None

5 months ago

0 Regarding The Open Source, Self-Hosted Version Of The

the agent inside the docker compose is just a handy one to serve a service queue where you can queue all your "clean up" tasks that are not deep learning related, using only a bit of CPU

one year ago

your need both in certain case

one year ago

inside the script that launch the agent, I set all the env need (aka disable installation with the var above)

one year ago

0 How To Tell Clearml Server To Use Cloud Storage (Azure)? I Have A Clearml Server Deployed With Docker-Compose. As Per Instruction

@<1523701087100473344:profile|SuccessfulKoala55> Is it even possible to have the server storing file to a given blob storage ?

one year ago

0 I Have A Docker Container That Have Clearml-Agent Running Inside In Normal Mode. The Agent Take On A Task And Execute It Fine. I Just Want To Somehow Log The Docker Image Version That The Agent Is Running Inside. I Start My Container With Something Like:

you mean this dump section ?

one year ago

@<1523701087100473344:profile|SuccessfulKoala55> It's working !! Thank you very much !!! Clearml is awesome !!!!

one year ago

0 Hello, All. I’Ve Recently Started Experiencing A Weird Issue With Arg Parsing Where Any String Values Are Being Repeated As Lists Of Strings When The Values Are Sent To The Clearml Server (See Attached Screenshot). I Believe This Issue Started Around The

I also have the same issue. Default argument are fine but all supplied argument in command line become duplicated !

one year ago

0 Hi Everyone, I Am Running A Pipeline Using The Autoscaler, I Am Able To Spin Up The Vm Instance Using The Autoscaler And The Docker Is Also Getting Installed In There Perfectly. The Issue I Am Facing Is That During Executing A Pipeline Task While Cloning

how di you provide credentials to clearml and git ?

one year ago

0 Is There A Way To Tell The Agent To Use A Specific Venv Pre Installed ? Like The One Already Installed In The Developer Pc And The Agent Is Running Inside That Same Pc?

Oh, so you mean CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/path/to/my/venv/bin/python3 ??

one year ago

0 Is There A Way To Tell The Agent To Use A Specific Venv Pre Installed ? Like The One Already Installed In The Developer Pc And The Agent Is Running Inside That Same Pc?

Should I put that in the clearml.conf file?

one year ago

0 Is There A Reason That Im Not Seeing Any Side Panels? Following This Tutorial:

have you try a different browser ?

one year ago

0 ***** Solved ***** It Appears That Clearml Hasn'T Automatically Captured The Requirements.Txt File In The Cloned Repository. Adding The Following Line Of Code At The Beginning Of My Script Fixed That:

following this thread as it happen every now and then that clearml miss some package for some reason ...

one year ago

0 Is There A Way For Clearml To Assign Semantic Version To Model Automatically Like Mlfow Does?

Should i open a feature request?

one year ago

0 Hi. We Have Task That Generate Trained Model In

To "attach" that zip to the model, do you just use the update_weight and point to that zip file?

one year ago

Show more results