CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

My guess other agents are sitting on different machines, did you verify that the credentials are the same between the different clearml.conf files? Maybe @<1523701087100473344:profile|SuccessfulKoala55> might have an idea

2 years ago

0 Hi, I Am Currently Experimenting With Clearml Pipelines In Offline Environments And I Am Trying To Establish A Best Practice For Changing And Maintaining Dependencies In The Pipeline Tasks. I Noticed That Clearml Automatically Pulls The Requirements.Txt

Hi ShakyOstrich31 ,

Can you verify that you did push the updated code into your repository?

3 years ago

0 Hi Team,May I Get Any Reference To Check On Model Drifting And How We Can Automate This For Retraining Of Model

You can see my answer in channel

2 years ago

0 Hi All, I Have A Pipeline Construct From Multiple Base Tasks. Is There A Way To Get Output Or Notification Somehow From One Of The Steps In The Pipeline On The Fly? I Want To Know If I Can Trigger The A Child Step Based On Some "Go" Command That I Will Pu

Hi @<1539417873305309184:profile|DangerousMole43> , if understand correctly, you basically want to have some logic in your pipeline that will launch jobs according to some "trigger"?

one year ago

0 Hey I'Ve Not Used Clearml Pipelines Much. Is There A Possibility To Trigger A Pipeline Based On Some Clearml Event? (Like Tagging An Experiment)

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , I think this is what you're looking for 🙂
None

2 years ago

0 Hey I'Ve Not Used Clearml Pipelines Much. Is There A Possibility To Trigger A Pipeline Based On Some Clearml Event? (Like Tagging An Experiment)

From my understanding, they are 🙂

2 years ago

0 Also, Does You Guys Support User Authentication? In The Documentation -

Hi @<1580367711848894464:profile|ApprehensiveRaven81> , I'm afraid this is only option for the open source version. In the Scale/Enterprise licenses there are SSO/LDAP integrations

2 years ago

0 Hi Everyone, Has Someone Of You Tried To Track Your Shap Plots With Clearml? Somehow In My Dashboard The Tracked Plots Are Empty. Might They Be Too Complex Or Something? Br Sophie

Hi @<1787291173992271872:profile|BlandCormorant75> , how are you logging those plots? Can you provide a stand alone snippet that reproduces your behaviour?

8 months ago

0 Hi, We’Re Deploying Clearml On The Eks And Have An Issue With Authenticating The Server With The S3 Bucket. The Connection To S3 Bucket Is Not Working. Our Current Diagnosis: Clearml Internally Uses Aws_Access_Key_Id And Aws_Secret_Access_Key. But We A

As you mentioned it seems that the authentication you're using is not created as part of the boto object. Is there a specific reason you don't want to use access/secret pairs for authentication?

3 years ago

0 Hello ! I Am Using The Pipelinecontroller To Orchestrate A Set Of Job. The Clearm-Agent (Workers) Are Hosted On Spot Instance (Gcp) And The Pipellinecontroller Does Not Mark The Task As Failure Whenever A Worker Gets Preempted. Is There A Way To Mark The

Is the pipelinecontroller also working on preemptible instances?

2 years ago

0 Can You Please Point Me To Documentation Of Cron Jobs In Clearml?

Hi UpsetTurkey67 ,

Is this what you're looking for?
https://clear.ml/docs/latest/docs/references/sdk/trigger#add_model_trigger

3 years ago

0 Hi All, I'M New To Clearml, And Trying To Understand The Set_Metadata Method Of The Dataset Class. The Documentation Is Almost Non-Existent Does Anyone Have An Example Script? How Would I Add Data Using E.G. Pandas. I Assume One Column Would Relate To The

Hi @<1574931891478335488:profile|DizzyButterfly4> , I think if you have a pandas object pd then the usage would be something like ds.set_metadata(metadata=pd, metadata_name="my pandas object")

I think you would be referencing the entire thing using the metadata_name parameter

2 years ago

0 Is There Any Way To: Within The Ui, Select And Compare The Scalars For More Than 10 Experiments? I'D Like To Do Something Like:

SmallDeer34 , and they still have the same colors when you maximize the graph?

3 years ago

0 Hi Guys, I Am Having Some Trouble Running Some Training Scripts With The Agent Functionality:

Hi ShallowGoldfish8 , what versions of ClearML & ClearML-Agent are you using?

3 years ago

0 Anyone Faced An Issue With Elasticsearch Before

Can you provide the full log?

3 months ago

0 Has Anybody Encountered:

I think this is due to Optuna itself. It will manually kill experiments it doesn't think will have good results

2 years ago

0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

And other downloads work OK?

2 years ago

0 Hi All, I Have Deployed A Clearml Server On Linux Vm And I Am Having An Issue With Logging Plots. Specifically, A Plot Is Logged, But In The Ui It Does Not Load. The Developer Tools Provide The Following Error: “Failed To Load Resource: The Server Respon

Hi @<1791277437087125504:profile|BrightDog7> , do you have a code snippet that reproduces this? Is it for all plots or only specifics?

7 months ago

0 Hi Guys Can You Please Tell, What Does This Means..

Hi @<1570583227918192640:profile|FloppySwallow46> , can you please add the full log?

2 years ago

0 Hi, My Server Is On Version 1.11, And Yesterday A Few Of My Runs (With Agent 1.5.1) Failed On

Hi @<1639799308809146368:profile|TritePigeon86> , I think the 1.16 refers to the version of the SDK. I'd suggest upgrading your server regardless 🙂

one year ago

0 Hi, My Server Is On Version 1.11, And Yesterday A Few Of My Runs (With Agent 1.5.1) Failed On

I meant that maybe you ran it with a newer version of the SDK

one year ago

0 Hi, I'M Using Aws Ec2 Instance To Trian My Models With Clearml Autoscaler, But It Says Cuda Device Is Not Avaliable. The Code Runs Well On My Local Pc And It Runs Well On Clearml With Ec2 Yesterday, But It Suddenly Doesn'T Work Today. Is There Anyway To S

@<1597762318140182528:profile|EnchantingPenguin77> , are you sure you added the correct log? I don't see any errors related to cuda

6 months ago

0 Hello All, I'Ve A Question On S3 Integration. I'Ve Deployed Clearml And Clearml-Agent Helm Charts In My Ovh Managed K8S Cluster. I'Ve Jupyterhub Running In Same Namespace. I Was Trying To Make Connection With My Ovh S3 Bucket From Jupyter Notebook By Fetc

Hi @<1665891247245496320:profile|TimelyOtter30> , not sure I follow. It looks like a misconfiguration. I think you need to see the correct settings here: None , also note the direct reference to minio 🙂

one year ago

0 Hi All. I'Ve Been Mistakenly Using

Hi WittyOwl57 ,

Can you give a screenshot of how it's saved in the UI currently? Also can you look at the developer tools and see what tasks.get_configuration_names & tasks.get_configurations return when looking at the experiment's configurations in the UI

3 years ago

0 Hi I Strongly To Solve This Issue Of "Python Virtual Environment Cache Is Disabled. To Accelerate Spin-Up Time Set `Agent.Venvs_Cache.Path=~/.Clearml/Venvs-Cache`" Anyone With Similar Issue And It Was Resolved?

Hi BroadSeaturtle49 , can you please elaborate on what the issue is?

2 years ago

0 Hi, I Am Working In Aws Where I Have Multiple Accounts, Each One Containing Its Own Databases. I Want To Understand How To Set Up A Clearml Server In One Centralized Account, And Then Use That In Order To Launch Experiments In The Different Accounts (Such

Hi @<1749240449366757376:profile|BitingMosquito50> , is there connectivity between the different accounts - i.e can one machine communicate with another machine between accounts? ClearML acts as a control plane. Meaning you can setup it (Server) on some account and if the jobs are running in different accounts the clients(SDK/Agent) running on those accounts will need to have connectivity to the ClearML server machine.

I assume models are saved in their respective accounts, and can be ser...

11 months ago

0 Hi! We'Re Using Clearml In Our Pipeline And Have A Question Regarding Datasets. Currently, We Export Training Data Directly From Clickhouse To S3 Using A Command Like:

Hi, I think this is what you're looking for - None

4 months ago

0 Two Questions Today. First, Is There Some Way To Calculate The Number Of Gpu-Hours Used For A Project? Could I Select All Experiments And Count Up The Number Of Gpu-Hours/Gpu-Weeks? I Realize I Could Do This Manually By Looking At The Gpu Utilization Grap

Regarding 1 & 2 - I suggest always keeping the API docs handy - https://clear.ml/docs/latest/docs/references/api/definitions

I love using the API since it's so convenient. So to get to business -
To select all experiments from a certain project you can use tasks.get_all with filtering according to the API docs (I suggest you also use the web UI as reference - if you hit F12 you can see all the API calls and their responses. This can really help to get an understanding of it's capabilities ...

3 years ago

0 Hey, Im Doing This (Id Like To Set Custom X_Ticks For The Plot):

What do you mean by x_ticks?

3 years ago

0 Hi, I Am Trying To Use The Parameterset For Hyper-Parameter Tuning With Dependencies, An Example Of How I Use It: Parameterset([{“Prm1”:1, “Prm2": 1},{“Prm1”:2, “Prm2":2}]) But I Get A Warning :

Hi MoodySheep3 ,

Can you please provide screenshots from the experiment - how the configuration looks like

3 years ago

Show more results