CostlyOstrich36

0 Questions, 3690 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3690

0 Hey, Everybody! I Have Such A Question, I Want To Link Clearml Web With My Git So That When I Add A New Task To Git It Will Be Automatically Added To The Queue Or Project Folder On Clearml Web, Can You Please Tell Me If There Is Such A Functionality And I

Hi @<1661904968040321024:profile|SpotlessOwl43> , you can achieve this using the REST API of ClearML - None

9 months ago

0 When I Run Clearml-Data To Create A New Dataset When First Setup The Clearml Server, I Got The Following Error: Root@Banglian-Virtual-Machine:~# Clearml-Data Create --Project Smoke --Name Smokedataset Clearml-Data - Dataset Management & Versioning Cli Cre

Hi @<1572395190897872896:profile|ShortWhale75> , is it possible you're using a very old version of clearml package?

one year ago

0 Hello! I'M Trying To Figure Out How To Deploy A Scheduled Pipeline. I Have A Sample Pipeline Here

It would work from your machine as well, but the machine needs to be turned on... like when an ec2 instance that is running.

one year ago

0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

Check the docker containers logs to see if there are any errors in them when you try to view the worker stats

3 months ago

0 How Would Ya'Ll Approach Backing Up The Elastic-Search/Redis/Etc. Data In Self-Hosted Clearml? Any Drawbacks/Risks Of Doing A Simple Process That Periodically Zips Up The

@<1541954607595393024:profile|BattyCrocodile47> , that is indeed the suggested method - although make sure that the server is down while doing this

one year ago

0 Hello Everybody, I Have A Quick Question, I Have Been Training Multiple Models And Have Reached A Point Where I Am Satisfied With A Model. How Do I Push My Model To S3 Server( Setup In The Clearml.Conf File)? Similar To What We Do When Pushing A Dataset

Hi @<1547028031053238272:profile|MassiveGoldfish6> , I think this is what you're looking for - None

9 months ago

0 Hello, I’M Integrating Clearml Into My Training Code To Track Experiments. I See That Clearml Logs Automatically The Python Env In The “Installed Packages” Section But The List Logged Is Very Different From The

RattyLouse61 , I think you can save the yml conda env file as an artifact, this way it would also be accessible by other tasks 🙂

2 years ago

0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

@<1734020162731905024:profile|RattyBluewhale45> , can you try upgrading to the latest version of the server? 1.16.2 should have a fix for this issue

3 months ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

Please do. You can download the entire log from the UI 🙂

2 years ago

0 Hi, Is There A Quick Way To Create New Pipeline From Few Other/"Sub" Pipelines?

Hi @<1559711623147425792:profile|PlainPelican41> , you can re-run an existing pipeline using different parameters from the UI. Otherwise, you need to create new pipelines with new code 🙂

one year ago

0 Hi, Is There A Quick Way To Create New Pipeline From Few Other/"Sub" Pipelines?

Yes, you'll need to connect them via code

one year ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

Where is the error?

2 years ago

0 Hi, Is There A Quick Way To Create New Pipeline From Few Other/"Sub" Pipelines?

I meant writing a new pipeline controller that will incorporate the previous pipelines as steps. What is the error that you're getting? Can you provide a snippet?

one year ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

It looks like you are running on the community server. Can you right click the experiment in the experiments table and click on 'Share' on all the relevant experiments and send here?

2 years ago

0 Hi Guys! Anyone Else Has Trouble Caching Virtual Environments In The Agent? I Manually Installed A Single Agent On A Virtual Machine, And I'M Using This Conf For Venv Caching :

@<1691620877822595072:profile|FlutteringMouse14> , what version of the agent are you using?

6 months ago

0 I Have Question About A Situation, When Agent Is Running On A Queue, But Also We'Ll Use

You can try, but I don't think so.

one year ago

0 Hey Clearml-Community, I Have A Doubt Around The Default Upload Destination When Defining A Clearml Project & When Defining The Upload Destination For A Model Object When Doing Things Programmatically. I Am Trying To Use The Clearml File Server'S Endpoi

@<1523701132025663488:profile|SlimyElephant79> , it looks like you are right. I think it might be a bug. Could you open a GitHub issue to follow up on this?
As a workaround programmatically you can set Task.init(output_uri=True) , this will make the experiment outputs all to be uploaded to whatever is defined as the files_server in clearml.conf .

one year ago

0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

Hi @<1523704157695905792:profile|VivaciousBadger56> , you can configure Task.init(..., output_uri=True) and this will save the models to the clearml file server

one year ago

0 Does Clearml Have The Ability To Run A Single Experiment Across Multiple Nodes/Gpus In A K8 Cluster?

Maybe SuccessfulKoala55 might have more insight on setting K8s integration 🙂

2 years ago

0 (A Regular Experiment Did Execute In The Remote Agent, I Only Get This With The Pipe)

So when you run it standalone it works fine? How are you creating the pipeline?

2 years ago

0 The Clearml Helm Charts Page Is Gone?

Doesn't work for me either. I guess the guys are already looking into it

one year ago

0 Hello, Got A Simple Pipeline With 2 Tasks, First Task Is The Parent Of The Second One. Until Recently Everything Worked Fine. We Updated Agent Versions And Now A Strange Behavior Happens: The Second Task Is Always Skipped. The Code Base Hasn'T Changed. I'

Hi @<1523708602928336896:profile|HungryArcticwolf62> , can you share an isolated code snippet that reproduces this? What version of the agent are you using now?
Also, what do you mean by skipped? What happens to the pipeline?

one year ago

0 Hi

GrievingTurkey78 , which script in the repository are you running?

3 years ago

0 Hi, I Cannot Show The Results (E.G., 'Console', 'Scalars' ). When Pressing The Scalars Button, Clearml Shows A 'Wait Circle' And Then I Get The Message "Failed To Get Scalar Charts". A Solution That Worked 2 Days Ago, F12 --> Applications Tab --> Storage

RotundSquirrel78 , do you have an estimate how much RAM the machine running ClearML server? Is it dedicated to ClearML only or are there other processes running?

2 years ago

0 To Be Specific, In My Base Task, The Parameters That I Want To Optimize On Appear Under Hyperparameters/General. However When I Execute The Optimization Task, I Get An Error That "Could Not Find Requested Hyper-Parameters"

Hi @<1714813627506102272:profile|CheekyDolphin49> , how are you setting the parameter in the HPO?

5 months ago

0 Hey, About The Dependency Propagation Of Pipeline Components, If I Call A Vanilla Python Function From A Component Does The Dependencies Specified In The Internal Imports Propagated To This Function Call Too ? And Additionally If That Function Is In Anoth

Hi FierceHamster54 , can you please elaborate on the process with a more specific example?

2 years ago

0 Hi, Question About Setting Output_Uri=True For A Pipeline Step Using Decorators. What I’M Seeing Is That Training Results In No Output Destination Specified, And Logs To Local Disk (When Run Remotely In Docker Container), Where Is The Proper Place To Set

Hi ExuberantParrot61 , that's a good question. This is a bit hacky but what if you try to catch the task with Task.current_task() from inside the step and try to change the output_uri attribute there?

2 years ago

0 Bug Report? We Noticed That The Aws Autoscaler Will Lose Track Of Instances Crashing Due To No Space Left On Device, And The Ec2 Instance Will Remain Running Indefinitely.

Does the Autoscaler try to spin new instances?

one year ago

0 Hi, I Am Running A Script Very Similar To The One In

I'd suggest running Task.init first and then exposing the dataset name using argparser afterwards

5 months ago

0 Hi, I Am Running A Script Very Similar To The One In

Yes 🙂

5 months ago

Show more results