CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 How Do I Extract From A Completed Task, The Time It Took To Run ? Given I Have The Id Of The Task.

You can fetch the task object via the SDK and inspect task.data or do dir(task) to see what else is inside.

You can also fetch it via the API using tasks.get_by_id

2 years ago

0 Hey, Do Hyperdatasets Offer The Same Features With Tabular Data? Almost All Examples On The Docs Are On Image Datasets

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , HyperDatasets are built mainly for unstructured data since the problem itself is more difficult, but all features can be applied also to tabular data. Is there something specific you're looking for?

2 years ago

0 Hi, Does Anyone Know If There Is A Way To Have The Dataset Graph That Tells Us Which Dataset Was Created From Which Other Ones Without Setting The Previous Datasets As Parents? We Have Large Raw Datasets That Are Used To Create Several Smaller Ones, And I

Hi @<1523703397830627328:profile|CrookedMonkey33> , not sure I follow. Can you please elaborate more on the specific use case?

Currently you can add plots to the preview section of a dataset

one year ago

0 I Wonder If There Is Any Way To Sync Data On Cloud Storage (E.G S3 Or Minio) Using Clearml-Data Sync Command? Because I Don’T See Any Place In The Documentation Mention It, We Can Upload From Local Files But Not The Files On Cloud

Hi @<1603198153677344768:profile|ExasperatedSeaurchin40> , I think this is what you're looking for - None

2 years ago

0 Hi, How Can I Get Commit Id For Task Using Apiclient?

What about tasks.get_all and you specify the ID of the task you want as well:
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all

2 years ago

0 During Our First Large Hyperpameter Run, We Have Noticed That There Are Some Tasks That Get Aborted With The Following Console Log:

It looks like you're on a self hosted server, the community server is app.clear.ml where you can just sign up and don't have to maintain your own server 🙂

2 years ago

0 Hi! While I'M At The Office, All Works Well, But At Home I Get A Lot Of Timeout Warnings While Trying To Download Or Save Data. I Dont Think It Is Related To The Connection Quality Because It Is Realy Good (Download 600 Upload 100). Can You Help Me Fig

The communication is done via HTTPS so relevant ports should be open.

Did you try with a hotspot connection from your phone?

one year ago

0 During Our First Large Hyperpameter Run, We Have Noticed That There Are Some Tasks That Get Aborted With The Following Console Log:

Hi @<1541592204353474560:profile|GhastlySeaurchin98> , how are you running the experiments - which type of machines - local or cloud? Are you running your own server or using the community?

2 years ago

0 Is There A Way To Get List Of Users From The Api?

Hi @<1523701842515595264:profile|PleasantOwl46> , you can use users.get_all to fetch them - None

one year ago

0 I Have Am Issue Getting A Model From The Model Repository When Running A Task In A Remote Worker. I Have A Custom Model That Was Saved With Outputmodel:

Hi @<1523711002288328704:profile|YummyLion54> , can you please add a full log of both runs for reference?

2 years ago

0 I Have A Question. If I Do A Training On A Cloud Instance For Example The Models Are Saved There First. This Is The Path That Is Also Logged In The Clearml As Model Url. However, After The Training The Resulting Model Is Copied To A Central Fileserver And

GreasyPenguin14 Hi!

If I understand you correctly, you would have to change the url's of the models yourself so they would point to the now downed instances.

You can also use the following setting:
sdk.development.default_output_uri: "SOME_URL"
in your ~/clearml.conf to set it to send the models anywhere you want them to go from the get go 🙂

Is that helpful?

3 years ago

0 I Am Struggling A Bit To Understand The Use Case Of A Pipeline: Let Say You Have Step1 -> Step2 -> Step3 What Is The Point To Use Pipeline Feature Versus Having A Single Task That Do Those Steps One After Another ???

If there is a change in code (Not just the script itself but a different commit / different uncommitted changes in the repo). Makes sense?

2 years ago

0 Hello, I Had A Setup For Training Ml Model Of Multiple Sub-Modules, Used Pipelines From Task. Didn'T Run It For 4 Months, Was Working Fine Back Then, Now When I Run Pipeline, Steps Are Being Run And Completed Emty, No Console Log, No Stats, Nothing, What

Hi @<1623491856241266688:profile|TenseCrab59> , are you self deployed? Can you provide some logs/screenshots? If you go directly into the task information of each step there console is empty?

one year ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

Where is the error?

3 years ago

0 Hello! How Do You Manage Ssh Github Connection & The Clearml Agent In A Services Mode (One That Has To Be Run In The Container)? When I Try To Run A Pipeline With The Service Queue It Fails To Connect. The Reasons For That As I Can See Is That It Runs In

Hi @<1717350332247314432:profile|WittySeal70> , are you using a self hosted server or the community?

one year ago

0 If You Rely On Task To Automatically Upload Artifacts, It Seems You Cannot Retrieve Them Using

TrickyRaccoon92 , Hi!

Yes I believe this is the intended behavior. Since if you upload automatically you can upload many artifacts during a single run, whereas when you upload manually you create the object yourself.

3 years ago

0 Hi, Were Running Clearml Webserver (Version On The Ui Says: 1.1.1-135 • 1.1.1 • 2.14) On A Dedicated Ubuntu 20.04 Machine With 15G Ram And 8 Cores. Lately We Experience Slowdowns And Sometimes Even Stretches Of 0.5-1 Hour In Which The Webui Does Not Resp

Hi NervousFrog58 , versions 1.1.1 seem to be quite old. I would suggest upgrading your server. Please note that since then there have been a couple of DB migrations, so make sure to follow all steps 🙂

2 years ago

0 For Some Reason I Can'T Delete A Pipeline Projet, The Deletion Is Running Indefinitely. Is There A Way To Force The Deletion Of A Project Via The Apiclient?

My bad, should have asked you to go to Network as well to see if anything returns errors

2 years ago

0 Hey There! Question About The Aws Autoscaler, The Tldr Is That I Can'T Get The Aws_Autoscaler.Py When Running With --Remote Flag To Clone My Git Repository (Hosted On Gitlab). Here'S What I Did So Far:

Hi @<1612982606469533696:profile|ZealousFlamingo93> , I'm not sure I understand. You're trying to run the autoscaler, how is the clearml-agent connected to this?

one year ago

0 Hey, I Am New With Clearml And Need Some Help

Think of it this way. You have the pipeline controller which is the 'special' task that manages the logic. Then you have the pipeline steps. Both the controller and the steps need some agent to execute them. So you need an agent to execute the controller and also you need another agent to run the steps themselves.

I would suggest by clicking on 'task_one' and going into full details. My guess it is in 'enqueued' state probably to the 'default' queue.

one year ago

0 Hey Everyone, I Am Facing A Weird Issue With A Docker Image. When I Use It As My Base_Docker, Clearml Basically "Opens A Terminal" Inside Of It And Does Not Continue Any Further. I Have Never Had This Behavior With Any Other Docker Image. With The Same Co

Hi @<1670964687132430336:profile|SpicyFrog56> , can you please add the full log?

one year ago

0 Hello, Deploy Clearml In Docker And Train A Yolov8 Model, Finish Train, In Plots No Pics Show,So Why

Are you using the community server or are you using the open source and self hosting?

10 months ago

0 Hi, I Am Trying To Upload An Optimization Task And I Have The Following Message At The Bottom Of The App. Also When I Try To Upload The Task, It Fails With The Following Error ((Private - Removed) - Is Just Instead Of The Real Id):

AbruptWorm50 , the guys tell me that it's under progress and we will be updated in the following minutes 🙂

3 years ago

0 Hello All For Some Reason, Whenever I Start A Pipeline It Starts Two Runs At The Same Time, Which Ruins One Task. When I Abort One Such Pipeline Run, I Get "Aborted 2 Experiments". How Can I Stop That?

Hi @<1533619716533260288:profile|SmallPigeon24> , is it possible you're selecting multiple experiments? Or maybe there were two initial steps that were aborted? How does your pipeline look in the UI and do you have something that reproduces that?

2 years ago

0 Hello Everyone! I Launched An Ec2 Instance That'S Free Tier (

CluelessElephant89 , the relevant command should be something of the sort sudo docker logs clearml-apiserver

3 years ago

0 Hi, I Am Trying To Use The Clearml Aws Autoscaler Service (In The Pro Version) And Getting This Error:

Is there a way to lower the needed credentials for specific actions such as: run, stop, start instances etc...? for example: fixing it to work only with conditions of specific subnet, security group and instance types? ( I was trying doing it but as I said it failed with this message:

Can you elaborate on the specific configuration?

3 years ago

0 Hello, Is It Possible To Migrate From A Domain Name To Another ? I Have Instanciated A Clearml Server With Domain Name Myclearml.Server Et A Data File Server With Domaine Name Myminio.Server And Some Data Scientists Used It. Now I Have Backuped The Data

Hi DepravedCoyote18 , as long as you have everything backed up (configurations and data) on /opt/clearml/ (I think this is the default folder for storing clearml related stuff) the server migration should work (Data is a different issue).

However, ClearML holds links internally for datasets/debug samples/artifacts and a few other outputs maybe. Everything currently logged in the system to a certain minio server will still be pointing to that minio server.

Does that make sense?

2 years ago

0 Is There Some Example Of How To Develop A Hpo In A Pipeline Setup Where Each Hyperparameter Setup Is Each Own Step Again? Should We First Mimick A Base Task For Example?

Hi @<1577468611524562944:profile|MagnificentBear85> , can you please elaborate a bit on how exactly you want to stricture this?

2 years ago

AbruptWorm50 , can you confirm it works for you as well?

3 years ago

0 Hi, Quick Y/N Question: Is It Possible To Build A Pipeline Of Pipelines? I'D Imagine This To Be Possible, Since Pipelines Are Also Treated As Tasks.

Hi @<1523703572984762368:profile|SlimyDove85> , conceptually I think it's possible. However, what would be the use case? In the end it would all be abstracted to a single pipeline

2 years ago

Show more results