CostlyOstrich36

0 Questions, 3782 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3782

0 Hello Everyone, I Encountered The Following Error When I Tried To

Are you using the community server or did you deploy yourself?

6 months ago

0 Hi, Is There A Quick Way To Create New Pipeline From Few Other/"Sub" Pipelines?

I meant writing a new pipeline controller that will incorporate the previous pipelines as steps. What is the error that you're getting? Can you provide a snippet?

one year ago

0 There Is Something Weird Going On With Console Log After Latest Updates Of Clearml Server. It Doesn'T Show The Latest Updates, Instead It Often Jumps To The Seemingly Random Parts Of The Console Output

1.9.1?

one year ago

0 Hi, I'M Using Clearml'S Hosted Free Saas Offering. I'M Running Model Training In Pytorch On A Server And Pushing Metrics To Cml. I'Ve Noticed That Anytime My Training Job Fails Due To Gpu Oom Issues, Cml Marks The Job As

Hi JumpyPig73 , can you provide a snippet from the console log? Also, what OS are you running on?

2 years ago

0 Hi, Question Regarding

Can you try with blank worker_id/work_name in your clearml.conf (basically how it was before)?

You can force kill the agent using kill -9 <process_id> but clearml-agent daemon stop should work.

Also, can you verify that one of the daemons is the clearml-services daemon? This one should be running from inside a docker on your server machine (I'm guessing you're self hosting - correct?).

2 years ago

0 Hi , In Clearml How Do I Configure My Agent To Launch A Job On Multiple Gpus? Sometimes I Need 2 Gpus And Sometimes 4,. Lets Say I Have 4 Gpus On My Pc. If I Configure My Agent With All 4 Gpus, And Launch A Job With 2, Would I Still Be Able To Use The Ot

Hi @<1554638166823014400:profile|ExuberantBat24> , you mean dynamic GPU allocation on the same machine?

one year ago

0 Hi, How Can I Get Commit Id For Task Using Apiclient?

What about tasks.get_all and you specify the ID of the task you want as well:
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all

2 years ago

0 How Would Ya'Ll Approach Backing Up The Elastic-Search/Redis/Etc. Data In Self-Hosted Clearml? Any Drawbacks/Risks Of Doing A Simple Process That Periodically Zips Up The

@<1541954607595393024:profile|BattyCrocodile47> , shouldn't be an issue - ClearML SDK is resilient to connectivity issues so if the server goes down the SDK will continue running and will just store all the data locally, once server is back up, it will send everything that was waiting.

Makes sense?

one year ago

0 Is There A Place In Web Ui To Find All

There is literally

Models

tab in each project

Was about to mention it 😛

look like I created a new task for every epoch ...

What do you mean?

3 years ago

0 Hey Guys! I Have Multiple

I would also suggest using pipelines if you want to do several actions with a task controlling the progress.

2 years ago

0 Is There Something Like

ReassuredTiger98 , nothing CLI based but you can do it programmatically via the API quite easily.
Also, what happens if you do clearml-data delete --id <TASK_ID> ? It's a bet but it could actually work as well 🙂

2 years ago

0 Hi, Is There A Quick Way To Create New Pipeline From Few Other/"Sub" Pipelines?

You write code for a new pipeline 🙂

one year ago

0 Hi, I Am Getting

Dataset.get only fetches the dataset object, it doesn't try accessing files yet. What else are you doing in your code that reproduces your issue?

one year ago

0 Hey, I Am Using The Autoscaler For Both Gcp And Aws. The Issue Is That I Can'T See All Of My Workers In Gcp In The Queue. I Assume The

Discussion moved to internal channels

2 years ago

0 Weird Error; My Local Execution Hung With

And when you run it again under exactly the same circumstances it works fine?

2 years ago

0 Hi, I'Ve Been Using Your Saas Platform For Over A Month Now, But Today I Suddenly Noticed Most Of My Data Is Missing, I See That I Have 40 Tasks In My Data Project From The Dashboard As It Should Be, But Inside The Project I Can Only See 6, I Couldn'T Fin

Only news ones after you use SDK 1.6.0 🙂

2 years ago

0 Hey Guys! I Have Multiple

There is an optimizer in ClearML already.
Here is an example:
https://github.com/allegroai/clearml/tree/master/examples/optimization/hyper-parameter-optimization
and some docs 🙂
https://clear.ml/docs/latest/docs/references/sdk/hpo_optimization_hyperparameteroptimizer

2 years ago

0 Hi, Question Regarding

Also, can you verify that you still have the clearml-agent process running? top / htop

2 years ago

0 Hi All! I Am Solving The Following Issue -> File1.Py

Hi @<1523701181375844352:profile|ExasperatedCrocodile76> , and now the worker clones the repo correctly?

one year ago

This is because Datasets have a new view now. Just under 'Projects' on the left bar you have a button for Datasets 🙂

2 years ago

0 [Errors When Migrating Clearml Server From Aws To Gcp]

Hi @<1523702496097210368:profile|ScantChimpanzee51> , your steps look ok but the error pretty much indicates that there is a folder permissions issue. Please navigate manually to /opt/clearml/data folder and check "ls -al" command what are the user and permissions for the "elastic_7" folder and then enter the elastic_7 folder and check the same for its "nodes" subfolder. If the permissions are correct try restarting the docker and checking if it helps.

one year ago

0 Hi, I'M Having Problems With The Installed Packages When Creating An Experiment. The Installed Packages Used To Be A List With The Versions Of All The Installed Packages In The Venv. However, Now I Get The Following:

And thanks again!

3 years ago

0 The Comparison Page Seems To Resize The Experiments So That All Tags Will Fit In The Screen, But Then The Experiments Are Pretty Much Impossible To Compare

Huh, what an interesting issue! I think you should open a github issue for this to be followed up on.

If you remove the tags the page resizes back?

2 years ago

0 If I Want To Run Training Inside A Docker Container, How Do I Connect It To Clearml Installed Outside My Docker Container?

Hi PerfectMole86 ,

how do I connect it to clearml installed outside my docker container?

Can you please elaborate?

2 years ago

0 Dear All, Great To Join Your Community. We Are Working On Plant Growth Stage Models At Basf For Farmers And I Was Wondering If Clearml Can Be Used Also For Data Versioning Of Tabular Data, Structured Data. I Would Like To Track If This And That Row Is Par

Hi @<1543766544847212544:profile|SorePelican79> , I don't think you can track the data inside the dataset. Maybe @<1523701087100473344:profile|SuccessfulKoala55> , might have an idea

one year ago

0 Hello All! Is There Any Way To Hide Menu On The Side Bar? I Want To Show Project Menu Only.

I'm afraid not, but I think it would be a cool feature request on GitHub 😉

one year ago

0 What Does This Log Message Mean

It means there is nothing reporting iterations explicitly or any iterations being reported by any framework. This means scalers will show with time from start as x axist instead of iterations

2 years ago

0 Hi Everyone! I Created A Pipeline From One Block, Passed The Initial Parameters. Please Tell Me, Is It Possible To Make A New Launch Of The Pipeline, But With Different Parameters, Just Like In The Draft Mode Of Usual Experiments. Globally, I Want To Init

Hi @<1524560082761682944:profile|MammothParrot39> , I think you need to run the pipeline at least once (at least the first step should start) for it to "catch" the configs. I suggest you run once with pipe.start_locally(run_pipeline_steps_locally=True)

one year ago

Did the second run, run remotely or locally?

one year ago

0 Hi All, I Have A Problem With Setting Up An Agent. I Set Up Local Server On Ubuntu Behind Proxy, It Seems To Work Correctly. I Can Access Web Ui And Set Up Agent On A Windows Machine Just Fine, But When I Try To Set Up Agent On Any Linux Machine It Fails

Hi, can you give the error that is printed out?

2 years ago

Show more results