CostlyOstrich36

0 Questions, 4210 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4210

0 Hi Clearml, I Encountered This Issue Last Week: I Tried To Delete A Few Experiments From One Project (That I Archived Beforehand), An Error Message Appeared And I Found Out That Many Experiments Have Been Removed From All Of The Projects

Hi MagnificentMosquito84 , is this a self hosted server? What version is it? Do you have visibility into the logs?

2 years ago

0 What Is

MelancholyElk85 Hi!
You can use a custom image docker if it's on docker hub to reduce overhead. Regarding set_base_docker() equivalent for PipelineController , let me check

4 years ago

0 In Pipelines. Is It Possible To Inject A Requierment.Txt Such That The Executing Node Will Install Before Running Tasks?

the question how does ClearML know to create env and what files does it copy to the task

Either automatically detecting the packages in requirements.txt OR using the packages listed in the task itself

3 years ago

0 After Saving Models During Training I Cant Reuse The Same Task To Continue Training Is There Any Way To Continue Task Even Though There Are Models Saved? Alternatively Is There Any Way To Make Torch.Save Not Automatically Save The Model?

StaleButterfly40 Hi!
You could clone the original task and edit the input model of the new task as the output model of the previous task 🙂

4 years ago

0 Hey, I Am Trying To Use Clearml'S Hyper Parameter Optimization Ability. I Am Struggling Connecting The Parameters Names To My Code, Getting The Following Error:

Hi ObliviousClams17 , can you provide a code snippet that reproduces this?

2 years ago

0 Is There Anyway To Cancel The “--Rm” In The Clearml Agent Docker Mode?

Hi @<1523704667563888640:profile|CooperativeOtter46> , I don't think so. What is your use case?

one year ago

0 Agent And Env Variables (This Is Almost Duplicate

And in what section are you setting the environment?

one year ago

0 Hello, Is There A Way To Running Multiple Environments (Like Staging, Production) On The Same Clearml Instance? Or Do We Need Separate Instance For Each Environment? Or Is There A Way To Restrict What Each User Can Do? (Like Not Modify Other User Experime

Hi :)
I'm guessing you're running a self hosted version? I think that access rules are a feature in the enterprise version only.

3 years ago

0 Hi, Folks! Cannot See Plots In Clearml. Do You Know Why This Can Happen?

Possible, do you see any errors in ES? Also, what do you see in developer tools when navigating to the Plots tab?

11 months ago

0 Hi. Executing Reports I Noticed Quadruple, Identically Rendered Results. Does Anybody Know A Solution? E.G.

@<1543766544847212544:profile|SorePelican79> , what version of the SDK are you using? Also, what version of the backend are you running?

one year ago

0 Hello Everyone! I Am New To Clearml. I Have My Prebuilt Containers And Wanted To Run Them Using

Hi @<1681836303299121152:profile|RoundElk14> , I suggest watching this - None

one year ago

0 Hi, I Notice A New Behavuour With Clearml-Agent=1.1.0. When It Is Installing The Packages I Nrequirements.Txt, It Failed With.

Did anything change in your configurations? In the previous version there was no such issue? Is the agent version the only change?

4 years ago

0 Hello Everyone, Is The Logging Of "Automodelforcausallm" Models Supported? Even With Manually Logging Of Llama-2-7B-Hf It Does Not Appear In The Model List (Even When Uploading As Artifact)

Hi @<1637624975324090368:profile|ElatedBat21> , do you have a code snippet that reproduces this? You can also manually log a model to the system using the OutputModel - None

one year ago

0 Hi Everyone! I Have A Question Regarding Events-Training_Stats_Scalar-D1Bd92A3B039400Cbafc60A7A5B1E52B Index Its Size Is 93 Gb And It Initialises For 6 Hours. Can I Decrease Size Of This Index?

You can delete the index directly but do note that this will remove all scalars from your experiments.

To delete you can use the following:

curl -XDELETE "localhost:9200/events-training_stats_scalar-d1bd92a3b039400cbafc60a7a5b1e52b"

2 years ago

0 Hello Community, I'M Reading About

Long story short - You'll have to write a service to upload.

They way that datasets work - the SDK/CLI actually do the uploading itself. The REST API simply registers them on the backend

2 years ago

0 Hi, Can I Use The Taskscheduler To Schedule To Run Pipeline? Right Now It Look Like I Can Schedule Tasks (But Not Pipeline). Thanks

Hi GrittyCormorant73 ,

How are you scheduling a task now using TaskScheduler?

3 years ago

0 Hi! If There Are Several Tasks Running Concurrently, Which Task Should

Are you referring to the pipeline task?

4 years ago

0 Hi Everyone! I Created A Pipeline From One Block, Passed The Initial Parameters. Please Tell Me, Is It Possible To Make A New Launch Of The Pipeline, But With Different Parameters, Just Like In The Draft Mode Of Usual Experiments. Globally, I Want To Init

Did the second run, run remotely or locally?

2 years ago

0 Hi, I Am Trying To Use Omegaconf With Task.Connect_Configuration And I Get The Following Error:

Can you try with Task.connect() ?
https://clear.ml/docs/latest/docs/references/sdk/task#connect

3 years ago

0 I Have A Situation Where I’D Like To “Promote” The Pipeline (And Dataset) By Creating It In A Completely Separate Instance Of Clearml Server Which Is Used For Production Retraining (Vs. The Dev. Clearml Server That Is Used For Experiments) A) Is This Some

RoughTiger69 Hi 🙂

Regarding your questions:
Moving certain tasks/datasets from server to server would require a data merge. This process basically requires merging the databases (mongodb, elasticsearch, files etc.). I think it's something that can be done in the paid version as a service but not in the free. I think if you'd like to 'promote' tasks to production you can either work on a special project for that OR upload the models to S3 and then re-run the experiment and point it to the...

3 years ago

0 From What I Understand Clearml Should Be Auto Logging My Model, How Ever This Isn'T Happening. I Have Clear Ml Installed Via Docker On A Local Server, And Am Using Jupyter Lab On A Separate Local Server. Some Things Get Logged, Including Console Text, But

Hi RoundMole15 , what version of clearml are you using? Also how is the model being saved without ClearML?

3 years ago

0 Hi ,Could We Use Clearml For Nlp Projects?

Hi @<1536881167746207744:profile|EnormousGoose35> , you certainly can and should 🙂

2 years ago

0 Hi! Trying To Orchestrate A Pipeline On Multiple Agents For The First Time. I Am Setting Up The Pipeline From Functions And I Need The Individual Function Steps To Run From A Cloned Repository Due To Local Imports. The Pipeline Task Detects And Clones The

I think the controller and steps need to be in the same repository

one year ago

0 Hi, I Am Trying To Upload An Optimization Task And I Have The Following Message At The Bottom Of The App. Also When I Try To Upload The Task, It Fails With The Following Error ((Private - Removed) - Is Just Instead Of The Real Id):

AbruptWorm50 , it seems the issue is fixed and applications are running again for me 🙂

3 years ago

0 Hi, I'Ve Run Into A Problem And Would Appreciate Some Help. I Installed Clearml Locally. When I Run A New Task On A Remote Server And In The Python Training Code I Set It To Only Train On One Gpu. Everything Works Fine And I See All The Scalars Automatica

What is the command you used to run the agent?

11 months ago

0 Hello, Is There A Way To Selectively Disable Logging Of Certain Scalars? My Pytorch Callback Reports Certain Scalars For Informative Purposes, But I Don'T Want Those To Clutter Up The "Scalars" Plot, And I Only Want To See Certain Scalars Plotted. I Am Aw

Hi JuicyOtter4 , not sure you can disable certain scalars but you can disable auto logging of specific frameworks using the method showed here:
https://www.youtube.com/watch?v=etGjxOKG9lo

Hope this helps 🙂

2 years ago

0 Good Week Clearml Team

Hi UnevenDolphin73 ,

If I look at a specific experiment (say, the Artifacts tab), and then click on another experiment in the experiment list, it used to automatically show the newly selected experiment's Artifacts tab. It still does this, but it now shows a blank page. I have to choose a different tab and switch back.I think they fixed it in the next version that should be released soon.

(Not sure if by design) When selecting an experiment in a (new) project, it used to automatically swit...

3 years ago

0 Has Anyone Found A Workaround For The Bug?

BitterLeopard33 , I don't see anything in GitHub. Maybe open an issue for better visibility ? 🙂

3 years ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

What is the base task you are using? It looks like you're using one of the examples 🙂

3 years ago

0 Hi, If I Work With Excel Files And I Add New Features In It How Can Clearml Can Help Me Track The Features? How Should I Store My Samples (500,000) To Maximize The Benefit?

One way that is, every new feature will be save as a new file and I will specify the parent.

I think that would be the best way 🙂

3 years ago

Show more results