CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Also, Any Advice On Using Best Practice Of Using Task.Create() Instead Of Task.Init()? I Have The Need Of Specifying Docker And Repository, So Only Find Task.Create() Can Achive What I Need. But Then I End Up With Always Creating 2 Scripts For Each Task I

from clearml import Task

task = Task.init(,...)
print("hello world!")

6 months ago

0 What Is The Proccess To Rerun Optimization Sub-Tasks That Failed? Also, Can You Add More Paramters Combinations To Optimization After It Was Completed?

I think you can simply reset and enqueue the task again for it to run. Question is, why did it fail?
Are you running the HPO example? What do you mean by adding more parameter combinations? If the optimizer task finished you either need a new one or to reset the previous and re-run it.
You can do various edits while in draft mode

3 years ago

0 Hi, I Am Trying To Use The Parameterset For Hyper-Parameter Tuning With Dependencies, An Example Of How I Use It: Parameterset([{“Prm1”:1, “Prm2": 1},{“Prm1”:2, “Prm2":2}]) But I Get A Warning :

Can you please add a screenshot of how the hyper params show in the UI for you?

3 years ago

0 Hello, I Had A Setup For Training Ml Model Of Multiple Sub-Modules, Used Pipelines From Task. Didn'T Run It For 4 Months, Was Working Fine Back Then, Now When I Run Pipeline, Steps Are Being Run And Completed Emty, No Console Log, No Stats, Nothing, What

Hi @<1623491856241266688:profile|TenseCrab59> , are you self deployed? Can you provide some logs/screenshots? If you go directly into the task information of each step there console is empty?

one year ago

0 Where Can I Find A More Extensive Documentation Of Serving? I'M Looking For

Hi WackyRabbit7 ,

Is this what you're looking for?
https://github.com/allegroai/clearml-serving

3 years ago

0 I'M Trying To Understand The Difference Between Tasks And Pipelines. I Get The Big Picture But The Thing I Struggle To Understand Is The Interplay In The Code Itself. If You Set Up A Pipeline You Wouldn'T Include A Task Init? Or Is There A Reason To Use B

I suggest you take a look at the examples here and play with them a bit 🙂
None

2 years ago

0 Hello Everyone, Is There An Easy Way To Clone A Pipline And Execute It With New Parameters? I Know That There Is The Possibility With Task But With Pipelines I Haven'T Found Anything In The Documentation Yet. Thank You In Advance For Your Answer.

For example:
None
Thats adding an argument with pipeline from tasks
None
Thats adding an argument with pipelines from decorator, see - mock_parameter & pickle_url

9 months ago

0 Hi. I'M Using Clearml To Log My Experiments. During Training, I Load Files Using Torch.Load.Clearml Displays The Following Message:

SoreDragonfly16 , yes

4 years ago

0 Hi There, I Am Intending To Work More Often With The Datasets, But Not Sure If There Is A Way To Retrieve Specific Files From A Uploaded Dataset. I Saw I Can Retrieve Chunks Of Data, But Not Sure How That Would Work With A Dataset Of Parquet Files. If I H

Since the "grand" dataset will inherit from the child versions you wouldn't need to have data duplications

3 years ago

0 Hello! The Agent-Services Present In Clearml Server'S Docker-Compose Is Only For Cleanup Tasks, Right ? For Training I Would Need To Run Another Instance Of Clearml-Agent Alongside The Docker-Compose ?

Enqueue simply puts the task in the queue to be picked up by an agent. You need an agent running and listening to the queue for it to be picked up 🙂

3 years ago

0 Hello, I'Ve Been Using Clearml For A Month Now, And Must Say It'S A Really Good Product! I'M Mostly Working With Huggingface Transformers, I Integrated Clearml In My Solution:

Hi HungryArcticwolf62 ,
from what I understand you simply want to access models afterwards - correct me if I'm wrong.
What I think would solve your problem is the following:
task = Task.init(...., output_uri=True)This should upload the model to the server and thus make it accessible by other entities within the system.
Am I on track?

3 years ago

0 Clearml 1.3.2 I'M Running

How many tasks do you figure this thing is iterating through the project?

3 years ago

0 Hi Friends

To use the SDK see here:
https://clear.ml/docs/latest/docs/references/sdk/task#taskget_all

3 years ago

0 Helo, I Wonder If Someone Have An Idea How To Handle The "Error", Which I Mentioned In

Hi @<1856144871656525824:profile|SparklingFly7> , can you describe the issue you're experiencing? I saw there is a new response in github - None

one month ago

0 Hej Everyone! I'M Trying To Setup Cleraml Using K8S. Everything Went Well Until I Started My Training Pipeline. The Problem Is That My Debug Samples Aren'T Shown

Hi @<1585078752969232384:profile|FantasticDuck7> , can you add some information? Are the debug samples being logged and just not showing in the webUI or they are not available at all? Are debug samples logged to the files server or some other storage?

11 months ago

0 Hey, I Tried To Use

Which version for clearml-data are you using?

3 years ago

0 Hi, I Have Problem With Retrieving Models From Storage I Have Following Code

Hi @<1858319200146165760:profile|PoisedDeer30> , can you provide a standalone snippet that reproduces this behaviour?

Also do you have a log of this? From where did you delete it?

one month ago

0 Is There A Functionality To See The Dependency Structure Of Datasets? Or Has Anyone Written A Script For This?

EnormousWorm79 , Hi 🙂

What do you mean by dependency structure?

3 years ago

0 Hi, I Have Problem With Retrieving Models From Storage I Have Following Code

you deleted the model from the same directory as you ran from the code but you didn't delete it from the cache folder?

one month ago

0 Hi, I'M Eric. I'M An Mlops Engineer At A Company With 9 De'S, 6 Ds'S, And 2 Mlops Engineers. I Just Learned About Clearml A Few Hours Ago And I'M Getting Excited About It!! I'M Wondering If We Could Replace Our Current Mlops Platform With Clearml. Right N

I see, thank you for the input 🙂

2 years ago

0 Hi, I Have Problem With Retrieving Models From Storage I Have Following Code

Can you add your clearml.conf file here?

one month ago

0 Hello

Not that I know of 🙂

2 years ago

0 Hi Everyone! I Am Currently Using Clearml To Track My Datasets. At Each Run I Am Producing Some Datasets That Are Somehow "Heavy". As I Want To Track Any Diff Change Every Time, I Am Using The

Hi @<1787653566505160704:profile|EnchantingOctopus35> , I don't think you can clean up parents without damaging the children since they rely on that. I would suggest taking any data you don't want scrubbed and then creating a new version with it. Then delete the unrelated older datasets. What do you think?

8 months ago

0 I'M Publishing The Model Artifact After The Tensorflow Model Is Saved. But In The Ui, The Download Button Is Grayed Out. And Get_Local_Copy() Doesn'T Seem To Work Either, Help Would Be Appreciated.

How are you saving the model?

3 years ago

0 I Have Used Aws S3 And Minio As Storage For Clearml Artifacts. But Has Anyone Used Nexus As A Storage ?

DeliciousBluewhale87 , what would be your use case? You can save various artifacts/models/files to nexus via the previously mentioned method (You can also configure this in your clearml.conf file under sdk.development.default_output_uri="" )

4 years ago

0 Can You Please Point Me To Documentation Of Cron Jobs In Clearml?

Hi UpsetTurkey67 ,

Is this what you're looking for?
https://clear.ml/docs/latest/docs/references/sdk/trigger#add_model_trigger

3 years ago

0 Hello Clearml Ppl

FreshKangaroo33 ,

On the top right of the experiments view you have a cog wheel, if you click on it, it will give you an option to add hyper parameters to the table. I think from the API calls from there you can figure something out 🙂

3 years ago

0 Hi Everyone! When I Execute

Hi @<1540867420321746944:profile|DespicableSeaturtle77> , what didn't work? What showed up in the experiment? What was logged in the installed packages?

2 years ago

0 Hi, We Have Clearml Version Webapp: 1.3.0-165 • Server: 1.3.0-165 • Api: 2.17 Suddenly All Experiments Were Removed. After Checking Logs We See That Before 6 Days Elasticsearch Container Was Terminated Due To Out Of Memory And New One Was Created Instead

You can restore these tasks by copying or moving them from task__trash into task collection. But the events for these tasks cannot be restored. About the user who deleted them unfortunately ClearML does not record this info in Mongo and without logging to ES there is no place to retrieve it (I can suggest using Kibana to monitor ES). You can try to inspect the mongo collection url_to_delete. It contains all the links from the deleted tasks that should be removed from the fileserver. If you se...

2 years ago

0 Hi All I Am Would Like To Somehow Prevent Clearml Caching From Caching A Task That Hasn'T Uploaded Artifacts (Using Cache_Executed_Step In

Hi @<1533619716533260288:profile|SmallPigeon24> , can you please elaborate on your usecase ?

one year ago

Show more results