Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
MiniatureRobin9
Moderator
18 Questions, 36 Answers
  Active since 14 March 2023
  Last activity 2 months ago

Reputation

0

Badges 1

36 × Eureka!
0 Votes
2 Answers
705 Views
0 Votes 2 Answers 705 Views
Hi all 😁 In CleaRML you can make an output of your models as artifacts of the task but it can also be uploaded as model in the ClearML UI. I was wondering w...
one year ago
0 Votes
13 Answers
736 Views
0 Votes 13 Answers 736 Views
Hi all 👋 ! I got an issue with clearml-serving : I'm doing the sklearn tutorial from GitHub None . When I run the train_model.py on my machine, I get the pr...
one year ago
0 Votes
2 Answers
591 Views
0 Votes 2 Answers 591 Views
Hi everyone 👋 I'm crearting a pipeline from controller. In my last task I'm training a bunch of models. I would like to know if It's possible to report the ...
11 months ago
0 Votes
8 Answers
465 Views
0 Votes 8 Answers 465 Views
Hi everyone 👋 I want to delete stuff from my clearml server, but the memory keeps getting used when I delete it from the server. How can I definitely delete...
9 months ago
0 Votes
2 Answers
210 Views
0 Votes 2 Answers 210 Views
Hi all 👋 I have a question regarding Datasets, I can see the genealogy of the Dataset I'm looking at (I can know its parents and older). But I want to see t...
3 months ago
0 Votes
2 Answers
231 Views
0 Votes 2 Answers 231 Views
Hi
Hi 👋 I'm executing a pipeline with PipelineController,is there a method to get the id of this pipeline after its execution (something like PipelineControlle...
3 months ago
0 Votes
6 Answers
604 Views
0 Votes 6 Answers 604 Views
Hi
Hi 👋 I have a problem while trying to delete projects from my server on the UI : sometimes it's saying that there are un-archived stuff in it, so I can't de...
one year ago
0 Votes
6 Answers
855 Views
0 Votes 6 Answers 855 Views
one year ago
0 Votes
10 Answers
790 Views
0 Votes 10 Answers 790 Views
Hi all 👋 I'm trying to understand clearml-task in CLI. In the docs here None you can add tags from your git repo to look for your script with --branch . But...
one year ago
0 Votes
2 Answers
470 Views
0 Votes 2 Answers 470 Views
Hi everyone 👋 When I create a pipeline from tasks, The run time shown in the pipeline can be really different from the run time shown in the task. Is there ...
9 months ago
0 Votes
1 Answers
622 Views
0 Votes 1 Answers 622 Views
Hi everyone! 👋 I'm building a pipeline with PipelineController , and when I put Dataset.get , I got this message repeating itself a lot of time : clearml - ...
one year ago
0 Votes
4 Answers
611 Views
0 Votes 4 Answers 611 Views
Hi everyone! 👋 I got another question : after reading the doc (a lot of times) I'm not sure to understand the difference between a worker and an agent. Coul...
one year ago
0 Votes
2 Answers
615 Views
0 Votes 2 Answers 615 Views
Hi everyone 👋 I'm working on a pipeline with PipelineController . I was wondering if you can make an "optional" step with a condition : Imagine I create a p...
one year ago
0 Votes
5 Answers
722 Views
0 Votes 5 Answers 722 Views
Hi all 👋 ! I'm creating a pipeline from tasks with clearml-task (and with PipelineController). I execute the tasks remotely on an open-source server I set u...
one year ago
0 Votes
5 Answers
763 Views
0 Votes 5 Answers 763 Views
one year ago
0 Votes
5 Answers
734 Views
0 Votes 5 Answers 734 Views
Hi all 😁 ! I would like to add a tag to a pipeline built from tasks like in the GitHub example None , but directly in the python code and not in the UI. Doe...
one year ago
0 Votes
2 Answers
889 Views
0 Votes 2 Answers 889 Views
Hi all ! I'm trying to setup my agent, I always get the same error even when I run remotely a task where I only print('hello world'). I wonder what I'm missi...
one year ago
0 Votes
7 Answers
214 Views
0 Votes 7 Answers 214 Views
2 months ago
0 Hi

Hi @<1523701070390366208:profile|CostlyOstrich36> , sorry for the delay
I just found I could reveal the hidden projects in the setting, I think that was why I couldn't delete everything I wanted 😉

11 months ago
0 Hi All

No problem, I tried with this code :

from sklearn.linear_model import LogisticRegression
from sklearn.datasets import make_blobs
from joblib import dump
from clearml import Task, OutputModel

task = Task.init(project_name="serving examples", task_name="train sklearn model", output_uri=True)

# generate 2d classification dataset
X, y = make_blobs(n_samples=100, centers=2, n_features=2, random_state=1)
# fit final model
model = LogisticRegression()
model.fit(X, y)

#dump(model, filename="...
one year ago
0 Hi All ! I'M Trying To Run My Tasks On Open-Source Clearml-Server. But Everytime I Try To Run A Task On It With Clearml-Agent, I Get The Same Error : Clearml_Agent: Error: 'Utf-8' Codec Can'T Decode Byte 0Xe9 In Position 26: Invalid Continuation Byte Even

Hi @<1523701070390366208:profile|CostlyOstrich36> @<1537605940121964544:profile|EnthusiasticShrimp49> , thank you for your interest, I was wondering if you had time to quickly check my issue

one year ago
0 Hi All

yeah

one year ago
0 Hi All ! I'M Trying To Run My Tasks On Open-Source Clearml-Server. But Everytime I Try To Run A Task On It With Clearml-Agent, I Get The Same Error : Clearml_Agent: Error: 'Utf-8' Codec Can'T Decode Byte 0Xe9 In Position 26: Invalid Continuation Byte Even

Hey @<1537605940121964544:profile|EnthusiasticShrimp49> , yes I can download it and open it with pickle, here is how I do it :
pickle_data_url = ' None '
local_iris_pkl = StorageManager.get_local_copy(remote_url=pickle_data_url)
with open(local_iris_pkl, 'rb') as f:
iris = pickle.load(f)

I set up my agent from my machine but my open-source server is not running on my machine. I can share my agent conf...

one year ago
0 Hi Everyone

Hi @<1523701435869433856:profile|SmugDolphin23> ! Thank you for your answer, I will try both your suggestions 😉

one year ago
0 Hi Everyone ! I'M Working With Pipelinecontroller. Is It Possible To Create A Pipeline With Optional Steps ? To Clarify I Add An Example Of A Pipeline In The Picture. For Example, The User Would Be Able To Modify The Value Of A Parameter To Execute The St

Okay, I found it : I put an if statement with the parameter and continue_on_fail=True in the steps, and it worked. But I had to specify the continue_on_fail in add_step to make it work.

2 months ago
0 Hi All

Hi @<1523701087100473344:profile|SuccessfulKoala55> , here is an example :
On the picture of the Dataset 'DS_Master', the versions 1.0.1,1.0.2,1.0.3 and 1.0.4 are all children of the version 1.0.0. When I go on one specific version, I can see that the version 1.0.0 is the parent of the version I'm looking at. But when I go on the version 1.0.4 for example, I dont' know that the versions 1.0.1,1.0.2,1.0.3 are also children of the version 1.0.0. And I would like to see that on a graph, like t...

3 months ago
0 Hi

Thank you for your answer, it worked 😃

3 months ago
0 Hi

Hi @<1523701070390366208:profile|CostlyOstrich36> , sure, here there are 😉
image
image

one year ago
0 Hi All

Yes, that's right

one year ago
0 Hi

I just checked, and there was no filter (sadly)

one year ago
0 Hi All

Oh okay, it could explain a lot of stuff. Thank you for your answer 👍 My server isn't on 0.0.0.0, so would I need to setup a new one to solve this problem, or is there an alternative ?
I checked the logs as you suggested, I didn't find any error of this type (maybe I didn't put an important parameter). My agent is setup as a docker. Here are the logs.

one year ago
0 Hi All

Okay, thank you for your answer and your concern 👍

one year ago
0 Hi Everyone

Yeah I mean disk space usage (we have our own clearml server)

9 months ago
0 Hi all :wave:! I got a problem regarding Grafana/Prometheus. When I deploy a model with clearml-serving and I add metrics like this: `clearml-serving --id *** metrics add --endpoint slm_POC --variable-scalar beds=0,1,5,10,50 bath=0,1,5,10,50 y=0,100000,50

Wow I didn't send my answer sorry about it.
Yeah you're right keeping old data is always a good way.
I'm new to Grafana so I get questions about it. Anyway thank you for your answer 👍

one year ago
0 Hi All

With my team we found a solution: to execute tasks with agent, we use clearml-task in CLI. We add the argument --output-uri : ***:1234 where *** is the link to our self-hosted server. Then models in pickle are automatically exported to the server, and not the path of the agent

one year ago
0 Hi All

Hi @<1523701070390366208:profile|CostlyOstrich36> , thank you for your answer, sadly it "only" adds tags to the steps of the pipeline, not the pipeline itself. And that's the last part I'm looking for.

one year ago
0 Hi All

Hi @<1523701087100473344:profile|SuccessfulKoala55> , I see. With my team we are wondering what should be the best practice to train and make predictions with machine learning models: do we get models from artifacts to make predictions or is it a better approach to get models from "models" ? 🤔

one year ago
0 Hi All

Hi @<1523701070390366208:profile|CostlyOstrich36> , you can reproduce it with the pipeline of the iris dataset from the github None
I have a gitlab repo, I run this command to run this pipeline :
clearml-task --project test-iris --name pipeline-iris --repo ***.git --script pipeline/pipeline_from tasks.py --queue services --requirements requirements.txt --task-type controller --branch main
My agent is setup as a docke...

one year ago
0 Hi Everyone

We got the server version : 1.12.1-397
We tried to delete a task "print hello world" from the web UI this morning, and we still find it on the disk space of our server

9 months ago
0 Hi All

Hi @<1523701070390366208:profile|CostlyOstrich36> , I have version 1.9.2. When I use the command clearml-task like this one : clearml-task --project test_tag_git --name sklearn --repo http://***.git --script sklearn.py --requirements requirements.txt --branch test_tag --output-uri http://*** using the script from here : None . 'test_tag' is the name of my git tag. When executi...

one year ago
0 Hi All

Hi @<1523701435869433856:profile|SmugDolphin23> ! I enqueued my task and I got an error sadly 😞 . I put the logs here

one year ago
0 Hi Everyone!

Can we have one worker running for multiple agents ?

one year ago
0 Hi Everyone

I'm trying to delete projects, datasets and pipeline from the web UI at my local server adress. For example if I want to delete a dataset, I put it in archive > delete the file only by clicking on the web UI (not with python).
When my team leader look at the disk space usage of the server (in docker), he can still access to this file with the dataset, even if I deleted it from the web UI.

9 months ago
0 Hi Everyone

Hi @<1523701087100473344:profile|SuccessfulKoala55> , Sorry for the delay, thank you for your answer 😉

9 months ago
0 Hi All

Hi @<1523701205467926528:profile|AgitatedDove14> , I added pipeline._task.add_tags(tags) and it works, thank you very much 👍

one year ago
Show more results compactanswers