Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
MiniatureRobin9
Moderator
15 Questions, 31 Answers
  Active since 14 March 2023
  Last activity 4 months ago

Reputation

0

Badges 1

31 × Eureka!
0 Votes
10 Answers
548 Views
0 Votes 10 Answers 548 Views
Hi all 👋 I'm trying to understand clearml-task in CLI. In the docs here None you can add tags from your git repo to look for your script with --branch . But...
10 months ago
0 Votes
2 Answers
505 Views
0 Votes 2 Answers 505 Views
Hi all 😁 In CleaRML you can make an output of your models as artifacts of the task but it can also be uploaded as model in the ClearML UI. I was wondering w...
11 months ago
0 Votes
4 Answers
413 Views
0 Votes 4 Answers 413 Views
Hi everyone! 👋 I got another question : after reading the doc (a lot of times) I'm not sure to understand the difference between a worker and an agent. Coul...
7 months ago
0 Votes
6 Answers
412 Views
0 Votes 6 Answers 412 Views
Hi
Hi 👋 I have a problem while trying to delete projects from my server on the UI : sometimes it's saying that there are un-archived stuff in it, so I can't de...
7 months ago
0 Votes
5 Answers
527 Views
0 Votes 5 Answers 527 Views
10 months ago
0 Votes
2 Answers
624 Views
0 Votes 2 Answers 624 Views
Hi all ! I'm trying to setup my agent, I always get the same error even when I run remotely a task where I only print('hello world'). I wonder what I'm missi...
11 months ago
0 Votes
1 Answers
405 Views
0 Votes 1 Answers 405 Views
Hi everyone! 👋 I'm building a pipeline with PipelineController , and when I put Dataset.get , I got this message repeating itself a lot of time : clearml - ...
7 months ago
0 Votes
2 Answers
391 Views
0 Votes 2 Answers 391 Views
Hi everyone 👋 I'm crearting a pipeline from controller. In my last task I'm training a bunch of models. I would like to know if It's possible to report the ...
7 months ago
0 Votes
6 Answers
611 Views
0 Votes 6 Answers 611 Views
11 months ago
0 Votes
2 Answers
281 Views
0 Votes 2 Answers 281 Views
Hi everyone 👋 When I create a pipeline from tasks, The run time shown in the pipeline can be really different from the run time shown in the task. Is there ...
4 months ago
0 Votes
13 Answers
519 Views
0 Votes 13 Answers 519 Views
Hi all 👋 ! I got an issue with clearml-serving : I'm doing the sklearn tutorial from GitHub None . When I run the train_model.py on my machine, I get the pr...
10 months ago
0 Votes
5 Answers
527 Views
0 Votes 5 Answers 527 Views
Hi all 😁 ! I would like to add a tag to a pipeline built from tasks like in the GitHub example None , but directly in the python code and not in the UI. Doe...
11 months ago
0 Votes
8 Answers
283 Views
0 Votes 8 Answers 283 Views
Hi everyone 👋 I want to delete stuff from my clearml server, but the memory keeps getting used when I delete it from the server. How can I definitely delete...
4 months ago
0 Votes
5 Answers
517 Views
0 Votes 5 Answers 517 Views
Hi all 👋 ! I'm creating a pipeline from tasks with clearml-task (and with PipelineController). I execute the tasks remotely on an open-source server I set u...
11 months ago
0 Votes
2 Answers
422 Views
0 Votes 2 Answers 422 Views
Hi everyone 👋 I'm working on a pipeline with PipelineController . I was wondering if you can make an "optional" step with a condition : Imagine I create a p...
8 months ago
0 Hi Everyone!

Hi @<1523701205467926528:profile|AgitatedDove14> , sorry for the delay, I have a better understanding oh workers and agents now, thank you 😁

7 months ago
0 Hi Everyone!

Can we have one worker running for multiple agents ?

7 months ago
0 Hi All

Hi @<1523701205467926528:profile|AgitatedDove14> , I added pipeline._task.add_tags(tags) and it works, thank you very much 👍

11 months ago
0 Hi All

Hi @<1523701070390366208:profile|CostlyOstrich36> , I have version 1.9.2. When I use the command clearml-task like this one : clearml-task --project test_tag_git --name sklearn --repo http://***.git --script sklearn.py --requirements requirements.txt --branch test_tag --output-uri http://*** using the script from here : None . 'test_tag' is the name of my git tag. When executi...

10 months ago
0 Hi All

Hi @<1523701435869433856:profile|SmugDolphin23> ! I enqueued my task and I got an error sadly 😞 . I put the logs here

10 months ago
0 Hi All

Okay, thank you for your answer and your concern 👍

10 months ago
0 Hi Everyone

I'm trying to delete projects, datasets and pipeline from the web UI at my local server adress. For example if I want to delete a dataset, I put it in archive > delete the file only by clicking on the web UI (not with python).
When my team leader look at the disk space usage of the server (in docker), he can still access to this file with the dataset, even if I deleted it from the web UI.

4 months ago
0 Hi Everyone

Yeah I mean disk space usage (we have our own clearml server)

4 months ago
0 Hi Everyone

We got the server version : 1.12.1-397
We tried to delete a task "print hello world" from the web UI this morning, and we still find it on the disk space of our server

4 months ago
0 Hi All

yeah

10 months ago
0 Hi Everyone

Hi @<1523701435869433856:profile|SmugDolphin23> ! Thank you for your answer, I will try both your suggestions 😉

8 months ago
0 Hi

I just checked, and there was no filter (sadly)

7 months ago
0 Hi All

Hi @<1523701087100473344:profile|SuccessfulKoala55> , I see. With my team we are wondering what should be the best practice to train and make predictions with machine learning models: do we get models from artifacts to make predictions or is it a better approach to get models from "models" ? 🤔

11 months ago
0 Hi Everyone

Hi @<1523701087100473344:profile|SuccessfulKoala55> , Sorry for the delay, thank you for your answer 😉

4 months ago
0 Hi All ! I'M Trying To Setup My Agent, I Always Get The Same Error Even When I Run Remotely A Task Where I Only Print('Hello World'). I Wonder What I'M Missing

Hi @<1523701087100473344:profile|SuccessfulKoala55> , thank you for your answer, I will look into it 👍

11 months ago
0 Hi all :wave:! I got a problem regarding Grafana/Prometheus. When I deploy a model with clearml-serving and I add metrics like this: `clearml-serving --id *** metrics add --endpoint slm_POC --variable-scalar beds=0,1,5,10,50 bath=0,1,5,10,50 y=0,100000,50

Wow I didn't send my answer sorry about it.
Yeah you're right keeping old data is always a good way.
I'm new to Grafana so I get questions about it. Anyway thank you for your answer 👍

9 months ago
0 Hi all :wave:! I got a problem regarding Grafana/Prometheus. When I deploy a model with clearml-serving and I add metrics like this: `clearml-serving --id *** metrics add --endpoint slm_POC --variable-scalar beds=0,1,5,10,50 bath=0,1,5,10,50 y=0,100000,50

Hi @<1523701205467926528:profile|AgitatedDove14> , I understand what you mean.
In the case when I want to change my bucket values, it will not update them on Grafana and I will have to add a new endpoint. Is there a way to update the bucket values in Grafana, or deleting the variable/metric in Grafana ?

10 months ago
0 Hi All

Yes, that's right

10 months ago
0 Hi

Hi @<1523701070390366208:profile|CostlyOstrich36> , sure, here there are 😉
image
image

7 months ago
0 Hi

Hi @<1523701070390366208:profile|CostlyOstrich36> , sorry for the delay
I just found I could reveal the hidden projects in the setting, I think that was why I couldn't delete everything I wanted 😉

7 months ago
0 Hi All ! I'M Trying To Run My Tasks On Open-Source Clearml-Server. But Everytime I Try To Run A Task On It With Clearml-Agent, I Get The Same Error : Clearml_Agent: Error: 'Utf-8' Codec Can'T Decode Byte 0Xe9 In Position 26: Invalid Continuation Byte Even

Hi @<1523701070390366208:profile|CostlyOstrich36> @<1537605940121964544:profile|EnthusiasticShrimp49> , thank you for your interest, I was wondering if you had time to quickly check my issue

11 months ago
0 Hi All ! I'M Trying To Run My Tasks On Open-Source Clearml-Server. But Everytime I Try To Run A Task On It With Clearml-Agent, I Get The Same Error : Clearml_Agent: Error: 'Utf-8' Codec Can'T Decode Byte 0Xe9 In Position 26: Invalid Continuation Byte Even

Hey @<1537605940121964544:profile|EnthusiasticShrimp49> , yes I can download it and open it with pickle, here is how I do it :
pickle_data_url = ' None '
local_iris_pkl = StorageManager.get_local_copy(remote_url=pickle_data_url)
with open(local_iris_pkl, 'rb') as f:
iris = pickle.load(f)

I set up my agent from my machine but my open-source server is not running on my machine. I can share my agent conf...

11 months ago
0 Hi All

Hi @<1523701070390366208:profile|CostlyOstrich36> , you can reproduce it with the pipeline of the iris dataset from the github None
I have a gitlab repo, I run this command to run this pipeline :
clearml-task --project test-iris --name pipeline-iris --repo ***.git --script pipeline/pipeline_from tasks.py --queue services --requirements requirements.txt --task-type controller --branch main
My agent is setup as a docke...

11 months ago
0 Hi All

Hi @<1523701205467926528:profile|AgitatedDove14> , yes the pipeline is created via the clearml-task CLI. I find it less constraining to launch a pipeline via the CLI. I'm opening a GitHub issue right now, hoping it will be fixed soon. Thank you for your answer 😁

11 months ago
0 Hi All

Hi @<1523701070390366208:profile|CostlyOstrich36> , thank you for your answer, sadly it "only" adds tags to the steps of the pipeline, not the pipeline itself. And that's the last part I'm looking for.

11 months ago
0 Hi All

No problem, I tried with this code :

from sklearn.linear_model import LogisticRegression
from sklearn.datasets import make_blobs
from joblib import dump
from clearml import Task, OutputModel

task = Task.init(project_name="serving examples", task_name="train sklearn model", output_uri=True)

# generate 2d classification dataset
X, y = make_blobs(n_samples=100, centers=2, n_features=2, random_state=1)
# fit final model
model = LogisticRegression()
model.fit(X, y)

#dump(model, filename="...
10 months ago
0 Hi All

Oh okay, it could explain a lot of stuff. Thank you for your answer 👍 My server isn't on 0.0.0.0, so would I need to setup a new one to solve this problem, or is there an alternative ?
I checked the logs as you suggested, I didn't find any error of this type (maybe I didn't put an important parameter). My agent is setup as a docker. Here are the logs.

10 months ago
0 Hi All

With my team we found a solution: to execute tasks with agent, we use clearml-task in CLI. We add the argument --output-uri : ***:1234 where *** is the link to our self-hosted server. Then models in pickle are automatically exported to the server, and not the path of the agent

10 months ago
Show more results compactanswers