Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
GiganticMole91
Moderator
19 Questions, 51 Answers
  Active since 10 January 2023
  Last activity 5 months ago

Reputation

0

Badges 1

50 × Eureka!
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
Hi guys, I'm trying to familiarize myself with Hyperparameter Optimization using ClearML. It seems like there is a discrepancy between clearml-param-search C...
3 years ago
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
3 years ago
0 Votes
8 Answers
946 Views
0 Votes 8 Answers 946 Views
Rolling back to 1.15.0 seemed to fix the error for now. Is there something one should be aware of between server versions 1.15 and 1.16 related to versions o...
one year ago
0 Votes
0 Answers
627 Views
0 Votes 0 Answers 627 Views
It seems to be related to elastisearch clearml-elastic | "stacktrace": ["org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed", I...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Hi I just updated our server to the latest version, but it seems to have broken all our running experiments. Scalars is totally down, I just get this error w...
one year ago
0 Votes
1 Answers
812 Views
0 Votes 1 Answers 812 Views
Hi, is there anyone in the ClearML team that would like to review my PR on clearml-agent? I’m worried that it might have slipped under the radar. It adds sup...
10 months ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
2 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
11 months ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hey, We're seeing a lot of issues with our ClearML self-hosted server these days; it seems like the API times out while talking to elasticsearch: 2022-10-22 ...
2 years ago
0 Votes
2 Answers
670 Views
0 Votes 2 Answers 670 Views
6 months ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hi, I'm using Task.register_abort_callback to store the latest model checkpoint, but the ergonomics of the callback feel weird to me. I have to do these work...
one year ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
3 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
one year ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
Hi all, Is there a way to force an agent to use https although the scheduled task is using ssh for git?
one year ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Hi guys, Is there a way, analogous to using Task.set_credentials(...) , to set credentials for storage programmatically? Like, Task.setup_storage(...) ? I'm ...
3 years ago
0 Votes
3 Answers
561 Views
0 Votes 3 Answers 561 Views
Hi all, I would like to use clearml-serving to serve model binaries (for use in on-device deployment). Can clearml-serving be used to serve that?
5 months ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
I have an issue with how clearml logs checkpoints. We have a training setup with pytorch-lightning + clearml, where we use lightning.pytorch.ModelCheckpoint ...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi guys. I'm struggling to get the Cleanup Service working on our on-prem setup. We are using the built in service ( None ) but see loads of errors like: Cou...
one year ago
0 Rolling Back To 1.15.0 Seemed To Fix The Error For Now. Is There Something One Should Be Aware Of Between Server Versions 1.15 And 1.16 Related To Versions Of The
diff --git a/docker-compose.yml b/docker-compose.diff.yml
index c6b49e1..07f7f43 100644
--- a/docker-compose.yml
+++ b/docker-compose.diff.yml
@@ -5,7 +5,7 @@ services:
     command:
     - apiserver
     container_name: clearml-apiserver
-    image: allegroai/clearml:1.15.0
+    image: allegroai/clearml:latest
     restart: unless-stopped
     volumes:
     - /opt/clearml/logs:/var/log/clearml
@@ -19,17 +19,18 @@ services:
     environment:
       CLEARML_ELASTIC_SERVICE_HOST: elastics...
one year ago
0 Hi Guys, I'M In The Process Of Setting Up A Clearml Server For Experiment Tracking. I Have The Server Hosted In A Virtual Linux Machine On Azure And Run Experiments From Some Local Compute. Our Training Environment Is Pytorch Lightning And I Have Written

Do you mean to the Web UI?

Yes that's what I meant, sorry I'm still coming to terms with ClearML terminology πŸ˜… . Is it possible to store the web app cloud access token serverside so we don't have to input it in the Web UI? πŸ™‚

3 years ago
0 I Have An Issue With How Clearml Logs Checkpoints. We Have A Training Setup With Pytorch-Lightning + Clearml, Where We Use

Thanks for responding @<1523701087100473344:profile|SuccessfulKoala55> . Good question! One solution could be to create a new open-source project with lightning + clearml integrations and link it to the Lightning ecosystem-ci ; I believe most people use the basic tensorboard-logger with ClearML, but the extended usecase of a ClearML model checkpoint callback might make it valuable.

I guess one would have to disable auto-logging of p...

one year ago
0 Hi, I Have Some Questions About Hyperparameter Optimization. We Have A Setup Where We Use Pytorchlightning Cli With Clearml For Experiment Tracking And Hyperparameter Optimization. Now, All Our Configurations Are Config-File Based. Sometime We Have Linke

I don't have issues with setting the hyperparameters - I just would like to link changes to one hyperparameter (eg. encoder.layers ) to another parameter (e.g. http://decoder.in _layers ) when optimizing over encoder.layer

3 years ago
0 Hi All, Is There A Way To Force An Agent To Use Https Although The Scheduled Task Is Using Ssh For Git?

Hi Martin,
It doesn't seem to work with dev.azure though:

Using user/pass credentials - replacing ssh url 'git@ssh.dev.azure.com:v3/ORG/TEAM/PROJECT' with https url '
'
fatal: repository '
' not found

The expected format for the https protocol is None .
Thoughts @<1523701205467926528:profile|AgitatedDove14> ?

one year ago
0 Hi Guys, Is There A Way, Analogous To Using

Perfect! Thanks SuccessfulKoala55 , that would be an acceptable workaround until setup_upload also supports Azure πŸ™‚ πŸ™Œ

3 years ago
0 Hi There, Our. Self-Hosted Server Is Periodically Very Slow To React In The Web Ui. We'Ve Been Debugging For Quite Some Time, And It Would Seem That Elastisearch Might Be The Culprit. Looking At The Elastisearch Index, We Have An Index Of Around 80G Of Tr

Any tips on how to check if we are storing data on deleted tasks? Maybe @<1722061389024989184:profile|ResponsiveKoala38> knows? Is there a field on each scalar that I can cross check with ClearML?

11 months ago
0 Hi All, I Would Like To Use Clearml-Serving To Serve Model Binaries (For Use In On-Device Deployment). Can Clearml-Serving Be Used To Serve That?

@<1523701070390366208:profile|CostlyOstrich36> any thoughts? Are the model files themselves easier to serve?

5 months ago
0 Hi Guys, I'M In The Process Of Setting Up A Clearml Server For Experiment Tracking. I Have The Server Hosted In A Virtual Linux Machine On Azure And Run Experiments From Some Local Compute. Our Training Environment Is Pytorch Lightning And I Have Written

How does it look in the Web UI?

I just had a look, and they are visible under debug samples, but not under plots, as I had expected.
I thought that by using report_matplotlib_figure it would get grouped under plots? πŸ™‚

3 years ago
0 Hi Guys, I'M Trying To Familiarize Myself With Hyperparameter Optimization Using Clearml. It Seems Like There Is A Discrepancy Between

Hi CostlyOstrich36
I have created a base task on which I'm optimizing hyperparameters. With clearml-param-search I could use --params-override to set a static parameter, which should not be optimized, e.g. changing the number of epochs for all experiments. It seems to me that this capability is not present in HyperParameterOptimizer . Does that make sense?

From the example on https://clear.ml/docs/latest/docs/apps/clearml_param_search/ :
` clearml-param-search {...} --p...

3 years ago
0 Hi, I'M Using

Hi @<1523701070390366208:profile|CostlyOstrich36> , the task is being aborted via the web UI - I have another method that catches local interrupts (exceptions like keyboard interrupts and crashes). The case is equal for running tasks via agents or just local cli

one year ago
0 Hi Guys. I'M Struggling To Get The Cleanup Service Working On Our On-Prem Setup. We Are Using The Built In Service (

Hi @<1523701087100473344:profile|SuccessfulKoala55> , thanks for responding. I've found out that my first error came from cloning a super old version of the clean up task in the web UI πŸ˜„
I don't know about the other error, to me it looks like the task gets deleted before handling errors, but since an error occurred (some 404 stuff, maybe the files actually aren't there) when deleting some artifacts on the task, clearml tries to reload the task and fails, with the 400/201 or 400/101. ...

one year ago
0 Hi, I'M Using

I just tried and the result is the same. The other method only triggers on exceptions

one year ago
0 Hi Guys, I'M Setting Up A Bunch Of Machines As Clearml Agents And Have Run Into An Issue With Caching. We Are Using Poetry For Python Dependency Management, So The Agents Are Configured To Use That Too, But They Are Not Caching The Venvs Between Tasks. Th

Specifically, this is what I get in the console log when the agent spins up a task:

Poetry Enabled: Ignoring requested python packages, using repository poetry lock file!
Creating virtualenv latent-features in /data/clearml/venvs-builds/3.9/task_repository/our-repo/.venv
Installing dependencies from lock file
2 years ago
0 Hey, We'Re Seeing A Lot Of Issues With Our Clearml Self-Hosted Server These Days; It Seems Like The Api Times Out While Talking To Elasticsearch:

CostlyOstrich36 any thought on how we can further debug this? It's making ClearML practically useless for us

2 years ago
Show more results compactanswers