Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Is it expected that K8s helm chart also starts a ClearML worker?
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
What would be the best way to approach this flow? We have a configuration file that defines e.g. the project name to use in ClearML, alongside other experime...
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Since v1.4.0, our StorageManager.download_folder(..., local_folder='./') is failing - we've had to revert back to 1.3.2. I saw the changelist includes a fix ...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is it possible to avoid the clearml-agent for local installations, and have the file server automatically use an S3 bucket? I've found https://clearml.slack....
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there anywhere in the web UI where one can see the clearml server version running? I keep getting "version 1.1.1 is now available" even though I'm pretty ...
3 years ago
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
Can one compare experiments/tasks from different projects? EDIT: I mean, I can manually navigate to some /compare-experiments end point and then find the tas...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Does anyone know how we can restore ClearML on Helms chart from existing Snapshots (AWS)?
one year ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
If I clone a task, I suppose all artifacts are not cloned with it, even if they are registered, right?
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
The ClearML helm charts page is gone? https://allegroai.github.io/clearml-helm-charts/
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Hey! Probably missed something, but I recently upgraded to 1.1.1, and I've just noticed that png artifacts are not displayed in the preview. Is this intentio...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Does ClearML exposes (even temporarily) the contents of e.g. sdk.aws.s3 to the relevant environment variables (i.e. AWS_SECRET_ACCESS_KEY )? Specifically, if...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
I'd like the CONSOLE in a ClearML run to show only the stdout/stderr as it does now, but I'd also like ClearML to capture DEBUG level logs. Is there an easy ...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
What privileges/IAM role would the AWS autoscaler need?
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Our Mac users are having some issues. They have their respective ~/clearml.conf, and yet they get: ClearML 1.1.5 Traceback (most recent call last): ... File ...
2 years ago
0 Votes
7 Answers
948 Views
0 Votes 7 Answers 948 Views
Is there a way to generate usage stats and reports for queues? For example, how often is a queue used, how much CPU does the queue consume when it's used, et...
2 years ago
0 Votes
0 Answers
993 Views
0 Votes 0 Answers 993 Views
I have a project filled with failed attempts at onboarding to clearml by now 😅
3 years ago
0 Votes
27 Answers
985 Views
0 Votes 27 Answers 985 Views
Is there an autoscaler equivalent for K8s? That is, a service that will launch pods based on incoming requests?
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
What could cause a queue to be recreated automatically? I experimented with the autoscaler with queue name foo , got it working, closed the autoscaler, delet...
2 years ago
0 Votes
26 Answers
1K Views
0 Votes 26 Answers 1K Views
I have some code that launches ML tasks and it accepts a YAML file, .env file and various CSVs. What would be the best way to upload these to a clearml task ...
3 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Back to autoscaler; is there any way to ensure the environment variables on the services queue (where the scaler runs) will be automatically exposed to new E...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
If, for starters, I'd only like to use ClearML for logging purposes (that is, experiments run locally, and I report metrics, graphs, etc to ClearML). Do I st...
2 years ago
0 Votes
0 Answers
939 Views
0 Votes 0 Answers 939 Views
Also ubuntu 18.04 is losing support so everything in the image needs an update…
one year ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I realize I'm asking many niche questions - my apologies 🙈 Is there a way to translate task.data.user (user ID) to the actual username? Use case is that I'd...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Side note for documentation, Task.project reads > Returns the current Task’s project name. But it actually returns the project ID
one year ago
0 Votes
10 Answers
997 Views
0 Votes 10 Answers 997 Views
More clarification on documentation (ClearML Data): > Dataset changes are stored using differentiable storage, meaning a version will store the change-set fr...
2 years ago
0 Votes
13 Answers
719 Views
0 Votes 13 Answers 719 Views
Can steps be removed from pipelines, and/or can pipelines be generally modified other than adding steps to them?
10 months ago
0 Votes
8 Answers
994 Views
0 Votes 8 Answers 994 Views
Can I somehow change a project settings via the Python SDK?
one year ago
Show more results questions
0 I Have Some Code That Launches Ml Tasks And It Accepts A Yaml File,

Each user creates a .env file for their needs or exports them in the shell running the python code. Currently I copy the environment variables to an S3 bucket and download it from there.

3 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

One way to circumvent this btw would be to also add/use the --python flag for virtualenv

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

This seems to be fine for now, if any future lookups finds this thread, btw
with mock.patch('clearml.datasets.dataset.Dataset.create'): ...

2 years ago
0 Since V1.4.0, Our

You mean the host is considered the bucket, as I wrote in my earlier message as the root cause?

2 years ago
0 Since V1.4.0, Our

Still the same issue it seems (or maybe the behaviour is the new behaviour?)

2 years ago
2 years ago
0 Since V1.4.0, Our

Adding bucket = clearml in aws.s3.credentials did not help either

2 years ago
0 Since V1.4.0, Our

Okay so the new functionality is maintained; thanks!

2 years ago
0 Since V1.4.0, Our

Thanks David! I appreciate that, it would be very nice to have a consistent pattern in this!

2 years ago
0 Since V1.4.0, Our

I have no tried to download the entire file, but yes

2 years ago
0 Since V1.4.0, Our

One more thing that may be helpful SweetBadger76 , I've gone ahead and looked into clearml.storage.helper , and found that at least if I specify the bucket name directly in the aws.s3.credentials configuration for MinIO, then:
In [4]: StorageHelper._s3_configurations.get_config_by_uri(' ` ')
Out[4]: S3BucketConfig(bucket='clearml', host='some_ip:9000', key='xxx', secret='xxx', token='', multipart=False, acl='', secure=False, region='', verify=True, use_credentials_chain=False)...

2 years ago
0 Since V1.4.0, Our

Could also be that the use of ./ is the issue? I'm not sure what else I can provide you with, SweetBadger76

2 years ago
0 Since V1.4.0, Our

The bucket is not a folder, it's just a container. Whether it's implemented as a folder in MinIO should be transparent, shouldn't it?

Since the "fix" in 1.4.0 onwards, we now have to download the folder, and then move all the downloaded files/folders to the correct level.
This now entails we also have to check which storage is used, so we can check if the downloaded folder will contain the bucket name or not, which seems very inconsistent?

2 years ago
0 Since V1.4.0, Our

It could be related to ClearML agent or server then. We temporarily upload a given .env file to internal S3 bucket (cache), then switch to remote execution. When the remote execution starts, it first looks for this .env file, downloads it using StorageManager, uses dotenv, and then continues the execution normally

2 years ago
0 Since V1.4.0, Our

SweetBadger76 TimelyPenguin76
We're finally tackling this (since it has kept us back at 1.3.2 even though 1.6.2 is out...), and noticed that now the bucket name is also part of the folder?

So following up from David's latest example:
StorageManager.download_folder(remote_url='s3://****-bucket/david/', local_folder='./')Actually creates a new folder ./****-bucket/david/ and puts it contents there.

EDIT: This is with us using internal MinIO, so I believe ClearML parses that end...

2 years ago
0 Since V1.4.0, Our

StorageManager.download_folder(remote_url=' s3://some_ip:9000/clearml/my_folder_of_interest ', local_folder='./') yields a new folder structure, ./clearml/my_folder_of_interest , rather than just ./my_folder_of_interest

2 years ago
0 Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.

one year ago
0 Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Not sure if ClearML has any built in support, but we used the above for a similar issue but with Prefect2 :)

one year ago
2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

I would expect the service to actually implicitly inject it to new instances prior to applying the user's extra configuration 🤔

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Either, honestly, would be great. I meant even just a link to a blank comparison and one can then add the experiments from that view

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Hey AgitatedDove14 🙂
Finally managed; you keep saying "all projects" but you meant the "All Experiments" project instead. That's a good start 👍 Thanks!

Couple of thoughts from this experience:
Could we add a comparison feature directly from the search results (Dashboard view -> search -> highlight some experiments for comparison)? Could we add a filter on the project name in the "All Experiments" project? Could we add the project for each of the search results? (see above pictur...

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some
  1. I guess? 🤔 I mean the same filter option one has for e.g. tags in the table view. In the "all experiments" project I think it would make sense for one to be able to select the projects of interest, or even filter for textual matches.

  2. Sorry I meant the cards indeed :)

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Managed now 🙂 Thank you for your patience!
I edited the previous post with some suggestions/thoughts

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Unfortunately I can't take a photo of not being able to compare tasks by navigating around the WebUI...

Does that clarify the issue CostlyOstrich36 ?

2 years ago
Show more results compactanswers