Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
There seems to be an error if a project name has spaces (at least at the top-level name). I created a project called internal tests (with the space), and it ...
3 years ago
0 Votes
23 Answers
2K Views
0 Votes 23 Answers 2K Views
When using StorageManager.download_folder , I get the following error: Traceback (most recent call last): File "/home/idan/.clearml/venvs-builds/3.7/lib/pyth...
4 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Is it expected that K8s helm chart also starts a ClearML worker?
3 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Back to autoscaler; is there any way to ensure the environment variables on the services queue (where the scaler runs) will be automatically exposed to new E...
3 years ago
0 Votes
19 Answers
2K Views
0 Votes 19 Answers 2K Views
For remote execution where the queue has poetry as the default package manager, can the user decide to e.g. ignore the lock file?
2 years ago
0 Votes
29 Answers
2K Views
0 Votes 29 Answers 2K Views
We're trying to use the AWS autoscaler and have managed to get it up and running with spinning up instances. However, it does not seem to pull any of the tas...
3 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
If I create a dataset with Dataset.create(..., use_current_task=True) , that task holds the dataset. Can I then refer/copy/attach the same dataset to other t...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
We're running into errors such as this: Action failed <500/0: tasks.add_or_update_artifacts/v2.10 (Update failed (BSONObj size: 18564134 (0x11B4426) is inval...
3 years ago
0 Votes
23 Answers
2K Views
0 Votes 23 Answers 2K Views
We're using Ray and ClearML together, and suddenly we're seeing some hanging threads, and finally we got an error message: 2022-01-10 09:58:56,803 [ERROR] [C...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
How does ClearML store some of the more intrinsic data (scalars, plots, etc)? We recently recovered Mongo from a backup and while the projects and tasks are ...
2 years ago
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Trying to run AWS autoscaler with poetry queue, and I get: Traceback (most recent call last): File "/root/.local/bin/poetry", line 5, in from poetry.console....
2 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
When uploading an artifact, can I list it in some grouping (like with parameters, having e.g. Args/foo , Args/bar )?
3 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
We’re randomly getting the following message - 2023-03-07 11:07:26,123 [WARNING] [urllib3.connectionpool]: Retrying (Retry(total=237, connect=237, read=240, ...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
I'd like the CONSOLE in a ClearML run to show only the stdout/stderr as it does now, but I'd also like ClearML to capture DEBUG level logs. Is there an easy ...
3 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
We’re running clearml-agent on k8s and I first noticed some warnings from the pod about Python 3.6..? > /usr/lib/python3/dist-packages/secretstorage/dhcrypto...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
2 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Is there a way to set precedence on package managers? If we set an agent to use poetry it will ignore local packages, even if I use the force_requirements_en...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
I'm trying to set up some initial experiments within our stack, but when I use the execute_remotely task, I get this error: clearml_agent: ERROR: Failed gett...
4 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Is there a way to force ClearML to first parse the config file, before running Task.init ? We’re relying in some code that the credentials in clearml.conf ar...
2 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Does ClearML have any suggestions on GPU and non-GPU AMIs for the AutoScaler? The two default ones in the documentation are either: Non-existent (too old) - ...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Sometimes, on shorter tasks, my Task would hang for the 5 minute timeout with e.g. 2022-01-04 08:45:25,181 - clearml.Task - INFO - Waiting for repository det...
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
I think something is messed up in my remote agents environment, could someone lend a hand? I'm getting this during remote execution (poetry queue): Summary -...
2 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Is it possible to avoid the clearml-agent for local installations, and have the file server automatically use an S3 bucket? I've found https://clearml.slack....
3 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Side note for documentation, Task.project reads > Returns the current Task’s project name. But it actually returns the project ID
2 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
We have configured the AWS credentials in the remote worker's clearml.conf , but they are not available to third parties that use e.g. AWS_ACCESS_KEY . Is th...
2 years ago
0 Votes
14 Answers
2K Views
0 Votes 14 Answers 2K Views
Automatic logging for generated matplotlib works nicely, but for some reason it names the graphs as "00 untitled" and uses series "plot image" in ClearML UI ...
3 years ago
Show more results questions
0 Hey! Probably Missed Something, But I Recently Upgraded To 1.1.1, And I'Ve Just Noticed That Png Artifacts Are Not Displayed In The Preview. Is This Intentional? Edit: Ah, It Has To Be A

Not really - it will just show the string. A preview would be more like a low-res version of the uploaded image or similar.

4 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

So some UI that shows the contents of users.get_all ?

3 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

The idea is that the features would be copied/accessed by the server, so we can transition slowly and not use the available storage manager for data monitoring

4 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

On it! Should I include the additional user filters described above?

3 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Don't even need to specify json=... 😉 Thanks!

3 years ago
0 The Comparison Page Seems To Resize The Experiments So That All Tags Will Fit In The Screen, But Then The Experiments Are Pretty Much Impossible To Compare

I can scroll sideways but if I open any of the comparison items, I pretty much can only see one experiment's values

3 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

A follow up question (instead of opening a new thread), is there a way I could signal some files/directories to be copied to the execute_remotely task?

4 years ago
0 Can I Somehow Change A Project Settings Via The Python Sdk?

Where do I import this APIClient from AgitatedDove14 ? I meanwhile edited it directly in mongo, but editing a db directly on a Friday is a big nono

2 years ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

The logs are on the bucket, yes.
The default file server is also set to s3://ip:9000/clearml

3 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

It's of course not an MLOps issue so I understand it's not high on the priority list, but would be kinda cool to just have a simple view presenting the content of users.get_all 😄

3 years ago
0 Hi, I'M Trying To Access/Use Experiment'S Model+Data+Params My Model And Data Are Stored In S3 And I'M Not Sure What Is The Practice Of Getting Them Reddy To Use. When I Use

IIRC, get_local_copy() downloads a local copy and returns the path to the downloaded file. So you might be interested in e.g.
local_csv = pd.read_csv(a_task.artifacts['train_data'].get_local_copy())
With the models, you're looking for get_weights() . It acts the same as get_local_copy() , so it returns a path.

EDIT: I think also get_local_copy() for a model should work 👍

3 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Sorry, not necessarily RBAC (although that is tempting 😉 ), but for now was just wondering if an average joe user has access to see the list of "registered users"?

3 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

I guess following the example https://github.com/allegroai/clearml/blob/master/examples/advanced/execute_remotely_example.py , it's not clear to me how the server has access to the data loaders location when it hits execute_remotely

4 years ago
0 Hi All, I Try To Pass Secrets From My Local Machine To A Remote Agent. I'M Using The

No it doesn't, the agent has its own clearml.conf file.

I'm not too familiar with clearml on docker, but I do remember there are config options to pass some environment variables to docker.
You can then set your environment variables in any way you'd like before the container starts

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

So no direct page to see e.g. how many people have registered and/or if someone accidentally made two (or more) accounts, or somewhere to just delete users, etc

3 years ago
0 We Use Environment Variables In Our

SuccessfulKoala55 CostlyOstrich36 actually it is the import statement, just finally got around to the traceback:

` File "/home/.../ccmlp/configs/mlops.py", line 4, in <module>
from clearml import Task
File "/home/.../.venv/lib/python3.8/site-packages/clearml/init.py", line 4, in <module>
from .task import Task
File "/home/.../.venv/lib/python3.8/site-packages/clearml/task.py", line 31, in <module>
from .backend_interface.metrics import Metrics
File "/home/......

3 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

If I set the following:
"extra_clearml_conf": "sdk.aws.s3.credentials = [\n{\nhost: 'ip:9000'\nkey: 'xxx'\nsecret: 'xxx'\nmultipart: false\nsecure: false\n},\n{\nhost: 'ip2:9000'\nkey: 'xxx'\nsecret: 'xxx'\nmultipart: false\nsecure: false\n}\n]"I run into a weird furl error:
ValueError: Invalid port '9000''.

3 years ago
0 Getting A Weird Error On Local Setup For Clearml Server:

Yup! Seems to have been some brief unavailability for some reason

3 years ago
0 We Use Environment Variables In Our

I see, okay that already clarifies some stuff, I'll dig a bit more into this then! Thanks!

3 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some
  1. I guess? 🤔 I mean the same filter option one has for e.g. tags in the table view. In the "all experiments" project I think it would make sense for one to be able to select the projects of interest, or even filter for textual matches.

  2. Sorry I meant the cards indeed :)

3 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Also (sorry for all of these!) - could be nice to have a direct "task comparison" link in the UI somewhere, that would open a comparison with no tasks and the user can add them manually using the "add experiments" button. :)

3 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

So basically what I'm looking for and what I have now is something like the following:
(Local) I have a well-defined aws_autoscaler.yaml that is used to run the AWS autoscaler. That same autoscaler is also run with CLEARML_CONFIG_FILE=.... (Remotely) The autoscaler launches, listens to the predefined queue, and is able to launch instances as needed. I would run a remote execution task object that's appended to the autoscaler queue. The autoscaler picks it up, launches a new instanc...

3 years ago
0 Back To This

Thanks for investigating this SweetBadger76 !

3 years ago
Show more results compactanswers