Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Does the ClearML team still post updates in this channel when new ClearML versions come out? If not, what's the easiest way to keep track of various release ...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
If, for starters, I'd only like to use ClearML for logging purposes (that is, experiments run locally, and I report metrics, graphs, etc to ClearML). Do I st...
3 years ago
0 Votes
0 Answers
939 Views
0 Votes 0 Answers 939 Views
Also ubuntu 18.04 is losing support so everything in the image needs an update…
one year ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I realize I'm asking many niche questions - my apologies πŸ™ˆ Is there a way to translate task.data.user (user ID) to the actual username? Use case is that I'd...
2 years ago
0 Votes
10 Answers
997 Views
0 Votes 10 Answers 997 Views
More clarification on documentation (ClearML Data): > Dataset changes are stored using differentiable storage, meaning a version will store the change-set fr...
2 years ago
0 Votes
8 Answers
994 Views
0 Votes 8 Answers 994 Views
Can I somehow change a project settings via the Python SDK?
one year ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
We're trying to upgrade our ClearML on K8s but we're getting this error - Error: UPGRADE FAILED: cannot patch "clearml-fileserver-data" with kind PersistentV...
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there any way in the WebUI to search by task name? I see the search bar only goes through projects
2 years ago
0 Votes
6 Answers
996 Views
0 Votes 6 Answers 996 Views
So the around app is also from ClearML? :shocked_face_with_exploding_head:
3 years ago
0 Votes
7 Answers
998 Views
0 Votes 7 Answers 998 Views
Good week ClearML team πŸ™‚ I have found two more WebUI bugs (on the self-hosted server): If I look at a specific experiment (say, the Artifacts tab), and then...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
I encountered a weird edge case with the AWS Auto-scaler, wondering if there are any solutions or if this is a known issue. Something as follows happened: Th...
2 years ago
0 Votes
28 Answers
1K Views
0 Votes 28 Answers 1K Views
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there a way to set precedence on package managers? If we set an agent to use poetry it will ignore local packages, even if I use the force_requirements_en...
2 years ago
0 Votes
6 Answers
992 Views
0 Votes 6 Answers 992 Views
Soooo… the tooltip for some buttons in the WebUI hides the actual buttons πŸ€” Any quick fixes?
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
What could cause a queue to be recreated automatically? I experimented with the autoscaler with queue name foo , got it working, closed the autoscaler, delet...
2 years ago
0 Votes
27 Answers
986 Views
0 Votes 27 Answers 986 Views
Is there an autoscaler equivalent for K8s? That is, a service that will launch pods based on incoming requests?
one year ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Does ClearML exposes (even temporarily) the contents of e.g. sdk.aws.s3 to the relevant environment variables (i.e. AWS_SECRET_ACCESS_KEY )? Specifically, if...
2 years ago
0 Votes
2 Answers
983 Views
0 Votes 2 Answers 983 Views
Can we use S3 buckets to cache environments?
2 years ago
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
We’re running clearml-agent on k8s and I first noticed some warnings from the pod about Python 3.6..? > /usr/lib/python3/dist-packages/secretstorage/dhcrypto...
one year ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
When uploading an artifact, can I list it in some grouping (like with parameters, having e.g. Args/foo , Args/bar )?
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
We’re randomly getting the following message - 2023-03-07 11:07:26,123 [WARNING] [urllib3.connectionpool]: Retrying (Retry(total=237, connect=237, read=240, ...
one year ago
0 Votes
7 Answers
978 Views
0 Votes 7 Answers 978 Views
Weird encounter on macOS (local execution, rerunning after it failed - worked normally): Traceback (most recent call last): File "/Users/.../repositories/......
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Is there any way (or are there any plans) to include some view for datasets in the WebUI? One that is detached from the generating task?
2 years ago
0 Votes
42 Answers
50K Views
0 Votes 42 Answers 50K Views
one year ago
0 Votes
5 Answers
958 Views
0 Votes 5 Answers 958 Views
Getting a weird error on local setup for ClearML Server: 2022-03-30 08:07:07,932 - clearml.Task - ERROR - Action failed <500/0: tasks.get_all/v1.0 (mongo:270...
2 years ago
0 Votes
2 Answers
977 Views
0 Votes 2 Answers 977 Views
Can one delete individual tasks from the WebUI?
3 years ago
0 Votes
13 Answers
720 Views
0 Votes 13 Answers 720 Views
Can steps be removed from pipelines, and/or can pipelines be generally modified other than adding steps to them?
11 months ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Since v1.4.0, our StorageManager.download_folder(..., local_folder='./') is failing - we've had to revert back to 1.3.2. I saw the changelist includes a fix ...
2 years ago
0 Votes
14 Answers
1K Views
0 Votes 14 Answers 1K Views
Automatic logging for generated matplotlib works nicely, but for some reason it names the graphs as "00 untitled" and uses series "plot image" in ClearML UI ...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
There seems to be an error if a project name has spaces (at least at the top-level name). I created a project called internal tests (with the space), and it ...
2 years ago
Show more results questions
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

Hurrah! Added
git config --system credential.helper 'store --file /root/.git-credentials' to the extra_vm_bash_script and now it works
(logs the given git credentials in the store file, which can then be used immediately for the recursive calls)

2 years ago
0 More Clarification On Documentation (Clearml Data):

Yes it would be πŸ™‚
Visualization is always a difficult topic... I'm not sure about that, but a callback would be nice.

One idea that comes to mind (this is of course limited to DataFrames), but think the git diff , where I imagine 3 independent section:
Removed columns (+ truncated preview of removed values) (see below) Added columns (+ truncated preview of removed values)
The middle column is then a bit complicated, but I would see some kind of "shared columns" dataframe, where each ...

2 years ago
0 Is There Any Way In The Webui To Search By Task Name? I See The Search Bar Only Goes Through Projects

SuccessfulKoala55 That at least did not work, unless one has to specify wildcard patterns perhaps..?

2 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

Same result 😞 This is frustrating, wtf happened :shocked_face_with_exploding_head:
This is also specifically the services queue worker I'm trying to debug πŸ€”

2 years ago
0 Trying To Run Aws Autoscaler With

That still seems to crash SuccessfulKoala55 πŸ€”
EDIT: No, wait, the environment still needs updating. One moment still...

one year ago
0 Does Clearml Somehow

Oh, well, no, but for us that would be one way solution (we didn't need to close the task before that update)

2 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

I'll have yet another look at both the latest agent RC and at the docker-compose, thanks!

There was no "default" services agent btw, just the queue, I had to launch an agent myself (not sure if it's relevant)

2 years ago
0 The Clearml Helm Charts Page Is Gone?

Any updates on this? We can't do anything with our K8s since this 404...

one year ago
0 Our Mac Users Are Having Some Issues. They Have Their Respective ~/Clearml.Conf, And Yet They Get: Clearml 1.1.5

I'll have a look at 1.1.6 then!
And that sounds great - environment variables should be supported everywhere in the config, or then the docs should probably mention where they are and are not supported πŸ™‚

I'll be happy to test it out if there's any commit available?

The thing I don't understand is how come this DOES work on our linux setups πŸ€”

2 years ago
0 Automatic Logging For Generated Matplotlib Works Nicely, But For Some Reason It Names The Graphs As "00 Untitled" And Uses Series "Plot Image" In Clearml Ui -- Any Way To Circumvent This, Other Than Explicit Reporting?

Yes -- that's what I meant by The title is specified in the plot . I make the plots manually - title, axes labels, ticks, etc. In that sense, the figure is entirely configured. ClearML just saves it as "untitled 00/plot image"

2 years ago
2 years ago
0 We Use Environment Variables In Our

Would it also be loaded on e.g. Task.running_locally() ?

2 years ago
0 Trying To Run Aws Autoscaler With

Or to be clear, the environment installed by the autoscaler under /clearml_agent_venv has poetry installed, and it uses that to set up the environment for the executed task, e.g. in root/.clearml/venvs-builds/3.10/task_repository/.../.venv , but the latter does not have poetry installed, and so it crashes?

one year ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

Thanks SuccessfulKoala55 , I made https://github.com/allegroai/clearml-agent/issues/126 as a suggestion.

Do you have any thoughts on how to expose these... manually?
It does so already for environment variables that prefixed with CLEARML_ , so it would be nice to have some control over that.

2 years ago
0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

I can only say I’ve found ClearML to be very helpful, even given the documentation issue.
I think they’ve been working on upgrading it for a while, hopefully something new comes out soon.
Maybe @<1523701205467926528:profile|AgitatedDove14> has further info πŸ™‚

one year ago
0 Is It Expected That K8S Helm Chart Also Starts A Clearml Worker?

Can I query where the worker is running (IP)?

2 years ago
0 When Using

Generally the StorageManager seems a bit slow, even a simple StorageManager.list(...) on a local path seems to take a long time

3 years ago
0 When Using

Bump?

3 years ago
0 When Using

The error seems to come from this line:
self._driver = _FileStorageDriver(str(path_driver_uri.root)) (line #353 in clearml/storage/helper.py
Where if the path_driver is a local path, then the _FileStorageDriver starts with a base_path = '/' , and then takes extremely long time at iterating over the entire file system (e.g. in _get_objects , line #1931 in helper.py )

3 years ago
0 When Using

Here's a full description of the layout:
Remote agent + entire ClearML docker suite running on host A. Host A also has a /data/clearml folder mounted to it and to it's docker containers (I've edited the docker-compose to add this mount point) Connect to host A, use StorageManager on the /data/clearml folder for some early troubles (e.g. long .list call) Use the same connection to run a task with execute_remotely and download_folder and see it crash :disapp...

3 years ago
0 When Using

Indeed with ~ the .root call ends with an empty string, so it has a bit of different flow

3 years ago
0 When Using

This also appears in the error log:

` StorageManager.download_folder(cache_dir.as_posix(), local_folder=".")
File "/home/idan/.clearml/venvs-builds/3.7/lib/python3.7/site-packages/clearml/storage/manager.py", line 278, in download_folder
for path in helper.list(prefix=remote_url):
File "/home/idan/.clearml/venvs-builds/3.7/lib/python3.7/site-packages/clearml/storage/helper.py", line 596, in list
res = self._driver.list_container_objects(self._container, ex_prefix=prefix)
Fi...

3 years ago
0 When Using

Btw TimelyPenguin76 this should also be a good starting point:
First create the target directory and add some files:sudo mkdir /data/clearml sudo chmod 777 -R /data/clearml touch /data/clearml/foo touch /data/clearml/bar touch /data/clearml/bazThen list the files using the StorageManager. It shouldn't take more than a few miliseconds.` from clearml import StorageManager

%%timeit
StorageManager.list("/data/clearml")

-> 21.2 s Β± 328 ms per loop (mean Β± std. dev. of 7 runs, 1 loop each) `

3 years ago
0 When Using

On my remote server..?

3 years ago
0 When Using

Added the following line under volumes for apiserver , fileserver , agent-services :
- /data/clearml:/data/clearml

3 years ago
0 When Using

It's also sufficient to see StorageManager.list("/data/clear") takes a really long time to return no results

3 years ago
Show more results compactanswers