Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Since V1.4.0, Our

Adding bucket = clearml in aws.s3.credentials did not help either

2 years ago
0 Since V1.4.0, Our

Okay so the new functionality is maintained; thanks!

2 years ago
0 Since V1.4.0, Our

Thanks David! I appreciate that, it would be very nice to have a consistent pattern in this!

2 years ago
0 Since V1.4.0, Our

I have no tried to download the entire file, but yes

2 years ago
0 Since V1.4.0, Our

One more thing that may be helpful SweetBadger76 , I've gone ahead and looked into clearml.storage.helper , and found that at least if I specify the bucket name directly in the aws.s3.credentials configuration for MinIO, then:
In [4]: StorageHelper._s3_configurations.get_config_by_uri(' ` ')
Out[4]: S3BucketConfig(bucket='clearml', host='some_ip:9000', key='xxx', secret='xxx', token='', multipart=False, acl='', secure=False, region='', verify=True, use_credentials_chain=False)...

2 years ago
0 Since V1.4.0, Our

Could also be that the use of ./ is the issue? I'm not sure what else I can provide you with, SweetBadger76

2 years ago
0 Since V1.4.0, Our

The bucket is not a folder, it's just a container. Whether it's implemented as a folder in MinIO should be transparent, shouldn't it?

Since the "fix" in 1.4.0 onwards, we now have to download the folder, and then move all the downloaded files/folders to the correct level.
This now entails we also have to check which storage is used, so we can check if the downloaded folder will contain the bucket name or not, which seems very inconsistent?

2 years ago
0 Since V1.4.0, Our

It could be related to ClearML agent or server then. We temporarily upload a given .env file to internal S3 bucket (cache), then switch to remote execution. When the remote execution starts, it first looks for this .env file, downloads it using StorageManager, uses dotenv, and then continues the execution normally

2 years ago
0 Since V1.4.0, Our

SweetBadger76 TimelyPenguin76
We're finally tackling this (since it has kept us back at 1.3.2 even though 1.6.2 is out...), and noticed that now the bucket name is also part of the folder?

So following up from David's latest example:
StorageManager.download_folder(remote_url='s3://****-bucket/david/', local_folder='./')Actually creates a new folder ./****-bucket/david/ and puts it contents there.

EDIT: This is with us using internal MinIO, so I believe ClearML parses that end...

2 years ago
0 Since V1.4.0, Our

StorageManager.download_folder(remote_url=' s3://some_ip:9000/clearml/my_folder_of_interest ', local_folder='./') yields a new folder structure, ./clearml/my_folder_of_interest , rather than just ./my_folder_of_interest

2 years ago
0 Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.

one year ago
0 Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Not sure if ClearML has any built in support, but we used the above for a similar issue but with Prefect2 :)

one year ago
2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

I would expect the service to actually implicitly inject it to new instances prior to applying the user's extra configuration πŸ€”

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Either, honestly, would be great. I meant even just a link to a blank comparison and one can then add the experiments from that view

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Hey AgitatedDove14 πŸ™‚
Finally managed; you keep saying "all projects" but you meant the "All Experiments" project instead. That's a good start πŸ‘ Thanks!

Couple of thoughts from this experience:
Could we add a comparison feature directly from the search results (Dashboard view -> search -> highlight some experiments for comparison)? Could we add a filter on the project name in the "All Experiments" project? Could we add the project for each of the search results? (see above pictur...

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some
  1. I guess? πŸ€” I mean the same filter option one has for e.g. tags in the table view. In the "all experiments" project I think it would make sense for one to be able to select the projects of interest, or even filter for textual matches.

  2. Sorry I meant the cards indeed :)

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Managed now πŸ™‚ Thank you for your patience!
I edited the previous post with some suggestions/thoughts

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Unfortunately I can't take a photo of not being able to compare tasks by navigating around the WebUI...

Does that clarify the issue CostlyOstrich36 ?

2 years ago
2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Also (sorry for all of these!) - could be nice to have a direct "task comparison" link in the UI somewhere, that would open a comparison with no tasks and the user can add them manually using the "add experiments" button. :)

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

For example, can't interact with these two tasks from this view (got here from searching in the dashboard view; they're in different projects):

2 years ago
0 Hi All, I Try To Pass Secrets From My Local Machine To A Remote Agent. I'M Using The

For the former (static-ish environment variables), just add:

environment {
  VAR1: value1
  VAR2: value2
}

to the agent’s clearml.conf

one year ago
0 We'Re Trying To Upgrade Our Clearml On K8S But We'Re Getting This Error -

For now this is okay - no data lost, really - but I'd like to make sure we're not missing any steps in the next upgrade

2 years ago
Show more results compactanswers