Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
MelancholyElk85
Moderator
28 Questions, 174 Answers
  Active since 10 January 2023
  Last activity 2 months ago

Reputation

0

Badges 1

149 × Eureka!
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Is there any documentation for StorageHelper class?
2 years ago
0 Votes
1 Answers
973 Views
0 Votes 1 Answers 973 Views
What's the difference between http://allegro.ai/clearml/docs and http://clear.ml/docs ? Which one is the real documentation? I need to look up something very...
3 years ago
0 Votes
1 Answers
957 Views
0 Votes 1 Answers 957 Views
Hi! Is there a way to connect multiple S3 storages to ClearML? As far as I understand, I can only specify one set of S3 credentials in clearml.conf
one year ago
0 Votes
15 Answers
981 Views
0 Votes 15 Answers 981 Views
How to use task_overrides in PipelineController.add_step method to set latest commit in some branch?
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Is there a place in web UI to find all Models I created?
2 years ago
0 Votes
21 Answers
1K Views
0 Votes 21 Answers 1K Views
Hi, I'm trying to make use of new capabilities of DAG creation in ClearML. Seems that api has changed pretty much since a few versions back. There seems to b...
3 years ago
0 Votes
1 Answers
955 Views
0 Votes 1 Answers 955 Views
Can I manually delete .zip files with datasets in .clearml/cache/storage_manager/datasets directory? seems that the datasets are stored both in packed and un...
2 years ago
0 Votes
19 Answers
983 Views
0 Votes 19 Answers 983 Views
What is set_base_docker() equivalent for PipelineController ?
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Has anybody used albumentations with pytorch in remote execution on clearml? The task is freezing during DataLoader initialization every time I put any augme...
2 years ago
0 Votes
2 Answers
544 Views
0 Votes 2 Answers 544 Views
Hi! Our ClearML server keeps crashing because of some weird task with the = symbol in the ID. After restoring the database to the latest working state, it wo...
10 months ago
0 Votes
3 Answers
198 Views
0 Votes 3 Answers 198 Views
Hi everyone. I'm facing a problem when connecting to Azure storage. When the task tries to download a dataset, it fails with the message 2024-08-29 11:02:19,...
2 months ago
0 Votes
13 Answers
956 Views
0 Votes 13 Answers 956 Views
When I pass invalid key to task_overrides parameter in PipelineController.add_step method, it fails but with COMPLETED status
3 years ago
0 Votes
13 Answers
860 Views
0 Votes 13 Answers 860 Views
Hi! Is there a way to get_local_copy but to download only the latest diff in dataset genealogy (that is, the files listed by list_added_files ), omitting eve...
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
A suggestion to add task_name parameter to InputModel.__ init__ . As for now I can search by project name and model name, but what if I had 2 models within t...
2 years ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
Hi! Which method is used to delete OutputModel from the storage? https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel/
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hi, a question about dataset storage Suppose I create a dataset like this dataset = Dataset.create(dataset_name='my_name', dataset_project='my_project') What...
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Hi! Please, could anyone explain this sort of behaviour? First, we save a model checkpoint during training (both in .pth and .onnx format) output_model_pth =...
2 years ago
0 Votes
5 Answers
999 Views
0 Votes 5 Answers 999 Views
3 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there any canonical way to migrate all data between different clearml-server s? Some time ago we were using trains server with quite a few valuable experi...
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists.I have strong deja vu feeling. Cr...
2 years ago
0 Votes
4 Answers
995 Views
0 Votes 4 Answers 995 Views
Dear clearml practitioners, I'd like to share my experiment to another company, in order for them to clone and fine-tune it on their own clearml server. Is t...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi! I see the following in the docs https://clear.ml/docs/latest/docs/references/sdk/model_model/#modelquery_models But I get AttributeError: type object 'Mo...
2 years ago
0 Votes
23 Answers
971 Views
0 Votes 23 Answers 971 Views
Hi! For clearml.Dataset we can provide target storage (for example, in S3) with output_url parameter in the upload method. Is there any similar way to provid...
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Hi! How to add files locally to dataset and then upload to a custom s3 location? The location should be specified within python code, NOT clearml.conf . defa...
3 years ago
0 Votes
1 Answers
870 Views
0 Votes 1 Answers 870 Views
Hi everyone! How do I disable automatic reporting of matplotlib plots and images?
one year ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
3 years ago
0 Votes
27 Answers
474 Views
0 Votes 27 Answers 474 Views
I .
I add_step with clone_base_task=False . However, it still clones the task, wtf
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
2 years ago
0 Hi, Anyone Seen This Issue?

Yes, I'll try it straightaway

3 years ago
0 How To Use

You're right, I re-launched the agents, now it pulls images

3 years ago
0 Hi, Anyone Seen This Issue?

Solved. The problem was a trailing space before the image name in the Image section in web UI. I think you should probably strip the string before proceeding to environment building step, to avoid this annoying stuff to happen. Of course, users could check twice before launching, but this thing will come up every once in a while regardless

2 years ago
0 When I Pass Invalid Key To

if fails during add_step stage for the very first step, because task_overrides contains invalid keys

3 years ago
0 I .

so yeah, in short, target_project cannot do that

3 years ago
0 Hi, Anyone Seen This Issue?

AgitatedDove14 I run into this problem again. Are there any known issues about it? I don't remember what helped the last time

2 years ago
0 Hi Everyone. I'M Facing A Problem When Connecting To Azure Storage. When The Task Tries To Download A Dataset, It Fails With The Message

@<1523701070390366208:profile|CostlyOstrich36> on a remote agent, yes, running the task from the interface

2 months ago
0 Is There Any Documentation For

AgitatedDove14 Yes this would be great

2 years ago
0 Is There Any Documentation For

As for now it seems to query only by project name and model name.

2 years ago
0 Is There Any Documentation For

AgitatedDove14 by task you mean the training task or the separate task corresponding to the model itself? The former won't work since I don't want to delete the training task, only the models

2 years ago
0 Is There Any Documentation For

I just happened to spawn multiple OutputModels within a single script which is being run in a single task. That is, I see dozens of models in Models tab in web UI. What I want is to delete most of them (along with the files in S3), preserving the spawning task

2 years ago
0 Is There Any Documentation For

AND also add task_name parameter to Model.query_models

2 years ago
0 Is There Any Documentation For

AgitatedDove14 thank you. Maybe you know about OutputModel.remove method or something like that?

2 years ago
0 Is There Any Documentation For

so that the way of doing it would be like this:
all_models = Model.query_models(projeect_name=..., task_name=..., tags=['running-best-checkpoint']) all_models = sorted(all_models, key=lambda x: extract_epoch(x)) for model in all_models[:-num_to_preserve]: Model.remove(model, delete_weights_file=True)

2 years ago
0 Hi, I'M Trying To Make Use Of New Capabilities Of Dag Creation In Clearml. Seems That Api Has Changed Pretty Much Since A Few Versions Back. There Seems To Be No Need In

pipeline controller itself is stuck at running mode forever all step tasks are created but never enqueued
I can share some code

3 years ago
0 Hi! How To Add Files Locally To

AgitatedDove14 SuccessfulKoala55 maybe you know. How do I add files without uploading them anywhere?

3 years ago
0 Hi, A Question About Dataset Storage Suppose I Create A Dataset Like This

AgitatedDove14 yeah, makes sense, that would require some refactoring in our projects though...

But why is my_name a subproject? Why not just my_project/.datasets ?

one year ago
0 Hi! How To Add Files Locally To

there seems to be no way to change default_output_uri from the code.

Dataset.create calls Task.create which in turn accepts add_task_init_call flag. Task.init accepts output_uri , but we cannot add arguments with add_task_init_call , so we cannot change output_uri from Dataset.create , right?

3 years ago
0 What Is

AgitatedDove14
`
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.
clearml_agent: ERROR: Failed cloning repository.

  1. Make sure you pushed the requested commit:
    (repository='git@...', branch='main', commit_id='...', tag='', docker_cmd='registry.gitlab.com/...:...', en...
3 years ago
0 Hi! Which Method Is Used To Delete Outputmodel From The Storage?

if I just use plain boto3 to sync weights to/from S3, I just check how many files are stored in the location, and clear up the old ones

2 years ago
0 Hi! Is There A Way To

I still haven't figured out how to make files downloaded this way visible for future get_local_copy calls though

one year ago
0 Hi! For

specifying target storage for OutputModel from the config is bad idea: it should be project-specific, not agent-specific

2 years ago
0 Dear Clearml Practitioners, I'D Like To Share My Experiment To Another Company, In Order For Them To

@<1523701070390366208:profile|CostlyOstrich36> Yes, I'm self deployed, and the company I want to share it with is also self deployed

one year ago
0 Hi! Is There A Way To

@<1523701435869433856:profile|SmugDolphin23> about ignore_parent_datasets ? I renamed it the same day you added that comment. Please let me know if there is anything else I need to pay attention to

one year ago
Show more results compactanswers