Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
MelancholyElk85
Moderator
28 Questions, 174 Answers
  Active since 10 January 2023
  Last activity 8 months ago

Reputation

0

Badges 1

149 × Eureka!
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Is there a place in web UI to find all Models I created?
3 years ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
Hi! For clearml.Dataset we can provide target storage (for example, in S3) with output_url parameter in the upload method. Is there any similar way to provid...
3 years ago
0 Votes
21 Answers
1K Views
0 Votes 21 Answers 1K Views
Hi, I'm trying to make use of new capabilities of DAG creation in ClearML. Seems that api has changed pretty much since a few versions back. There seems to b...
3 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Can I manually delete .zip files with datasets in .clearml/cache/storage_manager/datasets directory? seems that the datasets are stored both in packed and un...
3 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Is there any documentation for StorageHelper class?
3 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
When I pass invalid key to task_overrides parameter in PipelineController.add_step method, it fails but with COMPLETED status
3 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
A suggestion to add task_name parameter to InputModel.__ init__ . As for now I can search by project name and model name, but what if I had 2 models within t...
3 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
How to use task_overrides in PipelineController.add_step method to set latest commit in some branch?
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Has anybody used albumentations with pytorch in remote execution on clearml? The task is freezing during DataLoader initialization every time I put any augme...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi! I see the following in the docs https://clear.ml/docs/latest/docs/references/sdk/model_model/#modelquery_models But I get AttributeError: type object 'Mo...
3 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Hi! Is there a way to get_local_copy but to download only the latest diff in dataset genealogy (that is, the files listed by list_added_files ), omitting eve...
one year ago
0 Votes
19 Answers
2K Views
0 Votes 19 Answers 2K Views
Hi! Which method is used to delete OutputModel from the storage? https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel/
3 years ago
0 Votes
2 Answers
863 Views
0 Votes 2 Answers 863 Views
Hi! Our ClearML server keeps crashing because of some weird task with the = symbol in the ID. After restoring the database to the latest working state, it wo...
one year ago
0 Votes
3 Answers
642 Views
0 Votes 3 Answers 642 Views
Hi everyone. I'm facing a problem when connecting to Azure storage. When the task tries to download a dataset, it fails with the message 2024-08-29 11:02:19,...
8 months ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
What is set_base_docker() equivalent for PipelineController ?
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Dear clearml practitioners, I'd like to share my experiment to another company, in order for them to clone and fine-tune it on their own clearml server. Is t...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi everyone! How do I disable automatic reporting of matplotlib plots and images?
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
3 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
What's the difference between http://allegro.ai/clearml/docs and http://clear.ml/docs ? Which one is the real documentation? I need to look up something very...
3 years ago
0 Votes
27 Answers
836 Views
0 Votes 27 Answers 836 Views
I .
I add_step with clone_base_task=False . However, it still clones the task, wtf
3 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists.I have strong deja vu feeling. Cr...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
3 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there any canonical way to migrate all data between different clearml-server s? Some time ago we were using trains server with quite a few valuable experi...
3 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hi! Please, could anyone explain this sort of behaviour? First, we save a model checkpoint during training (both in .pth and .onnx format) output_model_pth =...
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
3 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Hi! How to add files locally to dataset and then upload to a custom s3 location? The location should be specified within python code, NOT clearml.conf . defa...
3 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi! Is there a way to connect multiple S3 storages to ClearML? As far as I understand, I can only specify one set of S3 credentials in clearml.conf
one year ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Hi, a question about dataset storage Suppose I create a dataset like this dataset = Dataset.create(dataset_name='my_name', dataset_project='my_project') What...
2 years ago
0 What Is

So, to summarize:
PipelineController works with default image, but it incurs overhead 4-5 min It doesn't work with any other image
I can add issue on Github

3 years ago
0 Hi, I'M Trying To Make Use Of New Capabilities Of Dag Creation In Clearml. Seems That Api Has Changed Pretty Much Since A Few Versions Back. There Seems To Be No Need In

pipeline controller itself is stuck at running mode forever all step tasks are created but never enqueued
I can share some code

3 years ago
2 years ago
0 Hi, I'M Trying To Make Use Of New Capabilities Of Dag Creation In Clearml. Seems That Api Has Changed Pretty Much Since A Few Versions Back. There Seems To Be No Need In

Sorry for the delay

Not reproduced, but caught another error when running pipeline_from_tasks.py
` Traceback (most recent call last):
File "pipeline_from_tasks.py", line 31, in <module>
pipe.add_step(name='stage_data', base_task_project='examples', base_task_name='pipeline step 1 dataset artifact')
File "/home/kirillfish/.local/lib/python3.6/site-packages/clearml/automation/controller.py", line 276, in add_step
base_task_project, base_task_name))
ValueError: Could not find ...

3 years ago
0 Hi, A Question About Dataset Storage Suppose I Create A Dataset Like This

Refactoring is to account for the new project names. And also to resolve the project name depending on the version of a client

2 years ago
0 Hi

AnxiousSeal95 We can make a nested pipeline, right? Like if the top pipeline calls add_step to create steps from tasks, and then we decompose any single step further and create a sub-pipeline from decorators there. We should be able to do that, because PipelineController is itself a task, right?

Also, is there a way to unfold such nested pipeline into a flat pipeline? So that only a single pipeline task is created, and it draws a single detailed DAG in PLOTS tab?

3 years ago
0 Is There Any Documentation For

AgitatedDove14 Yes this would be great

3 years ago
0 When I Pass Invalid Key To

if fails during add_step stage for the very first step, because task_overrides contains invalid keys

3 years ago
0 Hi, I'M Trying To Make Use Of New Capabilities Of Dag Creation In Clearml. Seems That Api Has Changed Pretty Much Since A Few Versions Back. There Seems To Be No Need In

The pipeline is initialized like this
pipe = PipelineController(project=cfg['pipe']['project_name'], name='pipeline-{}'.format(name_postfix), version='1.0.0', add_pipeline_tags=True) pipe.set_default_execution_queue('my-queue')
Then for each step I have a base task which I want to clone

` step_base_task = Task.get_task(project_name=cfg[name]['base_project'],
task_name=...

3 years ago
0 Hi! I See The Following In The Docs

SuccessfulKoala55 sorry, that was a bug on my side. It was just referring to another class named Model

3 years ago
0 Is There Any Documentation For

I just happened to spawn multiple OutputModels within a single script which is being run in a single task. That is, I see dozens of models in Models tab in web UI. What I want is to delete most of them (along with the files in S3), preserving the spawning task

3 years ago
0 Is There A Place In Web Ui To Find All

this is the same thing as in the previous thread. I suggest that we move there

3 years ago
0 Hi! Which Method Is Used To Delete Outputmodel From The Storage?

this is how I implemented it by myself. Looks like clearml functionality is quite opinionated and requires some tweaks every time I try to replace my own stuff with it

3 years ago
0 Hi! Which Method Is Used To Delete Outputmodel From The Storage?

This way I would want to keep track of 3 OutputModel s and call update_weights 3 times every update - and probably do 2 redundant uploadings

3 years ago
0 What Is

I initialize tasks not as functions, but as scripts from different repositories, with different images

3 years ago
0 What Is

AgitatedDove14
`
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.
clearml_agent: ERROR: Failed cloning repository.

  1. Make sure you pushed the requested commit:
    (repository='git@...', branch='main', commit_id='...', tag='', docker_cmd='registry.gitlab.com/...:...', en...
3 years ago
0 Hi! Is There A Way To

I still haven't figured out how to make files downloaded this way visible for future get_local_copy calls though

one year ago
0 Fatal: Could Not Read From Remote Repository. Please Make Sure You Have The Correct Access Rights And The Repository Exists.

in order to work with ssh cloning, one has to manually install openssh-client to the docker image, looks like that

3 years ago
0 Has Anybody Used

When I run locally w/o clearml, it doesn't freeze

3 years ago
0 What Is

of course, I use custom images all the time, the question was how to do it for a pipeline 😆 setting private attributes directly doesn't look as good practice

3 years ago
0 A Suggestion To Add

Searching by model ID is good idea, but how do I fetch it from the code? In principle, InputModels are rarely defined automatically, so I could look up for the ID manually...

3 years ago
0 Hi! Is There A Way To

@<1523701435869433856:profile|SmugDolphin23> could you please review it further? Is it acceptable to be merged?

one year ago
0 Hi! Is There A Way To

@<1523701435869433856:profile|SmugDolphin23> maybe I could make a pull request ? Is there any community guideline how to make pull requests to ClearML?

one year ago
0 Hi! Which Method Is Used To Delete Outputmodel From The Storage?

If I keep track of 3 OutputModels simultaneously, the weights would need to shift between them every epoch (like, updated weights for top-1, then top-1 becomes top-2, top-2 becomes top-3 etc)

3 years ago
Show more results compactanswers