Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
Can one compare experiments/tasks from different projects? EDIT: I mean, I can manually navigate to some /compare-experiments end point and then find the tas...
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Is there some automated migration for existing tasks from other MLOps frameworks to ClearML? (Specifically, interested in migrating from mlflow)
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
One more follow-up still; we're trying to run non-GPU scaler, and I've finally sorted out subnet and security groups issues, only to run into this: Executing...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
side question - any plans to include native support for lgbm ?
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there a way to set precedence on package managers? If we set an agent to use poetry it will ignore local packages, even if I use the force_requirements_en...
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
I think something is messed up in my remote agents environment, could someone lend a hand? I'm getting this during remote execution (poetry queue): Summary -...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
... and yet another 😄 When using the UI with regex to search for experiments, due to the greedy nature of the search, it consistently pops up the "ERROR Fet...
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Any easy way to ensure the pipline (tasks + controller) are not hidden in the projects UI? EDIT: Apparently not; for the time being I created this https://gi...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
What privileges/IAM role would the AWS autoscaler need?
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Follow up on execute_remotely, I see one can limit the available GPU resources in a worker daemon; could one also limit the number of CPU cores available?
3 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Can we use dynamodb with ClearML helm charts instead of mongodb? We'd like to move all stateful storage to AWS as a separate service and that would be a nice...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
2 years ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
For remote execution where the queue has poetry as the default package manager, can the user decide to e.g. ignore the lock file?
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Can we temporarily disable the autologging feature? (specifically for matplotlib ?)
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
When I upgrade the server, do I need to do anything with the agents/queues (redefine them, etc)?
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
If, for starters, I'd only like to use ClearML for logging purposes (that is, experiments run locally, and I report metrics, graphs, etc to ClearML). Do I st...
3 years ago
0 Votes
27 Answers
1K Views
0 Votes 27 Answers 1K Views
Is there an autoscaler equivalent for K8s? That is, a service that will launch pods based on incoming requests?
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Bug report? We noticed that the AWS autoscaler will lose track of instances crashing due to no space left on device, and the ec2 instance will remain running...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Weird error; my local execution hung with ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 2022-03-07 ...
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Seems like ClearML tasks in offline mode cannot be properly closed, we get ValueError: Unsupported keyword arguments: publish when calling task.close() . Thi...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
If we use a poetry queue and do not specify the agent.package_manager.poetry_version , will ClearML install/update anything? Asking because there are some is...
one year ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Is there a way to force ClearML to first parse the config file, before running Task.init ? We’re relying in some code that the credentials in clearml.conf ar...
one year ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
Back to this ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 😢 Hanging for the past ~45m like this
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Side note for documentation, Task.project reads > Returns the current Task’s project name. But it actually returns the project ID
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
We're moving from on-premise to AWS - is there an easy way to migrate wall the tasks, projects, etc to the new instance?
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Is there any way (or are there any plans) to include some view for datasets in the WebUI? One that is detached from the generating task?
3 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Any plans to add support for MultiIndex tables? That comma-separation feels a bit odd. (Also this shows up in plots while in the scalars tab I actually have ...
3 years ago
Show more results questions
0 There Seems To Be An Error If A Project Name Has Spaces (At Least At The Top-Level Name). I Created A Project Called

I created a new task with the project name internal tests , and no task name (so it's derived by ClearML).
The task was a simple print out.
The project does not appear in the project space and does not turn up on searches (the task does)

2 years ago
0 When Using

Any leads TimelyPenguin76 ? I've also tried setting up a minio s3 bucket, but I'm not sure if the remote agent has copied the credentials and host 🤔

3 years ago
0 Back To This

Not really, I've only been able to somewhat understand the scope of where it happens, and I'm not sure it's even a ClearML issue (maybe matplotlib)

2 years ago
0 Hey! Probably Missed Something, But I Recently Upgraded To 1.1.1, And I'Ve Just Noticed That Png Artifacts Are Not Displayed In The Preview. Is This Intentional? Edit: Ah, It Has To Be A

I've updated my feature request to describe that as well. A textual description is not necessarily a preview 😅 For now I'll use the debug samples.

These kind of things definitely show how ClearML was designed originally only for neural networks tbh, where images are almost always only part of the dataset. Same goes for the consistent use of iteration everywhere 😞

3 years ago
0 Hey! Probably Missed Something, But I Recently Upgraded To 1.1.1, And I'Ve Just Noticed That Png Artifacts Are Not Displayed In The Preview. Is This Intentional? Edit: Ah, It Has To Be A

That's a nice work around of course - I'm sure it works and I'll give it a shot momentarily. I'm just wondering if ClearML could automatically recognize image files in upload_artifact (and other well known suffixes) and do that for me.

3 years ago
0 Hey! Probably Missed Something, But I Recently Upgraded To 1.1.1, And I'Ve Just Noticed That Png Artifacts Are Not Displayed In The Preview. Is This Intentional? Edit: Ah, It Has To Be A

Not really - it will just show the string. A preview would be more like a low-res version of the uploaded image or similar.

3 years ago
3 years ago
2 years ago
0 Pipelines Suddenly No Longer Appear In The Pipelines Tab, What Could/Should I Look Into? Edit: Using Latest Clearml (Agent, Server, Sdk), And Creating The Pipelines Via The Pipelinecontroller Sdk (

Happens with the latest version indeed.
I can’t share our code, but the gist of it is:

pipe = PipelineController(name=..., project=..., version=...)

pipe.add_function_step(...)  # Many calls

pipe.set_default_execution_queue(...)
pipe.start(queue=..., wait=True)
2 years ago
0 What Privileges/Iam Role Would The Aws Autoscaler Need?

No need for S3 or other resources?

3 years ago
0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

I can only say I’ve found ClearML to be very helpful, even given the documentation issue.
I think they’ve been working on upgrading it for a while, hopefully something new comes out soon.
Maybe @<1523701205467926528:profile|AgitatedDove14> has further info 🙂

2 years ago
0 Clearml Server V1.2.0 Has Just Been Released!

Perfect now 👌 (also nice cleanup of default_new_data_root duplicate code :D)

3 years ago
2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

If I set the following:
"extra_clearml_conf": "sdk.aws.s3.credentials = [\n{\nhost: 'ip:9000'\nkey: 'xxx'\nsecret: 'xxx'\nmultipart: false\nsecure: false\n},\n{\nhost: 'ip2:9000'\nkey: 'xxx'\nsecret: 'xxx'\nmultipart: false\nsecure: false\n}\n]"I run into a weird furl error:
ValueError: Invalid port '9000''.

2 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

A follow up question (instead of opening a new thread), is there a way I could signal some files/directories to be copied to the execute_remotely task?

3 years ago
0 We'Re Using Ray And Clearml Together, And Suddenly We'Re Seeing Some Hanging Threads, And Finally We Got An Error Message:

I thought so too - so I added flush calls just in case, but nothing's changed.
This is somewhat weird since it always happens in the above scenario (Ray + ClearML), and always in the last task/job from Ray

3 years ago
2 years ago
0 Hi

Woot! What about clearml-agent 1.2.0? 🙂

2 years ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

We have an internal mono-repo and some of the packages are required - they’re all available correctly for the controller, only some are required for the individual tasks, but the “magic” doesn’t happen 😞
That is, the controller does not identify them as a requirement, so they’re not installed in the tasks environment.

2 years ago
0 How Can I Send A Composed Chunk Of Code For Remote Execution

Hey @<1537605940121964544:profile|EnthusiasticShrimp49> ! You’re mostly correct. The Step classes will be predefined (of course developers are encouraged to add/modify as needed), but as in the DataTransformationStep , there may be user-defined functions specified. That’s not a problem though, I can provide these functions with the helper_functions argument.

  • The .add_function_step is indeed a failing point. I can’t really create a task from the notebook because calling `Ta...
one year ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

I guess following the example https://github.com/allegroai/clearml/blob/master/examples/advanced/execute_remotely_example.py , it's not clear to me how the server has access to the data loaders location when it hits execute_remotely

3 years ago
0 Since Clearml 1.6.3, A Dataset Attached To A Task Now Renames That Task By Adding A

Yes, that one shows up. I forgot to mention we also set the version explicitly, but that just creates a duplicate dataset under Datasets and anyway our main Task is now hidden from the original project.
So project project exists, but it is empty.

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

Or well, because it's not geared for tests, I'm just encountering weird shit. Just calling task.close() takes a long time

2 years ago
0 Trying To Run Aws Autoscaler With

Ah. In the extra_vm_bash_script of the AWS autoscaler.

2 years ago
Show more results compactanswers