Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
!! In remote execution, do agents inherit the config from the queue from which they pull the task?
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there any testing suite that ships with ClearML? If we'd like to make some unit tests for our code?
2 years ago
0 Votes
3 Answers
983 Views
0 Votes 3 Answers 983 Views
side question - any plans to include native support for lgbm ?
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
2 years ago
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
How would I go about adding multiple credentials in the autoscaler? (i.e. specify multiple sdk.aws.s3.credentials ) It's a bit odd that one would also have t...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
For some reason the agent is now trying to use Python 2.7 all of a sudden, any idea why? 🤔 I see the following in the task's console output: New python exec...
2 years ago
0 Votes
6 Answers
948 Views
0 Votes 6 Answers 948 Views
Is there some automated migration for existing tasks from other MLOps frameworks to ClearML? (Specifically, interested in migrating from mlflow)
2 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
We use environment variables in our clearml.conf , but those might only be available later down the line (after dotenv.load_dotenv is called). When those env...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I'm trying to set up some initial experiments within our stack, but when I use the execute_remotely task, I get this error: clearml_agent: ERROR: Failed gett...
3 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Any easy way to ensure the pipline (tasks + controller) are not hidden in the projects UI? EDIT: Apparently not; for the time being I created this https://gi...
one year ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
What would be the best way to approach this flow? We have a configuration file that defines e.g. the project name to use in ClearML, alongside other experime...
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is it possible to avoid the clearml-agent for local installations, and have the file server automatically use an S3 bucket? I've found https://clearml.slack....
3 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Can we use dynamodb with ClearML helm charts instead of mongodb? We'd like to move all stateful storage to AWS as a separate service and that would be a nice...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Sometimes, on shorter tasks, my Task would hang for the 5 minute timeout with e.g. 2022-01-04 08:45:25,181 - clearml.Task - INFO - Waiting for repository det...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
We're running into errors such as this: Action failed <500/0: tasks.add_or_update_artifacts/v2.10 (Update failed (BSONObj size: 18564134 (0x11B4426) is inval...
2 years ago
0 Votes
7 Answers
949 Views
0 Votes 7 Answers 949 Views
Is there a way to generate usage stats and reports for queues? For example, how often is a queue used, how much CPU does the queue consume when it's used, et...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Follow up on execute_remotely, I see one can limit the available GPU resources in a worker daemon; could one also limit the number of CPU cores available?
2 years ago
0 Votes
7 Answers
996 Views
0 Votes 7 Answers 996 Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
If I create a dataset with Dataset.create(..., use_current_task=True) , that task holds the dataset. Can I then refer/copy/attach the same dataset to other t...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
How does ClearML store some of the more intrinsic data (scalars, plots, etc)? We recently recovered Mongo from a backup and while the projects and tasks are ...
one year ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there anywhere in the web UI where one can see the clearml server version running? I keep getting "version 1.1.1 is now available" even though I'm pretty ...
3 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Does ClearML somehow remove any loggers from logging module? We suddenly noticed that we have some handlers missing when running in ClearML
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Are the docs broken? https://clear.ml/docs/latest/docs/release_notes/ver_1_7 gives me this
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
If we use a poetry queue and do not specify the agent.package_manager.poetry_version , will ClearML install/update anything? Asking because there are some is...
one year ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Confirming about the documentation for clearml.conf : > agent.enable_task_env > ( > bool > ) Set the OS environments based on the Task's Environment section ...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Also (unrelated), I noticed that after the upgrade to ClearML Server 1.2.0, the AWS (MinIO) credentials are not saved/used. It keeps asking for them whenever...
2 years ago
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
Can one compare experiments/tasks from different projects? EDIT: I mean, I can manually navigate to some /compare-experiments end point and then find the tas...
2 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
If I clone a task, I suppose all artifacts are not cloned with it, even if they are registered, right?
2 years ago
Show more results questions
0 Hi All, I Am Trying To Spin Up Some Aws Autoscaler Instances, But I Seem To Have Some Issues With The Instance Creation:

@<1539780258050347008:profile|CheerfulKoala77> you may also need to define subnet or security groups.
Personally I do not see the point in Docker over EC2 instances for CPU instances (virtualization on top of virtualization).
Finally, just to make sure, you only ever need one autoscaler. You can monitor multiple queues with multiple instance types with one autoscaler.

one year ago
0 Clearml 1.3.2 I'M Running

I have selected the correct project indeed

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Follow up on this btw, from the WebUI/Server POV, I see there's an "Admin" role, etc. Do those have additional views available, such as users etc?

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

So some UI that shows the contents of users.get_all ?

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

So no direct page to see e.g. how many people have registered and/or if someone accidentally made two (or more) accounts, or somewhere to just delete users, etc

2 years ago
0 Clearml 1.3.2 I'M Running

It's a small snippet that ensures identically named projects are still unique'd with a running number.

2 years ago
0 Sometimes, On Shorter Tasks, My Task Would Hang For The 5 Minute Timeout With E.G.

Thanks SuccessfulKoala55 ! Could I change this during runtime, so for example, only the very first task goes through this process?

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

It's of course not an MLOps issue so I understand it's not high on the priority list, but would be kinda cool to just have a simple view presenting the content of users.get_all 😄

2 years ago
2 years ago
0 Clearml 1.3.2 I'M Running

I can see the task in the UI, it is not archived, and that's pretty much the snippet, but in full I do e.g.

2 years ago
2 years ago
0 The Clearml Helm Charts Page Is Gone?

Thanks for the reply @<1523701827080556544:profile|JuicyFox94> ! I'll debug more and let you know

one year ago
0 The Clearml Helm Charts Page Is Gone?

Not sure if @<1523701087100473344:profile|SuccessfulKoala55> or @<1523701827080556544:profile|JuicyFox94> maybe knows?

one year ago
0 Does Anyone Know How We Can Restore Clearml On Helms Chart From Existing Snapshots (Aws)?

Scaling to zero, copying the mongodb data, and scaling back up worked like a charm.

Thanks @<1523701827080556544:profile|JuicyFox94> !

one year ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Ah, the API server /users.get_all , I see!

2 years ago
0 Does Clearml Somehow

True, and we plan to migrate to pipelines once we have some time for it :) but anyway that condition is flawed I believe

2 years ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

The logs are on the bucket, yes.
The default file server is also set to s3://ip:9000/clearml

2 years ago
0 Clearml 1.3.2 I'M Running

proj_suffix = "" i = 2 while Task.get_project_id(f"{proj_name}{proj_suffix}") is not None: tasks = Task.get_tasks(project_name=f"{proj_name}{proj_suffix}") if not [task for task in tasks if not task.get_archived()]: # Empty project, we can use this one... break proj_suffix = f"_{i}" i += 1

2 years ago
0 Does Clearml Somehow

1.8.3; what about when calling task.close() ? We suddenly have a need to setup our logging after every task.close() call

2 years ago
0 The Clearml Helm Charts Page Is Gone?

Can I subscribe to updates? 😁

one year ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

The api.files_server is set to the MinIO endpoint s3://ip:9000/clearml (both locally and remotely) The sdk.development.default_output_uri is set to the MinIO endpoint (both locally and remotely) When we call Task.init I do not set the output_uri at all I get the logger directly with task.get_logger()

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Don't even need to specify json=... 😉 Thanks!

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

clearml.backend_api.session.defs.ENV_HOST.get() did not work unfortunately 🤔

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

On it! Should I include the additional user filters described above?

2 years ago
0 Does Clearml Somehow

I narrowed the bug down to the "fix" in 1.8.1, see my other post

2 years ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

After setting the sdk.development.default_output_uri in the configs, my code kinda looks like:
` task = Task.init(project_name=..., task_name=..., tags=...)
logger = task.get_logger()

report with logger freely `

2 years ago
0 Does Clearml Somehow

But it is strictly that if condition in Task.init, see the issue I opened about it

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

I couldn't find it directly in the SDK at least (in the APIClient)... 🤔

2 years ago
Show more results compactanswers