Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there any testing suite that ships with ClearML? If we'd like to make some unit tests for our code?
2 years ago
0 Votes
24 Answers
628 Views
0 Votes 24 Answers 628 Views
How can I send a composed chunk of code for remote execution from within a notebook ?
11 months ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
I'd like the CONSOLE in a ClearML run to show only the stdout/stderr as it does now, but I'd also like ClearML to capture DEBUG level logs. Is there an easy ...
2 years ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
For remote execution where the queue has poetry as the default package manager, can the user decide to e.g. ignore the lock file?
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Sometimes, on shorter tasks, my Task would hang for the 5 minute timeout with e.g. 2022-01-04 08:45:25,181 - clearml.Task - INFO - Waiting for repository det...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Side note for documentation, Task.project reads > Returns the current Task’s project name. But it actually returns the project ID
one year ago
0 Votes
23 Answers
980 Views
0 Votes 23 Answers 980 Views
Back to this ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 😒 Hanging for the past ~45m like this
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
What could cause a queue to be recreated automatically? I experimented with the autoscaler with queue name foo , got it working, closed the autoscaler, delet...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Are the docs broken? https://clear.ml/docs/latest/docs/release_notes/ver_1_7 gives me this
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Any easy way to ensure the pipline (tasks + controller) are not hidden in the projects UI? EDIT: Apparently not; for the time being I created this https://gi...
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
How do I stop a zombie agent? πŸ€” I see it in clearml-agent list , but I do not see it in ps aux and when I try clearml-agent daemon --stop , I get Could not ...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I'm trying to set up some initial experiments within our stack, but when I use the execute_remotely task, I get this error: clearml_agent: ERROR: Failed gett...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Is there a way to force ClearML to first parse the config file, before running Task.init ? We’re relying in some code that the credentials in clearml.conf ar...
one year ago
0 Votes
3 Answers
997 Views
0 Votes 3 Answers 997 Views
Can we temporarily disable the autologging feature? (specifically for matplotlib ?)
one year ago
0 Votes
28 Answers
1K Views
0 Votes 28 Answers 1K Views
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Is there any way (or are there any plans) to include some view for datasets in the WebUI? One that is detached from the generating task?
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
When I upgrade the server, do I need to do anything with the agents/queues (redefine them, etc)?
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
We're running into errors such as this: Action failed <500/0: tasks.add_or_update_artifacts/v2.10 (Update failed (BSONObj size: 18564134 (0x11B4426) is inval...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Trying to run AWS autoscaler with poetry queue, and I get: Traceback (most recent call last): File "/root/.local/bin/poetry", line 5, in from poetry.console....
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Does anyone know how we can restore ClearML on Helms chart from existing Snapshots (AWS)?
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Good week ClearML team πŸ™‚ I have found two more WebUI bugs (on the self-hosted server): If I look at a specific experiment (say, the Artifacts tab), and then...
2 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
If I clone a task, I suppose all artifacts are not cloned with it, even if they are registered, right?
2 years ago
0 Votes
7 Answers
999 Views
0 Votes 7 Answers 999 Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
We're moving from on-premise to AWS - is there an easy way to migrate wall the tasks, projects, etc to the new instance?
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
... and yet another πŸ˜„ When using the UI with regex to search for experiments, due to the greedy nature of the search, it consistently pops up the "ERROR Fet...
2 years ago
0 Votes
3 Answers
986 Views
0 Votes 3 Answers 986 Views
side question - any plans to include native support for lgbm ?
3 years ago
0 Votes
5 Answers
963 Views
0 Votes 5 Answers 963 Views
Getting a weird error on local setup for ClearML Server: 2022-03-30 08:07:07,932 - clearml.Task - ERROR - Action failed <500/0: tasks.get_all/v1.0 (mongo:270...
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
We have configured the AWS credentials in the remote worker's clearml.conf , but they are not available to third parties that use e.g. AWS_ACCESS_KEY . Is th...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
2 years ago
0 Votes
2 Answers
982 Views
0 Votes 2 Answers 982 Views
Can one delete individual tasks from the WebUI?
3 years ago
Show more results questions
0 Is It Expected That K8S Helm Chart Also Starts A Clearml Worker?

yes, a lot of moving pieces here as we're trying to migrate to AWS and set up autoscaler and more πŸ˜…

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

Yeah I managed to work around those former two, mostly by using Task.create instead of Task.init . It's actually the whole bunch of daemons running in the background that takes a long time, not the zipping.

Regarding the second - I'm not doing anything per se. I'm running in offline mode and I'm trying to create a dataset, and this is the error I get...
There is a data object it, but there is no script object attached to it (presumably again because of pytest?)

2 years ago
0 Is It Possible To Avoid The Clearml-Agent For Local Installations, And Have The File Server Automatically Use An S3 Bucket? I'Ve Found

The key/secret is also shared internally so that sounds like a nice mitigation actually!
Which environment variable am I looking for? I couldn't spot anything specifically in that environment variables page

3 years ago
0 <Edited> Two Things:

There's not much (or anything) in the log to provide...

` (.venv) 15:42 [0:user@server$~] CLEARML_CONFIG_FILE=~/agent_clearml.conf clearml-agent daemon --queue default on_prem --detached --order-fairness
Environment variables set from configuration: ['AWS_ACCESS_KEY_ID', 'AWS_SECRET_ACCESS_KEY', 'AWS_DEFAULT_REGION']
...

2 years ago
0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

We have the following, works fine (we also use internal zip packaging for our models):

model = OutputModel(task=self.task, name=self.job_name, tags=kwargs.get('tags', self.task.get_tags()), framework=framework)
model.connect(task=self.task, name=self.job_name)
model.update_weights(weights_filename=cc_model.save())
one year ago
0 Since V1.4.0, Our

Okay so the new functionality is maintained; thanks!

2 years ago
0 Since V1.4.0, Our

Could also be that the use of ./ is the issue? I'm not sure what else I can provide you with, SweetBadger76

2 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

Will try!

Curious - is there a temporary changelog for 1.2.0? 😁 Always fun to poke at the upcoming features

EDIT: Wait, should the clearml RC be installed outside the venv for the agent as well?

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

Or well, because it's not geared for tests, I'm just encountering weird shit. Just calling task.close() takes a long time

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

Last but not least - can I cancel the offline zip creation if I'm not interested in it πŸ€”
EDIT: I see not, guess one has to patch ZipFile ...

2 years ago
0 !! In Remote Execution, Do Agents Inherit The Config From The Queue From Which They Pull The Task?

Actually SuccessfulKoala55 , there is something like that happening behind the scenes.
I have an AWS Autoscaler running on a services queue, so the autoscaler inherits the configuration used by the services agent, right?
Now, when my autoscaler launched new EC2 instances, they used the same fileserver as the one that was defined in the services agent too πŸ€”

2 years ago
0 Back To This

Sorry, been away for a while!
I have no additional information, since it was a bug in my model that I have since eliminated...
Maybe it was just a matplotlib error and can be dropped for now. I'll let you know if it pops up again!

2 years ago
0 Our Mac Users Are Having Some Issues. They Have Their Respective ~/Clearml.Conf, And Yet They Get: Clearml 1.1.5

This was a long time running since I could not access the macbook in question to debug this.
It is now resolved and indeed a user error - they had implicitly defined CLEARML_CONFIG_FILE to e.g. /home/username/clearml.conf instead of /Users/username/clearml.conf as is expected on Mac.
I guess the error message could be made clearer in this case (i.e. CLEARML_CONFIG_FILE='/home/username/clearml.conf' file does not exist ). Thanks for the support! ❀

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

So some UI that shows the contents of users.get_all ?

2 years ago
0 Sometimes, On Shorter Tasks, My Task Would Hang For The 5 Minute Timeout With E.G.

Thanks SuccessfulKoala55 ! Could I change this during runtime, so for example, only the very first task goes through this process?

2 years ago
0 Pipelines Suddenly No Longer Appear In The Pipelines Tab, What Could/Should I Look Into? Edit: Using Latest Clearml (Agent, Server, Sdk), And Creating The Pipelines Via The Pipelinecontroller Sdk (

Happens with the latest version indeed.
I can’t share our code, but the gist of it is:

pipe = PipelineController(name=..., project=..., version=...)

pipe.add_function_step(...)  # Many calls

pipe.set_default_execution_queue(...)
pipe.start(queue=..., wait=True)
one year ago
0 The Clearml Helm Charts Page Is Gone?

Not sure if @<1523701087100473344:profile|SuccessfulKoala55> or @<1523701827080556544:profile|JuicyFox94> maybe knows?

one year ago
0 Our Mac Users Are Having Some Issues. They Have Their Respective ~/Clearml.Conf, And Yet They Get: Clearml 1.1.5

Then perhaps mac treats missing environment variables as empty and linux just crashes? Anyway, the config loading should be deferred, shouldn't it?

2 years ago
0 Is There An Easy Way To Add A Link To One Of The Tasks Panels? (As An Artifact, Configuration, Info, Etc)? Edit: And Follow Up Regarding The Dataset. As Discussed Somewhere Previously, The Datasets Are Now Automatically Moved To A Hidden "Sub-Project" Pr

Well, -ish. Ideally what we're after is one of the following:
Couple a task with a dataset. Keep it visible in it's destined location. Create a dataset separately from the task. Have control over its visibility and location. If it's hidden, it should not affect normal UI interaction (most annoying is having to click twice on the same project name when there are hidden datasets, which do not appear in the project view)

2 years ago
0 Is It Possible To Avoid The Clearml-Agent For Local Installations, And Have The File Server Automatically Use An S3 Bucket? I'Ve Found

That's what I found as well, but it did not like it after all (boto is fine with it, but underlying urllib and requests were not?)

It's fine -- I see the added benefit in making sure the users set up their clearml.conf and I've made a script to edit it to our needs as part of the installation process πŸ™‚ Thanks Martin!

3 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

TimelyPenguin76 CostlyOstrich36 It seems a lot of manual configurations is required to get the EC2 instances up and running.
Would it not make sense to update the autoscaler (and example script) so that the config.yaml that's used for the autoscaler service is implicitly copied to the EC2 services, and then any extra_clearml_conf are used/overwritten?

2 years ago
0 Is There An Easy Way To Add A Link To One Of The Tasks Panels? (As An Artifact, Configuration, Info, Etc)? Edit: And Follow Up Regarding The Dataset. As Discussed Somewhere Previously, The Datasets Are Now Automatically Moved To A Hidden "Sub-Project" Pr

I commented on your suggestion to this on GH. Uploading the artifacts would happen via some SDK before switching to remote execution.
When cloning a task (via WebUI or SDK), a user should have an option to also clone these input artifacts or simply linking to the original. If linking to the original, then if the original task is deleted - it is the user's mistake.

Alternatively, this potentially suggests "Input Datasets" (as we're imitating now), such that they are not tied to the original t...

2 years ago
0 Hi There, I Used

JitteryCoyote63 I use clearml.config.get_remote_task_id()

2 years ago
0 Hello, Trying To Figure Out How To Run A Machine In Docker Mode (Ecr Private Repo) Using Clearml. For Some Reason I Cannot Get This To Work With :

I think ClearML boots up only afterwards, so those environment variables may not be available yet.
You should set them manually in the bootstrap code unfortuantely.

one year ago
0 Is There Any Way (Or Are There Any Plans) To Include Some View For Datasets In The Webui? One That Is Detached From The Generating Task?

I see! The Hyper Datasets don't really fit our use case - it seems really focused on CNNs and image-based data, but lacking support for database-oriented tabular data.

So for now we mainly work with parquet and CSV files, and I was hoping there'd be an easy way to view those... I'll make a workaround with a "Datasets" project I suppose!

2 years ago
0 We Use Environment Variables In Our

SuccessfulKoala55 CostlyOstrich36 actually it is the import statement, just finally got around to the traceback:

` File "/home/.../ccmlp/configs/mlops.py", line 4, in <module>
from clearml import Task
File "/home/.../.venv/lib/python3.8/site-packages/clearml/init.py", line 4, in <module>
from .task import Task
File "/home/.../.venv/lib/python3.8/site-packages/clearml/task.py", line 31, in <module>
from .backend_interface.metrics import Metrics
File "/home/......

2 years ago
0 We Use Environment Variables In Our

So the config loading is not deferred until execution 😞

2 years ago
Show more results compactanswers