Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
27 Answers
1K Views
0 Votes 27 Answers 1K Views
Is there an autoscaler equivalent for K8s? That is, a service that will launch pods based on incoming requests?
one year ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there any way in the WebUI to search by task name? I see the search bar only goes through projects
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
I think something is messed up in my remote agents environment, could someone lend a hand? I'm getting this during remote execution (poetry queue): Summary -...
2 years ago
0 Votes
13 Answers
914 Views
0 Votes 13 Answers 914 Views
Can steps be removed from pipelines, and/or can pipelines be generally modified other than adding steps to them?
one year ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
For remote execution where the queue has poetry as the default package manager, can the user decide to e.g. ignore the lock file?
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is it possible to avoid the clearml-agent for local installations, and have the file server automatically use an S3 bucket? I've found https://clearml.slack....
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Is there an easy way to apply the uncommitted changes, logged by ClearML, locally to a dev environment?
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
ClearML 1.3.2 I'm running Task.get_tasks(project_name=...) and suddenly I get 2022-04-07 10:28:43,617 - clearml.Task - ERROR - Failed reloading task c2d514f3...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Also (unrelated), I noticed that after the upgrade to ClearML Server 1.2.0, the AWS (MinIO) credentials are not saved/used. It keeps asking for them whenever...
3 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Is there a guide on how to deploy a services agent on a k8s setup? Specifically, with the CLI we use flags such as --services-mode --cpu-only , and I can’t s...
one year ago
0 Votes
2 Answers
747 Views
0 Votes 2 Answers 747 Views
Is there a GCP driver similar to aws_driver.py ? None
one year ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
Back to this ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 😢 Hanging for the past ~45m like this
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Good week ClearML team 🙂 I have found two more WebUI bugs (on the self-hosted server): If I look at a specific experiment (say, the Artifacts tab), and then...
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
How do I stop a zombie agent? 🤔 I see it in clearml-agent list , but I do not see it in ps aux and when I try clearml-agent daemon --stop , I get Could not ...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Soooo… the tooltip for some buttons in the WebUI hides the actual buttons 🤔 Any quick fixes?
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there any testing suite that ships with ClearML? If we'd like to make some unit tests for our code?
2 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
If I clone a task, I suppose all artifacts are not cloned with it, even if they are registered, right?
2 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
What privileges/IAM role would the AWS autoscaler need?
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
So the around app is also from ClearML? :shocked_face_with_exploding_head:
4 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
⚠️ ClearML version 1.8.1 had "fix" for the deferred init which introduces a bug btw, I've opened None to highlight this.
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Bug report? We noticed that the AWS autoscaler will lose track of instances crashing due to no space left on device, and the ec2 instance will remain running...
one year ago
0 Votes
26 Answers
1K Views
0 Votes 26 Answers 1K Views
I have some code that launches ML tasks and it accepts a YAML file, .env file and various CSVs. What would be the best way to upload these to a clearml task ...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Confirming about the documentation for clearml.conf : > agent.enable_task_env > ( > bool > ) Set the OS environments based on the Task's Environment section ...
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Follow up on execute_remotely, I see one can limit the available GPU resources in a worker daemon; could one also limit the number of CPU cores available?
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Weird error; my local execution hung with ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 2022-03-07 ...
3 years ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
When using StorageManager.download_folder , I get the following error: Traceback (most recent call last): File "/home/idan/.clearml/venvs-builds/3.7/lib/pyth...
3 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
3 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Also ubuntu 18.04 is losing support so everything in the image needs an update…
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
If, for starters, I'd only like to use ClearML for logging purposes (that is, experiments run locally, and I report metrics, graphs, etc to ClearML). Do I st...
3 years ago
Show more results questions
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

It failed on some missing files in my remote_execution, but otherwise seems fine now

3 years ago
3 years ago
0 Does Clearml Somehow

True, and we plan to migrate to pipelines once we have some time for it :) but anyway that condition is flawed I believe

2 years ago
0 We’Re Running Clearml-Agent On K8S And I First Noticed Some Warnings From The Pod About Python 3.6..?

(in the current version, that is, we’d very much like to use them obviously :D)

one year ago
0 Can We Report A Pandas Table With Styling To Be Retained In The Webui? It Would Be Nice To Report E.G.

Thanks AgitatedDove14 , I'll give it a try. Perhaps additional documentation is needed for that extra_layout

3 years ago
2 years ago
0 Is There An Easy Way To Add A Link To One Of The Tasks Panels? (As An Artifact, Configuration, Info, Etc)? Edit: And Follow Up Regarding The Dataset. As Discussed Somewhere Previously, The Datasets Are Now Automatically Moved To A Hidden "Sub-Project" Pr

For now we've monkey-patched it to our usecase:

` Dataset._Dataset__hidden_tag = "active"

    def foo(cls, dataset_project, dataset_name):
        dataset_project = dataset_project or "Datasets"
        return dataset_project, dataset_project.rpartition("/")[0]

    Dataset._build_hidden_project_name = foo `
2 years ago
0 Is It Possible To Avoid The Clearml-Agent For Local Installations, And Have The File Server Automatically Use An S3 Bucket? I'Ve Found

That's what I found as well, but it did not like it after all (boto is fine with it, but underlying urllib and requests were not?)

It's fine -- I see the added benefit in making sure the users set up their clearml.conf and I've made a script to edit it to our needs as part of the installation process 🙂 Thanks Martin!

3 years ago
0 Our Mac Users Are Having Some Issues. They Have Their Respective ~/Clearml.Conf, And Yet They Get: Clearml 1.1.5

SuccessfulKoala55 That string was autogenerated by pyhocon and matches their documentation too - https://github.com/lightbend/config/blob/master/HOCON.md#substitutions
The first example won't work (it will treat ${...} as a string literal and won't replace it). The second does work, but as mentioned anyway, these were not hand typed, but rather generated from pyhocon, so I don't think that's the issue 🤔

3 years ago
0 Trying To Run Aws Autoscaler With

SuccessfulKoala55 no that did not solve the issue 😞

2 years ago
0 What Would Be The Best Way To Approach This Flow?

We have a more complicated case but I'll work around it 😄

Follow up though - can configuration objects refer to one-another internally in ClearML?

2 years ago
0 <Edited> Two Things:

There's not much (or anything) in the log to provide...

` (.venv) 15:42 [0:user@server$~] CLEARML_CONFIG_FILE=~/agent_clearml.conf clearml-agent daemon --queue default on_prem --detached --order-fairness
Environment variables set from configuration: ['AWS_ACCESS_KEY_ID', 'AWS_SECRET_ACCESS_KEY', 'AWS_DEFAULT_REGION']
...

2 years ago
0 Is It Possible To Avoid The Clearml-Agent For Local Installations, And Have The File Server Automatically Use An S3 Bucket? I'Ve Found

If I add the bucket to that (so CLEARML_FILES_HOST= s3://minio_ip:9000/minio/bucket ), I then get the following error instead --

2021-12-21 22:14:55,518 - clearml.storage - ERROR - Failed uploading: SSL validation failed for ... [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1076)

3 years ago
0 We’Re Running Clearml-Agent On K8S And I First Noticed Some Warnings From The Pod About Python 3.6..?

Honestly I wouldn't mind building the image myself, but the glue-k8s setup is missing some documentation so I'm not sure how to proceed

one year ago
0 Trying To Run Aws Autoscaler With

Sure SuccessfulKoala55 , and thanks for looking into it.

As an alternative (for now, or in general), we could consider reverting back to pip. The issue we encounter is that we have a monorepo, so frozen requirements should specify relative paths, but pip freeze does not seem to do that, so ClearML also fails in pip mode

2 years ago
0 For Remote Execution Where The Queue Has

Here's an example where poetry.lock is removed, and still the console reads:
url: .... branch: HEAD commit: 22fffaf8d5f377b7f10140e642a7f6f26b72ffaa root: /.../.clearml/venvs-builds/3.10/task_repository/... Applying uncommitted changes Poetry Enabled: Ignoring requested python packages, using repository poetry lock file! Creating virtualenv ds-platform in /.../.clearml/venvs-builds/3.10/task_repository/.../.venv Updating dependencies Resolving dependencies...

2 years ago
0 I Encountered A Weird Edge Case With The Aws Auto-Scaler, Wondering If There Are Any Solutions Or If This Is A Known Issue. Something As Follows Happened:

The instance that took a while to terminate (or has taken a while to disappear from the idle workers)

2 years ago
0 Hi There, I Used

JitteryCoyote63 yes exactly, sorry, I forgot to add the Task.get_task in my response. That's exactly what we do 😅

3 years ago
0 Clearml 1.3.2 I'M Running

proj_suffix = "" i = 2 while Task.get_project_id(f"{proj_name}{proj_suffix}") is not None: tasks = Task.get_tasks(project_name=f"{proj_name}{proj_suffix}") if not [task for task in tasks if not task.get_archived()]: # Empty project, we can use this one... break proj_suffix = f"_{i}" i += 1

2 years ago
0 When Using

Btw TimelyPenguin76 this should also be a good starting point:
First create the target directory and add some files:sudo mkdir /data/clearml sudo chmod 777 -R /data/clearml touch /data/clearml/foo touch /data/clearml/bar touch /data/clearml/bazThen list the files using the StorageManager. It shouldn't take more than a few miliseconds.` from clearml import StorageManager

%%timeit
StorageManager.list("/data/clearml")

-> 21.2 s ± 328 ms per loop (mean ± std. dev. of 7 runs, 1 loop each) `

3 years ago
0 I Have Some Code That Launches Ml Tasks And It Accepts A Yaml File,

Thanks AgitatedDove14 , I'll first have to prove viability with the free version :)

3 years ago
0 Is There An Easy Way To Add A Link To One Of The Tasks Panels? (As An Artifact, Configuration, Info, Etc)? Edit: And Follow Up Regarding The Dataset. As Discussed Somewhere Previously, The Datasets Are Now Automatically Moved To A Hidden "Sub-Project" Pr

can I assume these files are reused

A definite maybe, they may or may not be used, but we'd like to keep that option 🙃

Maybe the "old" way Dataset were shown is better suited ?

It was, but then it's gone now 😞

I see your point, this actually might be a "bug"?!

I would say so myself, but could be also by design..?

Awesome, I'll ask Product to reach out

LMK, happy to help out!
I know our use case is maybe a very different one, but...

2 years ago
0 Is There An Easy Way To Add A Link To One Of The Tasks Panels? (As An Artifact, Configuration, Info, Etc)? Edit: And Follow Up Regarding The Dataset. As Discussed Somewhere Previously, The Datasets Are Now Automatically Moved To A Hidden "Sub-Project" Pr

That gives us the benefit of creating "local datasets" (confined to the scope of the project, do not appear in Datasets tabs, but appear as normal tasks within the project)

2 years ago
Show more results compactanswers