Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Is there a guide on how to deploy a services agent on a k8s setup? Specifically, with the CLI we use flags such as --services-mode --cpu-only , and I can’t s...
2 years ago
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
3 years ago
0 Votes
14 Answers
2K Views
0 Votes 14 Answers 2K Views
Automatic logging for generated matplotlib works nicely, but for some reason it names the graphs as "00 untitled" and uses series "plot image" in ClearML UI ...
3 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
Weird error; my local execution hung with ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 2022-03-07 ...
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Also (unrelated), I noticed that after the upgrade to ClearML Server 1.2.0, the AWS (MinIO) credentials are not saved/used. It keeps asking for them whenever...
3 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Pipelines suddenly no longer appear in the Pipelines tab, what could/should I look into? EDIT: Using latest ClearML (agent, server, SDK), and creating the pi...
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
For some reason the agent is now trying to use Python 2.7 all of a sudden, any idea why? πŸ€” I see the following in the task's console output: New python exec...
3 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
Seems like ClearML tasks in offline mode cannot be properly closed, we get ValueError: Unsupported keyword arguments: publish when calling task.close() . Thi...
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
How/where can I change the session timeout time for the WebUI? It's timing out WAY too fast after the latest updates
3 years ago
0 Votes
28 Answers
2K Views
0 Votes 28 Answers 2K Views
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
side question - any plans to include native support for lgbm ?
4 years ago
0 Votes
13 Answers
2K Views
0 Votes 13 Answers 2K Views
Two things: The release of clearml-agent was not announced in 🀯 clearml-agent seems outdated wrt requirements, making poetry and clearml-agent incompatible:...
2 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
Is there anywhere in the web UI where one can see the clearml server version running? I keep getting "version 1.1.1 is now available" even though I'm pretty ...
4 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
There seems to be an error if a project name has spaces (at least at the top-level name). I created a project called internal tests (with the space), and it ...
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Does ClearML have any suggestions on GPU and non-GPU AMIs for the AutoScaler? The two default ones in the documentation are either: Non-existent (too old) - ...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
So the around app is also from ClearML? :shocked_face_with_exploding_head:
4 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
3 years ago
0 Votes
23 Answers
2K Views
0 Votes 23 Answers 2K Views
We're trying to upgrade our ClearML on K8s but we're getting this error - Error: UPGRADE FAILED: cannot patch "clearml-fileserver-data" with kind PersistentV...
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Is there a way to force ClearML to first parse the config file, before running Task.init ? We’re relying in some code that the credentials in clearml.conf ar...
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
We're moving from on-premise to AWS - is there an easy way to migrate wall the tasks, projects, etc to the new instance?
3 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
2 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
The remote workers seem to insist on using old git credentials, even after I stopped them, updated the conf file, and restarted them using it. Are the creden...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Since v1.4.0, our StorageManager.download_folder(..., local_folder='./') is failing - we've had to revert back to 1.3.2. I saw the changelist includes a fix ...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
One more follow-up still; we're trying to run non-GPU scaler, and I've finally sorted out subnet and security groups issues, only to run into this: Executing...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Trying to run AWS autoscaler with poetry queue, and I get: Traceback (most recent call last): File "/root/.local/bin/poetry", line 5, in from poetry.console....
2 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
How does ClearML store some of the more intrinsic data (scalars, plots, etc)? We recently recovered Mongo from a backup and while the projects and tasks are ...
2 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
What happens to file that are downloaded to a remote_execution via StorageManager? Are they removed at the end of the run, or does it continuously increases ...
3 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
We have configured the AWS credentials in the remote worker's clearml.conf , but they are not available to third parties that use e.g. AWS_ACCESS_KEY . Is th...
2 years ago
0 Votes
27 Answers
2K Views
0 Votes 27 Answers 2K Views
Is there an autoscaler equivalent for K8s? That is, a service that will launch pods based on incoming requests?
2 years ago
Show more results questions
0 I Have Some Code That Launches Ml Tasks And It Accepts A Yaml File,

Also I appreciate the time youre taking to answer AgitatedDove14 and CostlyOstrich36 , I know Fridays are not working days in Israel, so thank you πŸ™‚

4 years ago
2 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

Okay this was a deep dive into clearml-agent code 😁
Took a long time to figure out that there was a specific Python version with a specific virtualenv that was old (Python 3.6.9 and Python 3.8 had latest virtualenv, but Python 3.7.5 had an old virtualenv).
Then the task requested to use Python 3.7, and that old virtualenv version was broken.

As a result -> Could the agent maybe also output the virtualenv version used with setting up the environment for the first time?

3 years ago
0 What Could Cause A Queue To Be Recreated Automatically? I Experimented With The Autoscaler With Queue Name

No, I have no running agents listening to that queue. It's as if it's retained in some memory somewhere and the server keeps creating it.

3 years ago
0 Since Clearml 1.6.3, A Dataset Attached To A Task Now Renames That Task By Adding A

SmugDolphin23 we've been working with this for 2 weeks now, and it creates a lot of junk in our UI. Is there anyway to have better control over this?

3 years ago
0 Does Clearml Somehow

SmugDolphin23 I think you can simply change not (type(deferred_init) == int and deferred_init == 0) to deferred_init is True ?

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

So some UI that shows the contents of users.get_all ?

3 years ago
0 Back To This

Hm, this didn't happen until now; I'd be happy to try again with a new version, but something with 1.4.0 broke our StorageManager, so we reverted to 1.3.2

3 years ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

There's no decorator, just e.g.

def helper(foo: Optional[Any] = None):
    return foo

def step_one(...):
    # stuff

Then the type hints are not removed from helper and the code immediately crashes when being run

2 years ago
0 We’Re Randomly Getting The Following Message -

That's what I thought @<1523701087100473344:profile|SuccessfulKoala55> , but the server URL is correct (and WebUI is functional and responsive).
In part of our code, we look for projects with a given name, and pull all tasks in that project. That's the crash point, and it seems to be related to having running tasks in that project.

2 years ago
0 I Have Some Code That Launches Ml Tasks And It Accepts A Yaml File,

The S3 bucket credentials are defined on the agent, as the bucket is also running locally on the same machine - but I would love for the code to download and apply the file automatically!

4 years ago
0 For Remote Execution Where The Queue Has

I understand, but then the toml file needs to be parsed to ensure poetry is used. It's just a tool entry in the pyproject.toml.

2 years ago
0 If I Create A Dataset With

On an unrelated note, when cloning an experiment via the WebUI, shouldn't the cloned experiment have the original experiment as a parent? It seems to be empty

3 years ago
0 Automatic Logging For Generated Matplotlib Works Nicely, But For Some Reason It Names The Graphs As "00 Untitled" And Uses Series "Plot Image" In Clearml Ui -- Any Way To Circumvent This, Other Than Explicit Reporting?

Sure! It's a bit intricate as it accommodates many of our different plotting functionalities, but this consists of the important bits (I realize we have some bad naming here, but fig[0] is actually a Figure object, and fig[1] is an Axes object):

` plt.switch_backend('agg')
sns.set_theme(...)
fig = plt.subplots(...)

sns.histplot(data, ax=fig[1], ...)
fig[1].set_xlim(...)
fig[1].set_ylim(...)
fig[1].legend(loc='best')
fig[1].set_xlabel(xlabel)
fig[1].set_ylabel(ylabel)
fig[1].set_...

3 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Not sure I understand your comment - why not let the user start with an empty comparison page and add them from "Add Experiment" button as well?

3 years ago
0 Trying To Run Aws Autoscaler With

SuccessfulKoala55 no that did not solve the issue 😞

2 years ago
0 Sometimes, On Shorter Tasks, My Task Would Hang For The 5 Minute Timeout With E.G.

Uhhh, not really unfortunately :white_frowning_face: . I have ~20 tasks happening in a single file, and it's quite random if/when this happens. I just noticed this tends to happen with the shorter tasks

3 years ago
0 Hi There, I Used

The Task.init is called at a later stage of the process, so I think this relates again to the whole setup process we've been discussing both here and in #340... I promise to try ;)

3 years ago
0 We’Re Running Clearml-Agent On K8S And I First Noticed Some Warnings From The Pod About Python 3.6..?

Any updates @<1523701087100473344:profile|SuccessfulKoala55> ? 🫣

2 years ago
0 Can Steps Be Removed From Pipelines, And/Or Can Pipelines Be Generally Modified Other Than Adding Steps To Them?

Dynamic pipelines in a notebook, so I don’t have to recreate a pipeline every time a step is changed πŸ€”

one year ago
3 years ago
Show more results compactanswers