Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
When I upgrade the server, do I need to do anything with the agents/queues (redefine them, etc)?
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
We're running into errors such as this: Action failed <500/0: tasks.add_or_update_artifacts/v2.10 (Update failed (BSONObj size: 18564134 (0x11B4426) is inval...
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
!! In remote execution, do agents inherit the config from the queue from which they pull the task?
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Is there a way to force ClearML to first parse the config file, before running Task.init ? We’re relying in some code that the credentials in clearml.conf ar...
one year ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
When uploading an artifact, can I list it in some grouping (like with parameters, having e.g. Args/foo , Args/bar )?
2 years ago
0 Votes
2 Answers
982 Views
0 Votes 2 Answers 982 Views
Can we use S3 buckets to cache environments?
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Confirming about the documentation for clearml.conf : > agent.enable_task_env > ( > bool > ) Set the OS environments based on the Task's Environment section ...
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
How do I stop a zombie agent? 🤔 I see it in clearml-agent list , but I do not see it in ps aux and when I try clearml-agent daemon --stop , I get Could not ...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there any testing suite that ships with ClearML? If we'd like to make some unit tests for our code?
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
ClearML 1.3.2 I'm running Task.get_tasks(project_name=...) and suddenly I get 2022-04-07 10:28:43,617 - clearml.Task - ERROR - Failed reloading task c2d514f3...
2 years ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
For remote execution where the queue has poetry as the default package manager, can the user decide to e.g. ignore the lock file?
2 years ago
0 Votes
14 Answers
998 Views
0 Votes 14 Answers 998 Views
Automatic logging for generated matplotlib works nicely, but for some reason it names the graphs as "00 untitled" and uses series "plot image" in ClearML UI ...
2 years ago
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
We’re running clearml-agent on k8s and I first noticed some warnings from the pod about Python 3.6..? > /usr/lib/python3/dist-packages/secretstorage/dhcrypto...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Does ClearML have any suggestions on GPU and non-GPU AMIs for the AutoScaler? The two default ones in the documentation are either: Non-existent (too old) - ...
2 years ago
0 Votes
3 Answers
983 Views
0 Votes 3 Answers 983 Views
side question - any plans to include native support for lgbm ?
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
If I create a dataset with Dataset.create(..., use_current_task=True) , that task holds the dataset. Can I then refer/copy/attach the same dataset to other t...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Trying to run AWS autoscaler with poetry queue, and I get: Traceback (most recent call last): File "/root/.local/bin/poetry", line 5, in from poetry.console....
one year ago
0 Votes
6 Answers
991 Views
0 Votes 6 Answers 991 Views
Soooo… the tooltip for some buttons in the WebUI hides the actual buttons 🤔 Any quick fixes?
one year ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Two things: The release of clearml-agent was not announced in 🤯 clearml-agent seems outdated wrt requirements, making poetry and clearml-agent incompatible:...
2 years ago
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
How would I go about adding multiple credentials in the autoscaler? (i.e. specify multiple sdk.aws.s3.credentials ) It's a bit odd that one would also have t...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Sometimes, on shorter tasks, my Task would hang for the 5 minute timeout with e.g. 2022-01-04 08:45:25,181 - clearml.Task - INFO - Waiting for repository det...
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Is there a way to interface with ClearML agent (CLI?) to handle model repositories and data versioning (but so, not experimentation, tight integration, pipel...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
I think something is messed up in my remote agents environment, could someone lend a hand? I'm getting this during remote execution (poetry queue): Summary -...
one year ago
0 Votes
2 Answers
976 Views
0 Votes 2 Answers 976 Views
Can one delete individual tasks from the WebUI?
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
For some reason the agent is now trying to use Python 2.7 all of a sudden, any idea why? 🤔 I see the following in the task's console output: New python exec...
2 years ago
0 Votes
3 Answers
992 Views
0 Votes 3 Answers 992 Views
Can we temporarily disable the autologging feature? (specifically for matplotlib ?)
one year ago
0 Votes
23 Answers
977 Views
0 Votes 23 Answers 977 Views
Back to this ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 😢 Hanging for the past ~45m like this
2 years ago
0 Votes
6 Answers
997 Views
0 Votes 6 Answers 997 Views
... and yet another 😄 When using the UI with regex to search for experiments, due to the greedy nature of the search, it consistently pops up the "ERROR Fet...
2 years ago
0 Votes
6 Answers
948 Views
0 Votes 6 Answers 948 Views
Is there some automated migration for existing tasks from other MLOps frameworks to ClearML? (Specifically, interested in migrating from mlflow)
2 years ago
Show more results questions
0 Is It Possible To Set Values In Clearml Config File Programmatically? Specifically

I think the environment variables path might work for you then?
You'd set your config with
use_credentials_chain: ${CREDENTIALS_CHAIN} Then in Python you could os.environ['CREDENTIALS_CHAIN'] = True/False before you make any calls to ClearML?

2 years ago
0 Is It Possible To Set Values In Clearml Config File Programmatically? Specifically

StaleButterfly40 what use case are you looking for? I've used environment variables in the config file and then I can overwrite them in os.environ before ClearML loads the config

2 years ago
0 Is It Possible To Set Values In Clearml Config File Programmatically? Specifically

I thought this follows from our previous discussion SuccessfulKoala55 , where this is a built-in feature of pyhocon?

2 years ago
0 <Edited> Two Things:

There's not much (or anything) in the log to provide...

` (.venv) 15:42 [0:user@server$~] CLEARML_CONFIG_FILE=~/agent_clearml.conf clearml-agent daemon --queue default on_prem --detached --order-fairness
Environment variables set from configuration: ['AWS_ACCESS_KEY_ID', 'AWS_SECRET_ACCESS_KEY', 'AWS_DEFAULT_REGION']
...

2 years ago
0 <Edited> Two Things:

Sorry for the late reply Jake -- I was away on holidays -- it works perfectly now, thanks!

2 years ago
0 Our Mac Users Are Having Some Issues. They Have Their Respective ~/Clearml.Conf, And Yet They Get: Clearml 1.1.5

The agent also uses a different clearml.conf , so it should not matter?

2 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

Most of these are configurations (specific for an execution, but one such configuration defines multiple tasks). Some models might be uploaded if the user does not use our built-in link to ClearML model fetching 😄

2 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

I didn't mention code in #340 nor did I mention data here 😄 The idea was to package non git-specific files for remote execution

2 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

Honestly, this is all related to issue #340. The only reason we have this to begin with is because we need one separate "initializer" task that downloads the remote cache and prepares the agent environment for execution (downloading the configuration files, etc).
Otherwise it fits perfectly with pipelines, but we're not there yet.

In the local execution we don't have this initializer task, so we use Task.init() before starting to work on a model, and task.close() when we're done....

2 years ago
0 <Edited> Two Things:

Hm, I did not specify any specific versions previously. What was the previous default?

2 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

And yes, our flow would break anyway with the internal references within the yaml file. It would be much simpler if we could specify the additional files

2 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

The new task is not running inside a new subprocess. Our platform trains several models, and we'd like each of them to be tracked in their own Task . When running locally, this is "out of the box", as we can init and close before and after each model.
When running remotely, one cannot close the main task (since it is what orchestrates everything), and so this workaround was needed.

2 years ago
2 years ago
0 For Remote Execution Where The Queue Has

With clearml-agent 1.5.1

2 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

I'll kill the agent and try again but with the detached mode 🤔

3 years ago
0 Back To This

Erm, one sec, let me find that thread...

2 years ago
0 For Remote Execution Where The Queue Has

It seems that the agent uses the remote repository 's lock file. We've removed and renamed the file locally (caught under local changes), but it still installs from the remote lock file 🤔

2 years ago
0 Is There An Easy Way To Add A Link To One Of The Tasks Panels? (As An Artifact, Configuration, Info, Etc)? Edit: And Follow Up Regarding The Dataset. As Discussed Somewhere Previously, The Datasets Are Now Automatically Moved To A Hidden "Sub-Project" Pr

For now we've monkey-patched it to our usecase:

` Dataset._Dataset__hidden_tag = "active"

    def foo(cls, dataset_project, dataset_name):
        dataset_project = dataset_project or "Datasets"
        return dataset_project, dataset_project.rpartition("/")[0]

    Dataset._build_hidden_project_name = foo `
2 years ago
0 For Remote Execution Where The Queue Has

The poetry.lock in github, it seems 🤔

2 years ago
0 For Remote Execution Where The Queue Has

Here's an example where poetry.lock is removed, and still the console reads:
url: .... branch: HEAD commit: 22fffaf8d5f377b7f10140e642a7f6f26b72ffaa root: /.../.clearml/venvs-builds/3.10/task_repository/... Applying uncommitted changes Poetry Enabled: Ignoring requested python packages, using repository poetry lock file! Creating virtualenv ds-platform in /.../.clearml/venvs-builds/3.10/task_repository/.../.venv Updating dependencies Resolving dependencies...

one year ago
0 Back To This

Still happening with 1.4.1 SuccessfulKoala55

2 years ago
Show more results compactanswers