Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
19 Answers
2K Views
0 Votes 19 Answers 2K Views
For remote execution where the queue has poetry as the default package manager, can the user decide to e.g. ignore the lock file?
2 years ago
0 Votes
29 Answers
2K Views
0 Votes 29 Answers 2K Views
We're trying to use the AWS autoscaler and have managed to get it up and running with spinning up instances. However, it does not seem to pull any of the tas...
3 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
If I create a dataset with Dataset.create(..., use_current_task=True) , that task holds the dataset. Can I then refer/copy/attach the same dataset to other t...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
We're running into errors such as this: Action failed <500/0: tasks.add_or_update_artifacts/v2.10 (Update failed (BSONObj size: 18564134 (0x11B4426) is inval...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
How does ClearML store some of the more intrinsic data (scalars, plots, etc)? We recently recovered Mongo from a backup and while the projects and tasks are ...
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Trying to run AWS autoscaler with poetry queue, and I get: Traceback (most recent call last): File "/root/.local/bin/poetry", line 5, in from poetry.console....
2 years ago
0 Votes
12 Answers
2K Views
0 Votes 12 Answers 2K Views
When uploading an artifact, can I list it in some grouping (like with parameters, having e.g. Args/foo , Args/bar )?
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
We’re randomly getting the following message - 2023-03-07 11:07:26,123 [WARNING] [urllib3.connectionpool]: Retrying (Retry(total=237, connect=237, read=240, ...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
I'd like the CONSOLE in a ClearML run to show only the stdout/stderr as it does now, but I'd also like ClearML to capture DEBUG level logs. Is there an easy ...
3 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
We’re running clearml-agent on k8s and I first noticed some warnings from the pod about Python 3.6..? > /usr/lib/python3/dist-packages/secretstorage/dhcrypto...
2 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
What happens to file that are downloaded to a remote_execution via StorageManager? Are they removed at the end of the run, or does it continuously increases ...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Since v1.4.0, our StorageManager.download_folder(..., local_folder='./') is failing - we've had to revert back to 1.3.2. I saw the changelist includes a fix ...
3 years ago
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
Does ClearML somehow remove any loggers from logging module? We suddenly noticed that we have some handlers missing when running in ClearML
2 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Is there any testing suite that ships with ClearML? If we'd like to make some unit tests for our code?
3 years ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Can I somehow change a project settings via the Python SDK?
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
How/where can I change the session timeout time for the WebUI? It's timing out WAY too fast after the latest updates
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
I encountered a weird edge case with the AWS Auto-scaler, wondering if there are any solutions or if this is a known issue. Something as follows happened: Th...
3 years ago
0 Votes
28 Answers
2K Views
0 Votes 28 Answers 2K Views
3 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
The remote workers seem to insist on using old git credentials, even after I stopped them, updated the conf file, and restarted them using it. Are the creden...
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Can we use S3 buckets to cache environments?
3 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
ClearML 1.3.2 I'm running Task.get_tasks(project_name=...) and suddenly I get 2022-04-07 10:28:43,617 - clearml.Task - ERROR - Failed reloading task c2d514f3...
3 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
How do I stop a zombie agent? πŸ€” I see it in clearml-agent list , but I do not see it in ps aux and when I try clearml-agent daemon --stop , I get Could not ...
3 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Good week ClearML team πŸ™‚ I have found two more WebUI bugs (on the self-hosted server): If I look at a specific experiment (say, the Artifacts tab), and then...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Getting a weird error on local setup for ClearML Server: 2022-03-30 08:07:07,932 - clearml.Task - ERROR - Action failed <500/0: tasks.get_all/v1.0 (mongo:270...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Is there a GCP driver similar to aws_driver.py ? None
one year ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Confirming about the documentation for clearml.conf : > agent.enable_task_env > ( > bool > ) Set the OS environments based on the Task's Environment section ...
3 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Weird encounter on macOS (local execution, rerunning after it failed - worked normally): Traceback (most recent call last): File "/Users/.../repositories/......
3 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
If we use a poetry queue and do not specify the agent.package_manager.poetry_version , will ClearML install/update anything? Asking because there are some is...
2 years ago
Show more results questions
3 years ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

That's enabled; I was aiming if there are flags to add to pip install CLI, such as --no-use-pep517

3 years ago
0 Is There An Autoscaler Equivalent For K8S? That Is, A Service That Will Launch Pods Based On Incoming Requests?

Right, so where can one find documentation about it?
The repo just has the variables with not much explanations.

2 years ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

… And it’s failing on typing hints for functions passed in pipe.add_function_step(…, helper_function=[…]) … I guess those aren’t being removed like the wrapped function step?

2 years ago
0 We'Re Using Ray And Clearml Together, And Suddenly We'Re Seeing Some Hanging Threads, And Finally We Got An Error Message:

If that's the case, wouldn't it apply across the board? This happens in a single task within ray - the other tasks (I have many in a single run) are fine

3 years ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

Odd; switching to virtual environment results in
fatal: could not read Username for ' ': terminal prompts disabledeven though it does earlier show that:
agent.git_user = xxx

3 years ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

Nope, no .netrc defined anywhere, really (+I've abandoned the use of docker for the autoscaler as it complicates things, at least for now)

3 years ago
0 Is There A Guide On How To Deploy A Services Agent On A K8S Setup? Specifically, With The Cli We Use Flags Such As

And actually it fails on quite many tasks for us with this Python 3.6.
I tried to set up a different image ( agent8sglue.defaultContainerImage: "ubuntu:20.04" ) but that did not change much.
I suspect the culprit is agentk8sglue.image , which is set to tag 1.24-21 of clearml-agent-k8s-base . That image is quite very old… Any updates on that? πŸ€”

2 years ago
0 <Edited> Two Things:

The last kind when launching the agents.
The former on task execution.

2 years ago
0 Is It Possible To Set Values In Clearml Config File Programmatically? Specifically

I think the environment variables path might work for you then?
You'd set your config with
use_credentials_chain: ${CREDENTIALS_CHAIN} Then in Python you could os.environ['CREDENTIALS_CHAIN'] = True/False before you make any calls to ClearML?

3 years ago
0 Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.

2 years ago
0 I Realize I'M Asking Many Niche Questions - My Apologies

Follow up on this btw, from the WebUI/Server POV, I see there's an "Admin" role, etc. Do those have additional views available, such as users etc?

3 years ago
0 Hello! What Considerations Are There To Upgrading Clearml Kubernetes Installation From 1.6.0 To 1.7.0? Will It Suffice To Just Update The Image_Tag Within The Helm Charts And Keep Rest Of The Config As It Was? Br, -Ville P.

Following up on that (I don't think the K8s helm chart for 1.7.0 is out yet SlimyDove85 , is it?) - but what's the recommended way to backup the mongodb before upgrading on K8s?

3 years ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

The api.files_server is set to the MinIO endpoint s3://ip:9000/clearml (both locally and remotely) The sdk.development.default_output_uri is set to the MinIO endpoint (both locally and remotely) When we call Task.init I do not set the output_uri at all I get the logger directly with task.get_logger()

3 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

It does, but I don't want to guess the json structure (what if ClearML changes it or the folder structure it uses for offline execution?). If I do this, I'm planning a test that's reliant on ClearML implementation of offline mode, which is tangent to the unit test

3 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

Hm, that seems less than ideal. I was hoping I could pass some CSV locations. I'll try and find a workaround for that. Thanks!

4 years ago
0 Are The Docs Broken?

No, fixed πŸ™‚

3 years ago
0 Hi All, I Try To Pass Secrets From My Local Machine To A Remote Agent. I'M Using The

I know the ClearML enterprise offers a vault.
If these are static-ish, you can set them directly in the agent's config file.
If not, what we did was that before executing remotely, we uploaded environment variables of interest as parameters, and then loaded them in the remote task.
These can then be overwritten with *** after loading them.

2 years ago
0 When Uploading An Artifact, Can I List It In Some Grouping (Like With Parameters, Having E.G.

Hey FrothyDog40 ! Thanks for clarifying - guess we'll have to wait for that as a feature 😁

Should I create a new issue or just add to this one? https://github.com/allegroai/clearml/issues/529

3 years ago
3 years ago
0 Does Clearml Somehow

But it is strictly that if condition in Task.init, see the issue I opened about it

2 years ago
0 Does Anyone Know How We Can Restore Clearml On Helms Chart From Existing Snapshots (Aws)?

Actually, it appears some elements (scalars, plots, etc) have no migrated by moving mongodb data.
Where are these stored? Any idea @<1523701827080556544:profile|JuicyFox94> ?

2 years ago
0 When Uploading An Artifact, Can I List It In Some Grouping (Like With Parameters, Having E.G.

The SDK is fine as it is - I'm more looking at the WebUI at this point

3 years ago
0 Hi, I Updated To Clearml-Server 1.4.0 And I Am Uncomfortable With The New Table/Detail View, Is There A Way To Disable It And Use The Previous One (On Click -> Open Details)?

JitteryCoyote63 please do not get used to it :D there's an open ticket/feature request to either revert this or let the user/server choose the most comfortable way

3 years ago
Show more results compactanswers