Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
!! In remote execution, do agents inherit the config from the queue from which they pull the task?
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
How do I stop a zombie agent? 🤔 I see it in clearml-agent list , but I do not see it in ps aux and when I try clearml-agent daemon --stop , I get Could not ...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there any testing suite that ships with ClearML? If we'd like to make some unit tests for our code?
2 years ago
0 Votes
3 Answers
983 Views
0 Votes 3 Answers 983 Views
side question - any plans to include native support for lgbm ?
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
2 years ago
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
How would I go about adding multiple credentials in the autoscaler? (i.e. specify multiple sdk.aws.s3.credentials ) It's a bit odd that one would also have t...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
For some reason the agent is now trying to use Python 2.7 all of a sudden, any idea why? 🤔 I see the following in the task's console output: New python exec...
2 years ago
0 Votes
6 Answers
948 Views
0 Votes 6 Answers 948 Views
Is there some automated migration for existing tasks from other MLOps frameworks to ClearML? (Specifically, interested in migrating from mlflow)
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Pipelines suddenly no longer appear in the Pipelines tab, what could/should I look into? EDIT: Using latest ClearML (agent, server, SDK), and creating the pi...
one year ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
We use environment variables in our clearml.conf , but those might only be available later down the line (after dotenv.load_dotenv is called). When those env...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I'm trying to set up some initial experiments within our stack, but when I use the execute_remotely task, I get this error: clearml_agent: ERROR: Failed gett...
3 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Any easy way to ensure the pipline (tasks + controller) are not hidden in the projects UI? EDIT: Apparently not; for the time being I created this https://gi...
one year ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
What would be the best way to approach this flow? We have a configuration file that defines e.g. the project name to use in ClearML, alongside other experime...
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is it possible to avoid the clearml-agent for local installations, and have the file server automatically use an S3 bucket? I've found https://clearml.slack....
3 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Can we use dynamodb with ClearML helm charts instead of mongodb? We'd like to move all stateful storage to AWS as a separate service and that would be a nice...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Sometimes, on shorter tasks, my Task would hang for the 5 minute timeout with e.g. 2022-01-04 08:45:25,181 - clearml.Task - INFO - Waiting for repository det...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
We're running into errors such as this: Action failed <500/0: tasks.add_or_update_artifacts/v2.10 (Update failed (BSONObj size: 18564134 (0x11B4426) is inval...
2 years ago
0 Votes
7 Answers
949 Views
0 Votes 7 Answers 949 Views
Is there a way to generate usage stats and reports for queues? For example, how often is a queue used, how much CPU does the queue consume when it's used, et...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Follow up on execute_remotely, I see one can limit the available GPU resources in a worker daemon; could one also limit the number of CPU cores available?
2 years ago
0 Votes
7 Answers
996 Views
0 Votes 7 Answers 996 Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
If I create a dataset with Dataset.create(..., use_current_task=True) , that task holds the dataset. Can I then refer/copy/attach the same dataset to other t...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
How does ClearML store some of the more intrinsic data (scalars, plots, etc)? We recently recovered Mongo from a backup and while the projects and tasks are ...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Is it expected that K8s helm chart also starts a ClearML worker?
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there anywhere in the web UI where one can see the clearml server version running? I keep getting "version 1.1.1 is now available" even though I'm pretty ...
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Bug report? We noticed that the AWS autoscaler will lose track of instances crashing due to no space left on device, and the ec2 instance will remain running...
one year ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Does ClearML somehow remove any loggers from logging module? We suddenly noticed that we have some handlers missing when running in ClearML
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Are the docs broken? https://clear.ml/docs/latest/docs/release_notes/ver_1_7 gives me this
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
If we use a poetry queue and do not specify the agent.package_manager.poetry_version , will ClearML install/update anything? Asking because there are some is...
one year ago
Show more results questions
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

That doesn't make sense? 🤔
Maybe I was not clear, but it's a simple part of the config file.

2 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

I guess it's mixed. If #340 is resolved, then this initializer task will be a no-op: detach, and init-close new tasks as needed.

2 years ago
0 If I Clone A Task, I Suppose All Artifacts Are Not Cloned With It, Even If They Are Registered, Right?

Yes, thanks AgitatedDove14 ! It's just that the configuration object passed onwards was a bit confusing.
Is there a planned documentation overhaul? 🤔

2 years ago
0 Is There Any Way In The Webui To Search By Task Name? I See The Search Bar Only Goes Through Projects

I mean, if I search for "model", will it automatically search for tasks containing "model" in their name?

2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

If I set the following:
"extra_clearml_conf": "sdk.aws.s3.credentials = [\n{\nhost: 'ip:9000'\nkey: 'xxx'\nsecret: 'xxx'\nmultipart: false\nsecure: false\n},\n{\nhost: 'ip2:9000'\nkey: 'xxx'\nsecret: 'xxx'\nmultipart: false\nsecure: false\n}\n]"I run into a weird furl error:
ValueError: Invalid port '9000''.

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

Coming back to this; ClearML prints a lot of error messages in local tests, supposedly because the output streams are not directly available:
` --- Logging error ---
Traceback (most recent call last):
File "/usr/lib/python3.10/logging/init.py", line 1103, in emit
stream.write(msg + self.terminator)
ValueError: I/O operation on closed file.
Call stack:
File "/home/idan/CC/git/ds-platform/.venv/lib/python3.10/site-packages/clearml/task.py", line 3504, in _at_exit
self.__shutdown...

2 years ago
0 So The Around App Is Also From Clearml?

Or is just integrated in the ClearML slack space and for some reason it's showing the clearml address then?

3 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Not sure I understand your comment - why not let the user start with an empty comparison page and add them from "Add Experiment" button as well?

2 years ago
0 How Do I Stop A Zombie Agent?

Literally just as you said it - it happened

2 years ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

I'm aware, but it would be much cleaner to define them in the worker's clearml.conf and let ClearML expose them locally to running tasks.

EDIT: Also the above is specifically about serving, which is not the target here 🤔 At least not yet 😄

2 years ago
0 Soooo… The Tooltip For Some Buttons In The Webui Hides The Actual Buttons

Any simple ways around this for now? @<1523701070390366208:profile|CostlyOstrich36>

one year ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

So a missing bit of information that I see I forgot to mention, is that we named our packages as foo-mod in pyproject.toml . That hyphen then get’s rewritten as foo_mod.x.y.z-distinfo .

foo-mod @ git+
one year ago
0 Hi, How Can I Log A Metrcis Consists Of One Number?

You can use logger.report_scalar and pass a single value.

3 years ago
0 What Would Be The Best Way To Approach This Flow?

And task = Task.init(project_name=conf.get("project_name"), ...) is basically a no-op in remote execution so it does not matter if conf is empty, right?

2 years ago
0 What Would Be The Best Way To Approach This Flow?

BTW AgitatedDove14 following this discussion I ended up doing the regex way myself to sync these, so our code has something like the following. We abuse the object description here to store the desired file path.

` config_path = task.connect_configuration(configuration=config_path, name=config_fname)
included_files = find_included_files_in_source(config_path)
while included_files:
file_to_include = included_files.pop()
sub_config = task.connect_configuration(
configurat...

2 years ago
0 What Would Be The Best Way To Approach This Flow?

Now, the original pyhocon does support include statements as you mentioned - https://github.com/chimpler/pyhocon

2 years ago
0 Weird Error; My Local Execution Hung With

It misses the repository information of course, but the 'configuration/Args' were logged. So something weird in identifying the repository

2 years ago
0 Does Clearml Exposes (Even Temporarily) The Contents Of E.G.

Because setting env vars and ensuring they exist on the remote machine during execution etc is more complicated 😁

There are always ways around, I was just wondering what is the expected flow 🙂

2 years ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

` # test_clearml.py
import pytest
import shutil
import clearml

@pytest.fixture
def clearml_task():
clearml.Task.set_offline_mode(True)
task = clearml.Task.init(project_name="test", task_name="test")
yield task
shutil.rmtree(task.get_offline_mode_folder())
clearml.Task.set_offline_mode(False)

class ClearMLTests:
def test_something(self, clearml_task):
assert True run with pytest test_clearml.py `

2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

UPDATE: Apparently the quotation type matters for furl ? I switched the ' to \" and it seems to work now

2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

Since the additional credentials are available to the autoscaler when it boots up (via the config file), I thought it could use those natively?

2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

Does that make sense CostlyOstrich36 ? Any thoughts on how to treat this? For the time being I'm also perfectly happy to include something specific to extra_clearml_conf , but I'm not sure how to set the sdk.aws.s3.credentials to be a list of dictionaries as needed

2 years ago
0 More Clarification On Documentation (Clearml Data):

Would be great if it is 😍 We have few files that change frequently and are quite large in size, and it would be quite a storage hit to save all of them

2 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

I also tried setting agent.python_binary: "/usr/bin/python3.8" but it still uses Python 2.7?

2 years ago
0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

TimelyPenguin76 CostlyOstrich36 It seems a lot of manual configurations is required to get the EC2 instances up and running.
Would it not make sense to update the autoscaler (and example script) so that the config.yaml that's used for the autoscaler service is implicitly copied to the EC2 services, and then any extra_clearml_conf are used/overwritten?

2 years ago
0 I Have Some Code That Launches Ml Tasks And It Accepts A Yaml File,

I'm not sure I follow, how would that solution look like?

3 years ago
Show more results compactanswers