Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Back to autoscaler; is there any way to ensure the environment variables on the services queue (where the scaler runs) will be automatically exposed to new E...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
What happens to file that are downloaded to a remote_execution via StorageManager? Are they removed at the end of the run, or does it continuously increases ...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
How does ClearML store some of the more intrinsic data (scalars, plots, etc)? We recently recovered Mongo from a backup and while the projects and tasks are ...
one year ago
0 Votes
0 Answers
998 Views
0 Votes 0 Answers 998 Views
I have a project filled with failed attempts at onboarding to clearml by now 😅
3 years ago
0 Votes
6 Answers
999 Views
0 Votes 6 Answers 999 Views
Soooo… the tooltip for some buttons in the WebUI hides the actual buttons 🤔 Any quick fixes?
one year ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
When using StorageManager.download_folder , I get the following error: Traceback (most recent call last): File "/home/idan/.clearml/venvs-builds/3.7/lib/pyth...
3 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there any way in the WebUI to search by task name? I see the search bar only goes through projects
3 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
We’re randomly getting the following message - 2023-03-07 11:07:26,123 [WARNING] [urllib3.connectionpool]: Retrying (Retry(total=237, connect=237, read=240, ...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
If we use a poetry queue and do not specify the agent.package_manager.poetry_version , will ClearML install/update anything? Asking because there are some is...
one year ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there a way to set precedence on package managers? If we set an agent to use poetry it will ignore local packages, even if I use the force_requirements_en...
2 years ago
0 Votes
4 Answers
981 Views
0 Votes 4 Answers 981 Views
Is there an easy way to apply the uncommitted changes, logged by ClearML, locally to a dev environment?
2 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Two things: The release of clearml-agent was not announced in 🤯 clearml-agent seems outdated wrt requirements, making poetry and clearml-agent incompatible:...
2 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
We use environment variables in our clearml.conf , but those might only be available later down the line (after dotenv.load_dotenv is called). When those env...
2 years ago
0 Votes
8 Answers
970 Views
0 Votes 8 Answers 970 Views
Is there a guide on how to deploy a services agent on a k8s setup? Specifically, with the CLI we use flags such as --services-mode --cpu-only , and I can’t s...
one year ago
0 Votes
6 Answers
951 Views
0 Votes 6 Answers 951 Views
Is there some automated migration for existing tasks from other MLOps frameworks to ClearML? (Specifically, interested in migrating from mlflow)
2 years ago
0 Votes
2 Answers
992 Views
0 Votes 2 Answers 992 Views
Can we use S3 buckets to cache environments?
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Our Mac users are having some issues. They have their respective ~/clearml.conf, and yet they get: ClearML 1.1.5 Traceback (most recent call last): ... File ...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
⚠️ ClearML version 1.8.1 had "fix" for the deferred init which introduces a bug btw, I've opened None to highlight this.
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Since ClearML 1.6.3, a dataset attached to a Task now renames that task by adding a .datasets in the path, making it hidden. Can we control/cancel this? We c...
2 years ago
0 Votes
27 Answers
990 Views
0 Votes 27 Answers 990 Views
Is there an autoscaler equivalent for K8s? That is, a service that will launch pods based on incoming requests?
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
If I create a dataset with Dataset.create(..., use_current_task=True) , that task holds the dataset. Can I then refer/copy/attach the same dataset to other t...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Since v1.4.0, our StorageManager.download_folder(..., local_folder='./') is failing - we've had to revert back to 1.3.2. I saw the changelist includes a fix ...
2 years ago
0 Votes
6 Answers
999 Views
0 Votes 6 Answers 999 Views
So the around app is also from ClearML? :shocked_face_with_exploding_head:
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
One more follow-up still; we're trying to run non-GPU scaler, and I've finally sorted out subnet and security groups issues, only to run into this: Executing...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Does the ClearML team still post updates in this channel when new ClearML versions come out? If not, what's the easiest way to keep track of various release ...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
How/where can I change the session timeout time for the WebUI? It's timing out WAY too fast after the latest updates
2 years ago
0 Votes
13 Answers
726 Views
0 Votes 13 Answers 726 Views
Can steps be removed from pipelines, and/or can pipelines be generally modified other than adding steps to them?
11 months ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Is it expected that K8s helm chart also starts a ClearML worker?
2 years ago
Show more results questions
3 years ago
0 Automatic Logging For Generated Matplotlib Works Nicely, But For Some Reason It Names The Graphs As "00 Untitled" And Uses Series "Plot Image" In Clearml Ui -- Any Way To Circumvent This, Other Than Explicit Reporting?

Sure! It's a bit intricate as it accommodates many of our different plotting functionalities, but this consists of the important bits (I realize we have some bad naming here, but fig[0] is actually a Figure object, and fig[1] is an Axes object):

` plt.switch_backend('agg')
sns.set_theme(...)
fig = plt.subplots(...)

sns.histplot(data, ax=fig[1], ...)
fig[1].set_xlim(...)
fig[1].set_ylim(...)
fig[1].legend(loc='best')
fig[1].set_xlabel(xlabel)
fig[1].set_ylabel(ylabel)
fig[1].set_...

2 years ago
0 Clearml Server V1.2.0 Has Just Been Released!

It was really easy with the attached code, really 👍

I would only maybe suggest adding in the documentation, that if one uses the default recommended install location, then the script can be run without any command line arguments.
I had to momentarily look at the code to see the default paths match my own (though I could've also looked at --help default values 😛 )

2 years ago
0 Clearml Server V1.2.0 Has Just Been Released!

FYI @<1523701087100473344:profile|SuccessfulKoala55> (or I might be doing something wrong), but it seems the python migration code comes with carriage returns, so it fails on linux by default (one has to tr -d '\r' to use it)

EDIT: And also it defaults to /opt/allegro/data rather than the recommended /opt/clearml/data which is suggested when installing the server 🤔

2 years ago
2 years ago
0 What Privileges/Iam Role Would The Aws Autoscaler Need?

No need for S3 or other resources?

2 years ago
0 Back To This

My code is done, it's hanging waiting for ClearML :E

2 years ago
0 Back To This

Hm, this didn't happen until now; I'd be happy to try again with a new version, but something with 1.4.0 broke our StorageManager, so we reverted to 1.3.2

2 years ago
0 Back To This

A couple of minutes or so

2 years ago
0 Back To This

Thanks for investigating this SweetBadger76 !

2 years ago
0 How Can I Send A Composed Chunk Of Code For Remote Execution

No worries @<1537605940121964544:profile|EnthusiasticShrimp49> ! I made some headway by using Task.create , writing a temporary Python script, and using task.update in a similar way to how pipeline steps are created.

I'll try and create an MVC to reproduce the issue, though I may have strayed from your original suggestion because I need to be able to use classes and not just functions.

11 months ago
0 Is There A Way To Generate Usage Stats And Reports For Queues? For Example, How Often Is A Queue Used, How Much Cpu Does

AgitatedDove14 Unfortunately not, the queues tab shows only the number of tasks, but not resources used in the queue . I can toggle between the different workers but then I don't get the full image.

2 years ago
0 When Using

Generally the StorageManager seems a bit slow, even a simple StorageManager.list(...) on a local path seems to take a long time

3 years ago
0 When Using

Any leads TimelyPenguin76 ? I've also tried setting up a minio s3 bucket, but I'm not sure if the remote agent has copied the credentials and host 🤔

3 years ago
0 Is It Expected That K8S Helm Chart Also Starts A Clearml Worker?

Can I query where the worker is running (IP)?

2 years ago
0 Is It Expected That K8S Helm Chart Also Starts A Clearml Worker?

That's probably in the newer ClearML server pages then, I'll have to wait still 😅

2 years ago
0 When Using

Ubuntu 18.04, latest clearml version

3 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

A follow up question (instead of opening a new thread), is there a way I could signal some files/directories to be copied to the execute_remotely task?

3 years ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

I'm aware, but it would be much cleaner to define them in the worker's clearml.conf and let ClearML expose them locally to running tasks.

EDIT: Also the above is specifically about serving, which is not the target here 🤔 At least not yet 😄

2 years ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

Thanks SuccessfulKoala55 , I made https://github.com/allegroai/clearml-agent/issues/126 as a suggestion.

Do you have any thoughts on how to expose these... manually?
It does so already for environment variables that prefixed with CLEARML_ , so it would be nice to have some control over that.

2 years ago
0 I'M Trying To Set Up Some Initial Experiments Within Our Stack, But When I Use The

Thanks for your help SuccessfulKoala55 ! Appreciate the patience 🙏

3 years ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

Thanks SuccessfulKoala55 ! Is this listed anywhere in the documentation?
Could I set an environment variable there and then refer to it internally in the config with the ${...} notation?

I see https://github.com/allegroai/clearml-agent/blob/d2f3614ab06be763ca145bd6e4ba50d4799a1bb2/clearml_agent/backend_config/utils.py#L23 but not where it's called 🤔

2 years ago
0 Hello Community, Can I Run Multiple Clearml Agent From One Machine??

You don't even need to set the CLEARML_WORKER_ID, it will automatically assign one based on the machine's name

one year ago
0 Since V1.4.0, Our

One more thing that may be helpful SweetBadger76 , I've gone ahead and looked into clearml.storage.helper , and found that at least if I specify the bucket name directly in the aws.s3.credentials configuration for MinIO, then:
In [4]: StorageHelper._s3_configurations.get_config_by_uri(' ` ')
Out[4]: S3BucketConfig(bucket='clearml', host='some_ip:9000', key='xxx', secret='xxx', token='', multipart=False, acl='', secure=False, region='', verify=True, use_credentials_chain=False)...

2 years ago
Show more results compactanswers