Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
How would I go about adding multiple credentials in the autoscaler? (i.e. specify multiple sdk.aws.s3.credentials ) It's a bit odd that one would also have t...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Sometimes, on shorter tasks, my Task would hang for the 5 minute timeout with e.g. 2022-01-04 08:45:25,181 - clearml.Task - INFO - Waiting for repository det...
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Is there a way to interface with ClearML agent (CLI?) to handle model repositories and data versioning (but so, not experimentation, tight integration, pipel...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
I think something is messed up in my remote agents environment, could someone lend a hand? I'm getting this during remote execution (poetry queue): Summary -...
one year ago
0 Votes
2 Answers
976 Views
0 Votes 2 Answers 976 Views
Can one delete individual tasks from the WebUI?
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
For some reason the agent is now trying to use Python 2.7 all of a sudden, any idea why? ๐Ÿค” I see the following in the task's console output: New python exec...
2 years ago
0 Votes
3 Answers
992 Views
0 Votes 3 Answers 992 Views
Can we temporarily disable the autologging feature? (specifically for matplotlib ?)
one year ago
0 Votes
23 Answers
977 Views
0 Votes 23 Answers 977 Views
Back to this ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start ๐Ÿ˜ข Hanging for the past ~45m like this
2 years ago
0 Votes
6 Answers
997 Views
0 Votes 6 Answers 997 Views
... and yet another ๐Ÿ˜„ When using the UI with regex to search for experiments, due to the greedy nature of the search, it consistently pops up the "ERROR Fet...
2 years ago
0 Votes
6 Answers
948 Views
0 Votes 6 Answers 948 Views
Is there some automated migration for existing tasks from other MLOps frameworks to ClearML? (Specifically, interested in migrating from mlflow)
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Pipelines suddenly no longer appear in the Pipelines tab, what could/should I look into? EDIT: Using latest ClearML (agent, server, SDK), and creating the pi...
one year ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
We use environment variables in our clearml.conf , but those might only be available later down the line (after dotenv.load_dotenv is called). When those env...
2 years ago
0 Votes
6 Answers
995 Views
0 Votes 6 Answers 995 Views
So the around app is also from ClearML? :shocked_face_with_exploding_head:
3 years ago
0 Votes
2 Answers
568 Views
0 Votes 2 Answers 568 Views
Is there a GCP driver similar to aws_driver.py ? None
9 months ago
0 Votes
4 Answers
977 Views
0 Votes 4 Answers 977 Views
Weird error; my local execution hung with ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 2022-03-07 ...
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Does ClearML somehow remove any loggers from logging module? We suddenly noticed that we have some handlers missing when running in ClearML
2 years ago
0 Votes
7 Answers
994 Views
0 Votes 7 Answers 994 Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
one year ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I'm trying to set up some initial experiments within our stack, but when I use the execute_remotely task, I get this error: clearml_agent: ERROR: Failed gett...
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Is there a way to set precedence on package managers? If we set an agent to use poetry it will ignore local packages, even if I use the force_requirements_en...
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
How/where can I change the session timeout time for the WebUI? It's timing out WAY too fast after the latest updates
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Can we use dynamodb with ClearML helm charts instead of mongodb? We'd like to move all stateful storage to AWS as a separate service and that would be a nice...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Bug report? We noticed that the AWS autoscaler will lose track of instances crashing due to no space left on device, and the ec2 instance will remain running...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
The remote workers seem to insist on using old git credentials, even after I stopped them, updated the conf file, and restarted them using it. Are the creden...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Is there any way (or are there any plans) to include some view for datasets in the WebUI? One that is detached from the generating task?
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
We have configured the AWS credentials in the remote worker's clearml.conf , but they are not available to third parties that use e.g. AWS_ACCESS_KEY . Is th...
2 years ago
0 Votes
24 Answers
619 Views
0 Votes 24 Answers 619 Views
How can I send a composed chunk of code for remote execution from within a notebook ?
11 months ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Any plans to add support for MultiIndex tables? That comma-separation feels a bit odd. (Also this shows up in plots while in the scalars tab I actually have ...
3 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Any easy way to ensure the pipline (tasks + controller) are not hidden in the projects UI? EDIT: Apparently not; for the time being I created this https://gi...
one year ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
What happens to file that are downloaded to a remote_execution via StorageManager? Are they removed at the end of the run, or does it continuously increases ...
2 years ago
Show more results questions
2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Also (sorry for all of these!) - could be nice to have a direct "task comparison" link in the UI somewhere, that would open a comparison with no tasks and the user can add them manually using the "add experiments" button. :)

2 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

For example, can't interact with these two tasks from this view (got here from searching in the dashboard view; they're in different projects):

2 years ago
0 How Can I Send A Composed Chunk Of Code For Remote Execution

Hey @<1537605940121964544:profile|EnthusiasticShrimp49> ! Youโ€™re mostly correct. The Step classes will be predefined (of course developers are encouraged to add/modify as needed), but as in the DataTransformationStep , there may be user-defined functions specified. Thatโ€™s not a problem though, I can provide these functions with the helper_functions argument.

  • The .add_function_step is indeed a failing point. I canโ€™t really create a task from the notebook because calling `Ta...
10 months ago
0 Hi All, I Try To Pass Secrets From My Local Machine To A Remote Agent. I'M Using The

For the former (static-ish environment variables), just add:

environment {
  VAR1: value1
  VAR2: value2
}

to the agentโ€™s clearml.conf

one year ago
0 We'Re Trying To Upgrade Our Clearml On K8S But We'Re Getting This Error -

For now this is okay - no data lost, really - but I'd like to make sure we're not missing any steps in the next upgrade

2 years ago
0 We'Re Trying To Upgrade Our Clearml On K8S But We'Re Getting This Error -

Removing the PVC is just setting the state to absent AFAIK

2 years ago
0 Is There Any Way (Or Are There Any Plans) To Include Some View For Datasets In The Webui? One That Is Detached From The Generating Task?

I see! The Hyper Datasets don't really fit our use case - it seems really focused on CNNs and image-based data, but lacking support for database-oriented tabular data.

So for now we mainly work with parquet and CSV files, and I was hoping there'd be an easy way to view those... I'll make a workaround with a "Datasets" project I suppose!

2 years ago
0 Is There An Easy Way To Apply The Uncommitted Changes, Logged By Clearml, Locally To A Dev Environment?

Yes exactly, but I guess I could've googled for that ๐Ÿ˜…

Copy the uncommitted changes captured by ClearML using the UI, write to changes.patch , run git apply changes.patch ๐Ÿ‘

2 years ago
0 Since Clearml 1.6.3, A Dataset Attached To A Task Now Renames That Task By Adding A

It also happens when use_current_task=False though. So the current best approach would be to not combine the task and the dataset?

2 years ago
0 Is There A Way To Set Precedence On Package Managers? If We Set An Agent To Use

Hmmm maybe ๐Ÿค” I thought that was expected behavior from poetry side actually

2 years ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

How or why is this the issue? I great something is getting lost in translation :D
On the local machine, we have all the packages needed. The code gets sent for remote execution, and all the local packages are frozen correctly with pip.
The pipeline controller task is then generated and executed remotely, and it has all the relevant packages.
Each component it launches, however, is missing the internal packages available earlier :(

one year ago
one year ago
one year ago
0 ... And Yet Another

Either one would be nice to have. I kinda like the instant search option, but could live with an ENTER to search.

I opened this meanwhile - https://github.com/allegroai/clearml-server/issues/138

Generally, it would also be good if the pop-up presented some hints about what went wrong with fetching the experiments. Here, I know the pattern is incomplete and invalid. A less advanced user might not understand what's up.

2 years ago
0 How Can I Ensure Tasks In A Pipeline Have The Same Environment As The Pipeline Itself? It Seems A Bit Counter-Intuitive That The Pipeline (Executed Remotely) Captures The Local Environment, But The Tasks (Executed Remotely) Do Not Use That Same Environmen

Hey @<1523701205467926528:profile|AgitatedDove14> , thanks for the reply!

We would like to avoid dockerizing all our repositories. And for the time being we have not used the decorators, but we can do that too.
The pipeline is instead built dynamically at the moment.

The issue is that the components do not have their dependency. For example:

def step_one(...):
    from internal.repo import private
    # do stuff

When step_one is added as a component to the pipeline, it does ...

one year ago
0 Trying To Run Aws Autoscaler With

Still crashing, I think that may not be the correct virtual environment to edit ๐Ÿค”
It's the one created later down the line

one year ago
0 Trying To Run Aws Autoscaler With

I'll try that in a bit (that requires some access control changes). Any idea how can I modify the dynamically created virtualenv?

` Poetry Enabled: Ignoring requested python packages, using repository poetry lock file!
The currently activated Python version 3.10.6 is not supported by the project (~3.8.0).
Trying to find and use a compatible version.
Using python3.8 (3.8.16)
Creating virtualenv ... in /root/.clearml/venvs-builds/3.10/task_repository/...git/.venv
Installing dependencies from ...

one year ago
0 Trying To Run Aws Autoscaler With

SuccessfulKoala55 it does not

one year ago
Show more results compactanswers