Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
FierceHamster54
Moderator
29 Questions, 178 Answers
  Active since 10 January 2023
  Last activity 11 months ago

Reputation

0

Badges 1

131 × Eureka!
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Hey just wanting to know: what is the recommended best practice to write ClearML Pipelines between controller and decorators ?
2 years ago
0 Votes
25 Answers
1K Views
0 Votes 25 Answers 1K Views
Hey, trying to figure out how to create an https://clear.ml/docs/latest/docs/clearml_sdk/model_sdk#output-models , the doc says it needs a TaskId but my trai...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hey is .get_local_copy() thread-safe ? I mean can I concurrently download several datasets without breaking the cache and StorageManager ?
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Heya, good day to everyone, I'm finding myself facing this random error with a very opaque backtrace when attempting to squash two distinct versions of the s...
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
2 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Hey having an issue passing parameters to a component in a pipeline, the parameters appear to be None inside the component function: @PipelineDecorator.compo...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hey, would it be possible to add a way to edit autoscaler configs without having to clone them ? This is really frustrating especially when you reached the q...
2 years ago
0 Votes
4 Answers
991 Views
0 Votes 4 Answers 991 Views
2 years ago
0 Votes
4 Answers
982 Views
0 Votes 4 Answers 982 Views
one year ago
0 Votes
8 Answers
640 Views
0 Votes 8 Answers 640 Views
Hey everyone, I am having some difficulties passing environment variables on my piepeline components running on agents ( 1.6.1 ) without docker mode: - I set...
one year ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Heya, I hope you're all well in this beautiful day, my GCP Autoscaler just died with that strange but short backtrace, wondered if it rang a bell to any of y...
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
2 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
2 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Heya, trying to setup a GCP autoscaler for general-purpose CPU instances ( e2-standard-4 ) but I get into that error: googleapiclient.errors.HttpError: And I...
2 years ago
0 Votes
6 Answers
987 Views
0 Votes 6 Answers 987 Views
Hey guys, i hope you all have a nice days, I had to use the Task method .setup_aws_upload(bucket=...,region=...) to overcome a incorrect region specified for...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hey, is there a way to pass docker args for the execution of a pipeline controller defined through decorator @PipelineDecorator.pipeline the same way we can ...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hey I hope everyone is having a good day, two quick questions about datasets: Does squashing two datasets deletes the two original datasets ? Is it possible ...
2 years ago
0 Votes
6 Answers
707 Views
0 Votes 6 Answers 707 Views
11 months ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Hey all, hope you're having a great day, having an unexpected behavior with a training task of a YOLOv5 model on my pipeline, I specified a task in my traini...
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Hello everyone! I setup a GCP autoscaler on my Pro SaaS deployment but I keep getting this error: clearml_agent: ERROR: Server does not support --use-owner-t...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hey, it is said in the pipeline decorator example that requirements for executing a pipeline component is inferred from the imports inside the component func...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
2 years ago
0 Votes
20 Answers
1K Views
0 Votes 20 Answers 1K Views
Hey currently trying to run a pipeline locally to test a pipeline component with PipelineDecorator.run_locally() , first try returned a random pandas error, ...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Heya, is there any plan for ClearML to leverage the new https://developer.nvidia.com/blog/getting-the-most-out-of-the-a100-gpu-with-multi-instance-gpu/ tech ...
2 years ago
0 Votes
12 Answers
990 Views
0 Votes 12 Answers 990 Views
Hey has anyone managed to capture Darts logging with ClearML when using the temporal fusion transformers ? Even when overriding their trainer with a custom P...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
2 years ago
0 Votes
1 Answers
972 Views
0 Votes 1 Answers 972 Views
Hey is ClearML MLFlow based ? Is it exposed to CVE-2023-1176 and CVE-2023-1177 ?
one year ago
0 Votes
7 Answers
765 Views
0 Votes 7 Answers 765 Views
Hey everyone, As a Pro-tier SaaS user, I'm experiencing a very high latency when finalizing a dataset, it is attached in a big dataset version hierarchy and ...
one year ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hey, is there a shortcut on the Dataset SDK to directly get the latest version of a dataset ?
2 years ago
0 Hey, About The Dependency Propagation Of Pipeline Components, If I Call A Vanilla Python Function From A Component Does The Dependencies Specified In The Internal Imports Propagated To This Function Call Too ? And Additionally If That Function Is In Anoth

Well it is also failing within the same file if you read until the end, but for the cross-file issue, it's mostly because of my repo architecture organized in a v1/v2 scheme and I didn't want to pull a lot of unused files and inject github PATs that frankly lack gralunarity in the worker

2 years ago
0 Hey, About The Dependency Propagation Of Pipeline Components, If I Call A Vanilla Python Function From A Component Does The Dependencies Specified In The Internal Imports Propagated To This Function Call Too ? And Additionally If That Function Is In Anoth

Well given a file architecture looking like this:
|_ __init__.py |_ my_pipeline.py |_ my_utils.py
With the content of my_pipeline.py being:
` from clearml.automation.controller import PipelineDecorator
from clearml import Task, TaskTypes

from my_utils import do_thing

Task.force_store_standalone_script()

@PipelineDecorator.component(...)
def my_component(dataset_id: str):
import pandas as pd
from clearml import Dataset

dataset = Dataset.get(dataset_id=input_dataset_id...
2 years ago
0 Hey, About The Dependency Propagation Of Pipeline Components, If I Call A Vanilla Python Function From A Component Does The Dependencies Specified In The Internal Imports Propagated To This Function Call Too ? And Additionally If That Function Is In Anoth

Okay looks like the call dependency resolver does not supports cross-file calls and relies instead on the local repo cloning feature to handle multiple files so the Task.force_store_standalone_script() does not allow for a pipeline defined cross multiple files (now that you think of it it was kinda implied by the name), but what is interesting is that calling an auxiliary function in the SAME file from a component also raise a NameError: <function_name> is not defined , that's ki...

2 years ago
0 Hey, About The Dependency Propagation Of Pipeline Components, If I Call A Vanilla Python Function From A Component Does The Dependencies Specified In The Internal Imports Propagated To This Function Call Too ? And Additionally If That Function Is In Anoth

Would have been great if the CLearML resolver would just inline the code of locally defined vanilla functions and execute that inlined code under the import scope of the component from which it is called

2 years ago
0 Hello Guys, How To Make Clearml Not Store Some Artifacts In The Stroage By Default? For Instance, Model Outputs

You can specify default storage string on projects pointing to for instance a S3 bucket

2 years ago
0 Hey Having An Issue Passing Parameters To A Component In A Pipeline, The Parameters Appear To Be

Nice it works 😍
I'll try to update the version in the image I provide to the workers of th autoscaler app (but sadly I don't control the version of those in itself since it's CLearML managed)

2 years ago
0 Hi Folks! Is There A Way To Programmatically Create Users And Groups On A Server? If So, Can Someone Point Me To The Docs? Thanks

It doesnt seem so if you look at the REST api documentation, might be available as an ENterprise plan feature

10 months ago
0 Hey, Is There A Way To Pass Docker Args For The Execution Of A Pipeline Controller Defined Through Decorator

Yes but not in the controller itself, which is also remotely executed in a docker container

2 years ago
0 Hey, Is There A Way To Pass Docker Args For The Execution Of A Pipeline Controller Defined Through Decorator

Well I simply duplicated code across my components instead of centraliwing the operations that needed that env variable in the controller

2 years ago
0 Hey, Is There A Way To Pass Docker Args For The Execution Of A Pipeline Controller Defined Through Decorator

I'm considering doing a PR in a few days to add the param if it is not too complex

2 years ago
0 [Datasets] Is It Possible To Get An Individual File From A Dataset? Example Would Be Accessing Only A Single Feature From A Feature Store Dataset When It Could Be Costly To Download The Entire Dataset

And after your modifications are made you can use . https://clear.ml/docs/latest/docs/references/sdk/dataset/#datasetsquash to squash your modified subset with the main dataset if you want to re-integrate it in your flow. But I don't remember if squash requires the both datasets to be present locally or not...

one year ago
0 Heya, Trying To Setup A Gcp Autoscaler For General-Purpose Cpu Instances (

I checked the 'CPU-only' option in the auto-scaler config but that's seemed logic at the time

2 years ago
0 Heya, Trying To Setup A Gcp Autoscaler For General-Purpose Cpu Instances (

And this is a standard pro saas deployment, the autoscaler scale up was triggered by the remote execution attempt of a pipeline

2 years ago
2 years ago
2 years ago
0 Hello Everyone! I Setup A Gcp Autoscaler On My Pro Saas Deployment But I Keep Getting This Error:

Fix confirmed on our side CostlyOstrich36 thanks for everything!

2 years ago
0 Hey I Hope Everyone Is Having A Good Day, Two Quick Questions About Datasets:

Old tags are not deleted. When executing a Task (experiment) remotely, this method has no effect).

This description in the add_tags() doc intrigues me tho, I would like to remove a tag from a dataset and add it to another version (eg: a used_in_last_training tag) and this method seems to only add new tags.

2 years ago
0 Hey I Hope Everyone Is Having A Good Day, Two Quick Questions About Datasets:

And additionally does the When executing a Task (experiment) remotely, this method has no effect). part means that if it is executed in a remote worker inside a pipeline without the dataset downloaded the method will have no effect ?

2 years ago
0 Hi Everyone, I Recently Joined The Community And I Have A Question. I Installed Clearml Server Following The Instructions At The Link

That might be an issue with clearml itself that fails to send proper resources if you change the path, that kind of path modification can be a hussle, if you have a domain name available I would suggest making a subdomain of it point to the ip of your clearml machine and just add site-enabled on nginx to point on it rather than doing a proxy pass

one year ago
0 Hi Everyone, I Recently Joined The Community And I Have A Question. I Installed Clearml Server Following The Instructions At The Link

You need to set a specific port for your clearml server and then just set a rule in your reverse proxy (eg. nginx) to make point the specific route you want toward that port

one year ago
0 Hi Team, I Am Runing Script Which Fetch The Data From Clearml Server, I Am Getting This Information "Clearml - Info - Dataset.Get() Did Not Specify Alias. Dataset Information Will Not Be Automatically Logged In Clearml Server" .Please Can Any One Tell Me

alias : "Alias of the dataset. If set, the ‘alias : dataset ID’ key-value pair will be set under the hyperparameters section ‘Datasets’"

I have to concede that I found that description a bit vague at first but if you check that https://clear.ml/docs/latest/docs/clearml_data/best_practices#organize-datasets-for-easier-access you see that:

"In cases where you use a dataset in a task (e.g. consuming a dataset), you can easily track which dataset the task is using by using ` Dataset.get...

one year ago
2 years ago
0 Has Anyone Tried Using Clearml With Ray Based Distributed Training For Computer Vision Models Like Resnet?

We're using Ray for hyperparameter search for non-CV model successfully on ClearML

11 months ago
0 Hey Everyone, As A Pro-Tier Saas User, I'M Experiencing A Very High Latency When Finalizing A Dataset, It Is Attached In A Big Dataset Version Hierarchy And Since Recently The

Hey @<1523701087100473344:profile|SuccessfulKoala55> this is a fairly small dataset with a linear hierarchy of ~300 version and a size of ~2GBs

one year ago
Show more results compactanswers