Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
FierceHamster54
Moderator
29 Questions, 178 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

131 × Eureka!
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hey is ClearML MLFlow based ? Is it exposed to CVE-2023-1176 and CVE-2023-1177 ?
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Hey, is there a way to pass docker args for the execution of a pipeline controller defined through decorator @PipelineDecorator.pipeline the same way we can ...
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
2 years ago
0 Votes
13 Answers
2K Views
0 Votes 13 Answers 2K Views
Hey all, hope you're having a great day, having an unexpected behavior with a training task of a YOLOv5 model on my pipeline, I specified a task in my traini...
2 years ago
0 Votes
25 Answers
2K Views
0 Votes 25 Answers 2K Views
Hey, trying to figure out how to create an https://clear.ml/docs/latest/docs/clearml_sdk/model_sdk#output-models , the doc says it needs a TaskId but my trai...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Heya, good day to everyone, I'm finding myself facing this random error with a very opaque backtrace when attempting to squash two distinct versions of the s...
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hey everyone, I am having some difficulties passing environment variables on my piepeline components running on agents ( 1.6.1 ) without docker mode: - I set...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hey everyone, As a Pro-tier SaaS user, I'm experiencing a very high latency when finalizing a dataset, it is attached in a big dataset version hierarchy and ...
one year ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Hey, is there a shortcut on the Dataset SDK to directly get the latest version of a dataset ?
2 years ago
0 Votes
15 Answers
2K Views
0 Votes 15 Answers 2K Views
Heya, I hope you're all well in this beautiful day, my GCP Autoscaler just died with that strange but short backtrace, wondered if it rang a bell to any of y...
2 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hey just wanting to know: what is the recommended best practice to write ClearML Pipelines between controller and decorators ?
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hey, it is said in the pipeline decorator example that requirements for executing a pipeline component is inferred from the imports inside the component func...
2 years ago
0 Votes
15 Answers
2K Views
0 Votes 15 Answers 2K Views
Heya, trying to setup a GCP autoscaler for general-purpose CPU instances ( e2-standard-4 ) but I get into that error: googleapiclient.errors.HttpError: And I...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
2 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hello everyone! I setup a GCP autoscaler on my Pro SaaS deployment but I keep getting this error: clearml_agent: ERROR: Server does not support --use-owner-t...
2 years ago
0 Votes
13 Answers
2K Views
0 Votes 13 Answers 2K Views
2 years ago
0 Votes
15 Answers
2K Views
0 Votes 15 Answers 2K Views
Hey having an issue passing parameters to a component in a pipeline, the parameters appear to be None inside the component function: @PipelineDecorator.compo...
2 years ago
0 Votes
20 Answers
2K Views
0 Votes 20 Answers 2K Views
Hey currently trying to run a pipeline locally to test a pipeline component with PipelineDecorator.run_locally() , first try returned a random pandas error, ...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hey, would it be possible to add a way to edit autoscaler configs without having to clone them ? This is really frustrating especially when you reached the q...
2 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Hey has anyone managed to capture Darts logging with ClearML when using the temporal fusion transformers ? Even when overriding their trainer with a custom P...
2 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hey is .get_local_copy() thread-safe ? I mean can I concurrently download several datasets without breaking the cache and StorageManager ?
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hey I hope everyone is having a good day, two quick questions about datasets: Does squashing two datasets deletes the two original datasets ? Is it possible ...
2 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hey guys, i hope you all have a nice days, I had to use the Task method .setup_aws_upload(bucket=...,region=...) to overcome a incorrect region specified for...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Heya, is there any plan for ClearML to leverage the new https://developer.nvidia.com/blog/getting-the-most-out-of-the-a100-gpu-with-multi-instance-gpu/ tech ...
2 years ago
0 Hi Everyone, I Recently Joined The Community And I Have A Question. I Installed Clearml Server Following The Instructions At The Link

You need to set a specific port for your clearml server and then just set a rule in your reverse proxy (eg. nginx) to make point the specific route you want toward that port

one year ago
0 Heya, Is There Any Plan For Clearml To Leverage The New

Hey, I'm a SaaS user in PRO tier and I was wondering if it was a feature available on the auto-scaler apps so I could improve the cost-efficiency of my provisionned GCP A100 instances

2 years ago
0 Hi Team, I Am Runing Script Which Fetch The Data From Clearml Server, I Am Getting This Information "Clearml - Info - Dataset.Get() Did Not Specify Alias. Dataset Information Will Not Be Automatically Logged In Clearml Server" .Please Can Any One Tell Me

alias : "Alias of the dataset. If set, the ‘alias : dataset ID’ key-value pair will be set under the hyperparameters section ‘Datasets’"

I have to concede that I found that description a bit vague at first but if you check that https://clear.ml/docs/latest/docs/clearml_data/best_practices#organize-datasets-for-easier-access you see that:

"In cases where you use a dataset in a task (e.g. consuming a dataset), you can easily track which dataset the task is using by using ` Dataset.get...

2 years ago
0 Hey, Is There A Shortcut On The Dataset Sdk To Directly Get The Latest Version Of A Dataset ?

I would like instead of having to:
Fetch latest dataset to get the current latest version Increment the version number Create and upload a new version of the datasetTo be able to:
Select a dataset project by name Create a new version of the dataset by choosing what increment in SEMVER standard I would like to add for this version number (major/minor/patch) and upload

2 years ago
0 Hey Currently Trying To Run A Pipeline Locally To Test A Pipeline Component With

CostlyOstrich36 Having the same issue running on a remote worker, even tho the line works correctly on python interpreter and the component run correctly in local debug mode (but not standard local mode):
` File "/root/.clearml/venvs-builds/3.10/code/generate_dataset.py", line 18, in generate_dataset
time_range = pd.date_range(start=start_date, end=end_date, freq='D').to_pydatetime().tolist()
File "/root/.clearml/venvs-builds/3.10/lib/python3.10/site-packages/pandas/core/indexes/date...

2 years ago
0 Hey Currently Trying To Run A Pipeline Locally To Test A Pipeline Component With

Thus the main difference of behavior must be coming from the _debug_execute_step_function property in the Controller class, currently skimming through it to try to identify a cause, did I provide you enough info btw CostlyOstrich36 ?

2 years ago
0 Hey, Trying To Figure Out How To Create An

Oh, that's nice, if I import a model using InputModel do I still need to specify a OutputModel ?

2 years ago
0 Heya, Is There Any Plan For Clearml To Leverage The New

There is a gap in the GPU offer on GCP and there is no modern middle-ground for a TPU with more than 16GB GRAM and less than 40GB, so sometime we need to provision a A100 to get the training speed we want but we don't use all the GRAM so I figured out if we could batch 2 training tasks on the same A100 instance we would still be on the winning side in term of CUDA cores and getting the most of the GPU-time we're paying.

2 years ago
0 Hey All, Hope You'Re Having A Great Day, Having An Unexpected Behavior With A Training Task Of A Yolov5 Model On My Pipeline, I Specified A Task In My Training Component Like This:

The train.py is the default YOLOv5 training file, I initiated the task outside the call, should I go edit their training command-line file ?

2 years ago
0 Hey Having An Issue Passing Parameters To A Component In A Pipeline, The Parameters Appear To Be

Okay I confirm having default parameters fixes that issue, but kinda sad to have lost 3 days into that super weird behavior

2 years ago
0 Hey Having An Issue Passing Parameters To A Component In A Pipeline, The Parameters Appear To Be

I'm looking for the github issue so I can check the PR fixing that, do you have any info on that ?

2 years ago
0 Hey Has Anyone Managed To Capture Darts Logging With Clearml When Using The Temporal Fusion Transformers ? Even When Overriding Their Trainer With A Custom Pytorch Lightning Trainer It Seems That Clearml Cannot Retrieve The Iteration Log...

Wll idk the scalars are not reported and I get this message ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start , i'll go open the pull request for that right away

2 years ago
0 Hey, Is There A Shortcut On The Dataset Sdk To Directly Get The Latest Version Of A Dataset ?

And by extension is there a way to upsert a dataset by automatically creating an entry wich a incremented version or create it if it does not exists ? Or am I forced to do a get, check if the latest version is fainallyzed, then increment de version of that version and create my new version ?

2 years ago
0 Hey Currently Trying To Run A Pipeline Locally To Test A Pipeline Component With

When running with PipelineDecorator.run_locally() I get the legitimate pandas error that I fixed by specifying the freq param in the pd.date_range(.... line in the component:
Launching step [generate_dataset] ClearML results page: `
[STEP 1/4] Generating dataset from autocut logs...
Traceback (most recent call last):
File "/tmp/tmp2jgq29nl.py", line 137, in <module>
results = generate_dataset(**kwargs)
File "/tmp/tmp2jgq29nl.py", line 18, in generate_dataset
...

2 years ago
0 Hey Guys, I Hope You All Have A Nice Days, I Had To Use The

ClearML package version used: 1.9.1
ClearML Server: SaaS - Pro Tier

2 years ago
0 Heya, Trying To Setup A Gcp Autoscaler For General-Purpose Cpu Instances (

AnxiousSeal95 Okay it seems to work with a compute optimized c2-standard-4 instance

2 years ago
0 Hey, Trying To Figure Out How To Create An

Ah no i cant since the pipeline is in its own dummy model and you cannot reattach pipelines to real projects so I must instanciate a dummy task just to attach the output model to the correct project

2 years ago
0 Hey, Trying To Figure Out How To Create An

Oh that's great, thanks 😍 🎉

2 years ago
0 Hey Having An Issue Passing Parameters To A Component In A Pipeline, The Parameters Appear To Be

Hey SuccessfulKoala55 currently using the clearml package version 1.7.1 and my server is a PRO SaaS deployment

2 years ago
0 Hey Having An Issue Passing Parameters To A Component In A Pipeline, The Parameters Appear To Be

Seems pretty critical tho, SuccessfulKoala55 is the 1.7.2 releasing soon ? ( I see the rc2 has been built 3 days ago)

2 years ago
0 Hey Currently Trying To Run A Pipeline Locally To Test A Pipeline Component With

So it seems to be an issue with the component parameter called in:
` @PipelineDecorator.pipeline(
name="VINZ Auto-Retrain",
project="VINZ",
version="0.0.1",
pipeline_execution_queue="Quad_VCPU_16GB"
)
def executing_pipeline(start_date, end_date):
print("Starting VINZ Auto-Retrain pipeline...")
print(f"Start date: {start_date}")
print(f"End date: {end_date}")

window_dataset_id = generate_dataset(start_date, end_date)

if name == 'main':
PipelineDec...

2 years ago
0 Hey, Trying To Figure Out How To Create An

Or can I just set it to Task.current_task() ?

2 years ago
2 years ago
0 Hey I Hope Everyone Is Having A Good Day, Two Quick Questions About Datasets:

And additionally does the When executing a Task (experiment) remotely, this method has no effect). part means that if it is executed in a remote worker inside a pipeline without the dataset downloaded the method will have no effect ?

2 years ago
0 Hello. In Which Yaml Files For Kubernetes And Where Should I Specify The Aws File_Server And Credentials For Clearml-Agent So That When Running Tasks Remotely In The Queue, The Artifacts Are Saved In The S3 Bucket?

I got some credentials issues to in some pipelines steps and I solved it using

task = Task.current_task()
task.setup_aws_upload(...)

It can allows you to explicitaly specify credentials

one year ago
one year ago
Show more results compactanswers