Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
DeliciousBluewhale87
Moderator
38 Questions, 126 Answers
  Active since 10 January 2023
  Last activity 11 months ago

Reputation

0

Badges 1

121 × Eureka!
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Is there a way to output the cleamrl reports scalars / Configuration etc into a output pdf ? If not available, is it on the near term pipeline ?
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
I was running the hyperparameter optimization code in clearml. I understand Iteration is one single experiment but what does the other parameters refer to ? ...
4 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
I suppose the Data Management & Lineage (is similar to clearml-data in the open source version) and if so, what is this Hyperdatasets function (Not really ge...
4 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hi everyone, yesterday I pushed an experiment to the http://app.community.clear.ml server. It is still pending after 19 hours, is this normal behaviour ? Thanks
4 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Prev, i worked with Clearml (1 year back) and back then, we config Seldon Core for the deployment and Clearml for the training.. Now there is clearml-serving...
3 years ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
Hi, expanding on ReassuredTiger98 ’s earlier question, Let's say Alice is running an hyperparameter optimization task on a particular queue, and spins off hu...
4 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Does anyone know if you can export a dataset (ML) directly from a database to the clearml-data Or have to export out as csv first ?
3 years ago
0 Votes
0 Answers
714 Views
0 Votes 0 Answers 714 Views
4 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Hi , I have this use case. I have Dataset project. This stores the dataset and its lineage. 2. I have another project build using the Pipeline. The pipeline ...
4 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Seems clearml-server-k8s has been deprecated in version 1.0.. Did this to install helm install allegroai/clearml-server-chart --namespace=clearml --generate-...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
https://github.com/allegroai/clearml-server-helm I am following this k8 setup for clearml-server-helm. Here the clearml-agents are being started automaticall...
4 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Using the s3 to push data, I tried this snippet.. How to add in the key and secret key ? I see that it requires another class, StorageHelper, but I wasnt abl...
4 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hi, I have k8s environment and I have tried to install via helm. https://github.com/allegroai/clearml-helm-charts However, there were all kinds of errors in ...
3 years ago
0 Votes
1 Answers
690 Views
0 Votes 1 Answers 690 Views
🙋 Roll call! Who else is here?
4 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Quick qn, when using the clearml-task, how to specify the output_uri.
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Another qn, is clearml-data analogous to a feature-store
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Hi, I have quite a generic question. Basically, I am picking your brains for any solution. Our current pipeline has (clearml-data, clearml and seldon). We we...
3 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
For the Clearml-Server component, can the Clearml File server be configured to any kind of storage ? Example hdfs or even a database etc..
2 years ago
0 Votes
14 Answers
1K Views
0 Votes 14 Answers 1K Views
Hi, I am running a file like this python train_it.py Task.force_requirements_env_freeze(False) task = Task.init(project_name='playground', task_name='base') ...
3 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi , I have set up clearml using the helm chart in k8s. I have been wanting to set up an authentication for the clearml server. https://allegro.ai/clearml/do...
3 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi, I am trying to hyperparameterization. I am not sure how to pass a args['dataset_url'] from hyper.py to base.py. hyper_parameters=[ DiscreteParameterRange...
3 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Currently, I start my clearml queues like this from the command shell. Is there a more elegant way to do this/ Like running it in perpetuity ? python clearml...
3 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
I saw a guide on setting up clearml server in kubernetes. https://allegro.ai/clearml/docs/docs/deploying_clearml/clearml_server_kubernetes.html . However, i ...
4 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Hi, I'd like to set up ClearML in a Kubernetes environment. Previously, i used the helm package, but it was not really configurable. Now I intend to use this...
4 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi, Just a silly question. Using clearml-data, Am I right to say every data commit is immutable, as in , it isnt possible to open an existing task-id(for dat...
4 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
3 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Hi folks, we are trying to find a tool to help with workflow orchestration. This is our stack so far (Label Studio/Clearml/Seldon). Does anyone have any expe...
3 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hi, just checking.. Does anyone know whether clearml Enterprise has deployment functionality..
4 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Does Clearml has a webhook mechanism ? Example, when a training job is completed.. There is notification raised so can proceed to do deployment etc ...
3 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
I have used AWS S3 and minio as storage for clearml artifacts. But has anyone used Nexus as a storage ?
3 years ago
Show more results questions
4 years ago
0 Dear Community! I'M Trying Out A New Way To Make Clearml-Related Content. I'D Like Your Opinion On Whether This Is Something You Would Consider Watching (Provided Editing And Content Is A Little Bit Better

Nice tutorial.. Though personally, I prefer a more clean-cut presentation (without the Yays and muaks or the the turtle). 😄 But usually, as long as content is there, it shldnt matter...

4 years ago
0 I Saw A Guide On Setting Up Clearml Server In Kubernetes.

nice.. this looks a bit friendly.. 🙂 .. Let me try it.. Thanks

4 years ago
0 I Saw A Guide On Setting Up Clearml Server In Kubernetes.

Just to add on, I am using minikube now.

4 years ago
0 I Just Deployed Clearml Into K8 Cluster Using Clearml Helm Package. When I Ran A Job, It Gave This Error In The Clearml Web Server (Attached Below). I Sshed Into The Pod Running The Clearml-Agent. Upon Typing Clearml-Agent Init, I Realised The Clearml.Con

Yup, i used the value file for the agent. However, i manually edited for the agentservices (as there was no example for it in the github).. Also I am not sure what is the CLEARML_HOST_IP (left it empty)

4 years ago
0 Hi, I Am Trying To Understand Clearml-Data And Only Found This Piece Of Article Explaining It.

Hi, Some walk around I thought of.. Btw, I havent tried . AnxiousSeal95 , your comments

1 ) Attach a clearml-task id to each new dataset-id
So in the future, when new data comes in, get the last data commit from the project(Dataset) and get the clearml-task for it. Then clone the clearml-task, and pass in the new data. The only downside, is the need to clone the cleaml-task.
Or alternatively
2) Attach a gitsha-id of the processing code to each new dataset-id.
This can't give the exact code ...

3 years ago
0 Hi, Expanding On

The use case, is lets say i run
python k8s_glue_example.py --queue glue_qAnd some guys pushes an hyperparameterization job with over 100 experiments to the glue_q, one minute later, I push a simple training job to glue_q.. But I will be forced to wait for the 100 experiments to finish.

4 years ago
0 Hi , I Have This Use Case.

TimelyPenguin76 :
from clearml import Dataset ds = Dataset.get(dataset_project="PROJ_1", dataset_name="dataset")

4 years ago
0 Clearml Server For Kubernetes Clusters Using Helm

Hi, for the values.yaml, is there some reference for it esp so , if we assign more Memory to webserver service etc. I tried googling around but so far no luck

4 years ago
0 Hi, I Am Running A File Like This

I just downloaded the logs from the Failed task. Seem I have set the agent.package_manager.system_site_packages: true in the agent as well.

3 years ago
0 Hi, I Have Quite A Generic Question. Basically, I Am Picking Your Brains For Any Solution. Our Current Pipeline Has (Clearml-Data, Clearml And Seldon). We Were Looking For Some Workflow Orchestrator To Stitch Them Up. One Scenario:

RoughTiger69
So prefect tasks :
Loads Data into clearml-data Runs trainining in clearml Publish model (manual trigger required, so user publishes model) and return model url Seldon deploys the model ( model url passed in)

3 years ago
0 Hi, I'D Like To Set Up Clearml In A Kubernetes Environment. Previously, I Used The Helm Package, But It Was Not Really Configurable. Now I Intend To Use This

When I push a job to an agent node, i got this error.
"Error response from daemon: network None not found"

4 years ago
0 Hi, Expanding On

Hi AgitatedDove14 , Now we prefer to run dynamic agents instead using
python3 k8s_glue_example.pyIn this case, is it still possible to pass --order-fairness at the queue level or this is more of a Enterprise edition feature.

4 years ago
0 Hi , I Have This Use Case.

I mean PROJ_1 gets updated from an external source...

4 years ago
0 Hi, I Am Running A File Like This

Hi AgitatedDove14 , This isnt the issue. With or without specifying the queue, I have this error when I do the "Create version" as compared to the "Init version".
I wonder whether this is some issue with using the Create version together with execute_remotely() ..

3 years ago
0 I Just Deployed Clearml Into K8 Cluster Using Clearml Helm Package. When I Ran A Job, It Gave This Error In The Clearml Web Server (Attached Below). I Sshed Into The Pod Running The Clearml-Agent. Upon Typing Clearml-Agent Init, I Realised The Clearml.Con

Hi martin, i just untemplate-ed the
helm template clearml-server-chart-0.17.0+1.tgzI found this lines inside.
- name: CLEARML_AGENT_DOCKER_HOST_MOUNT value: /opt/clearml/agent:/root/.clearmlUpon ssh-ing into the folders in the both the physical node (/opt/clearml/agent) and the pod (/root/.clearml), it seems there are some files there.. So the mounting worked, it seems.
I am not sure, I get your answer. Should i change the values to something else ?
Thanks

4 years ago
0 I Saw A Guide On Setting Up Clearml Server In Kubernetes.

sure, I'll post some questions once I wrap my mind around it..

4 years ago
0 Seems Clearml-Server-K8S Has Been Deprecated In Version 1.0.. Did This To Install

Could it be another applications's "elasticsearch-pv" and not clearml's

3 years ago
0 Another Qn, Currently When Building Pipelines. We Use Python Codes As Steps. Is It Possible To Substitute These Steps Using Containers Instead. The Main Reason, Being This Will Be Much More Faster Than In Each Step Vs (Building Docker Image And Running Co

Hi, using the pipeline examples, with
step1_dataset_artifact.py, step2_data_processing.py, step3_train_model.py ==> pipeline_controller.pyIn the above example, the pipeline_controller is stringing together 3 python files, instead could it string together 3 containers instead. Of course, we can manually compile each into a docker image, but does clearml has some similar approach baked in.

3 years ago
0 Is There A Way To Output The Cleamrl Reports Scalars / Configuration Etc Into A Output Pdf ? If Not Available, Is It On The Near Term Pipeline ?

Hi AgitatedDove14 , imho links are def better, unless someone decides to archive their Tasks.. Just wondering about the possibility only..

3 years ago
Show more results compactanswers