SarcasticSquirrel56

16 Questions, 144 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

137 × Eureka!

Questions 16
Answers 144

0 Votes

13 Answers

2K Views

0 Votes 13 Answers 2K Views

Hi Folks, I Have A Question Related To The Storage Of Artifacts, As It Is Not Entirely Clear To Me Where To Configure It. If I Read The Documentation

Hi folks, I have a question related to the storage of artifacts, as it is not entirely clear to me where to configure it. If I read the documentation https:/...

clearml

3 years ago

0 Votes

11 Answers

2K Views

0 Votes 11 Answers 2K Views

Good Morning Folks, I Am Setting Up Clearml On A (Self-Hosted) K8S Cluster Using The

Good morning folks, I am setting up ClearML on a (self-hosted) K8s cluster using the https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearm...

mlops

3 years ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

Hi Folks, Good Morning

Hi folks, good morning 🙂 In our setup we have a set of queues that do not use any GPU resources. Yet, when I run an experiment in such queues, we see a Warn...

clearml

3 years ago

0 Votes

15 Answers

2K Views

0 Votes 15 Answers 2K Views

Hi Everybody, I Am Having An Issues With A Self-Hosted Clearml Server... I Am Having A Problem Enqueuing Experiments Whose Code Is In A Git Repository, They Are In A Pending State And Proceed... However If I Copy The Same Code Out In A Folder With No Rep

Hi everybody, I am having an issues with a self-hosted clearml server... I am having a problem enqueuing experiments whose code is in a git repository, they ...

clearml

3 years ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

Hi Folks, Any Of You Has Experience In Deploying Clearml To Kubernetes Using Argocd? I Managed To Make It Run Pointing It To The Clearml-Charts-Repo, It Recognizes The Helm Chart And It Works. But I Am Struggling A Bit To Write My Own Definition To Make I

Hi folks, any of you has experience in deploying ClearML to Kubernetes using ArgoCD? I managed to make it run pointing it to the clearml-charts-repo, it reco...

clearml

3 years ago

0 Votes

14 Answers

2K Views

0 Votes 14 Answers 2K Views

Hi Folks, I Have Installed Clearml On Kubernets Using The Helm Chart, But I Had To Specify Three Different Domains For The Ui, Apiserver And Fileserver. Is There Any Way To Let Clearml Know That The Apiserver Is At

Hi folks, I have installed ClearML on kubernets using the helm chart, but I had to specify three different domains for the ui, apiserver and fileserver. Is t...

clearml

3 years ago

0 Votes

7 Answers

2K Views

0 Votes 7 Answers 2K Views

Hi Folks, I Am Having An Issue I Can'T Properly Understand: I Have Tried To Run The "Dataset" Example From The Official Clearml Repository (From My Laptop) For Some Reason It Got Stuck, So I Killed The Process, But In Clearml Ui It Still Results As "Runn

Hi folks, I am having an issue I can't properly understand: I have tried to run the "dataset" example from the official clearml repository (from my laptop) F...

clearml

3 years ago

0 Votes

4 Answers

2K Views

0 Votes 4 Answers 2K Views

I Do Have One Questions About Using The Helm Chart, Is There Any Way To Specify The Users In The Values.Yaml?

I do have one questions about using the helm chart, is there any way to specify the users in the values.yaml?

clearml

3 years ago

0 Votes

19 Answers

2K Views

0 Votes 19 Answers 2K Views

Hi Folks, One Question: I Have A Script That Looks Like:

Hi folks, one question: I have a script that looks like: import clearml as cml import numpy as np from sklearn.linear_model import LogisticRegression from sk...

clearml

3 years ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

Hi Folks, I Have A Question On Something That It'S Not Clear To Me Reading The Documentation At

Hi folks, I have a question on something that it's not clear to me reading the documentation at https://clear.ml/docs/latest/docs/clearml_agent/ From what I ...

clearml

3 years ago

0 Votes

8 Answers

2K Views

0 Votes 8 Answers 2K Views

Hi Folks, A Question Regarding The Clearml-Agent With K8S Glue. In The Agents We Mount An Nfs Volume So That Some Artifacts And Data Would Be Available For Training. I Have Seen That The K8S Glue Runs As Root (I Guess To Be Able To Spawn New Pods?), But

Hi folks, a question regarding the clearml-agent with k8s glue. In the agents we mount an nfs volume so that some artifacts and data would be available for t...

clearml

3 years ago

0 Votes

17 Answers

2K Views

0 Votes 17 Answers 2K Views

Hi Folks I Have A Problem I Can'T Understand. Plots Are Not Shown When Experiments Are Executed From The Ui. For Example, If I Run The Code On My Laptop, And I Go To The Experiment Page I Can See Correctly The Plots: But If I Then Clone The Task, And Ex

Hi folks I have a problem I can't understand. Plots are not shown when experiments are executed from the UI. For example, if I run the code on my laptop, and...

clearml

3 years ago

0 Votes

31 Answers

128K Views

0 Votes 31 Answers 128K Views

Hi Folks, I Did A Deployment Of Clearml Using The K8S Helm Chart, And I Set The Agent Using K8S Glue. I Run A Task Locally, And I Went To The Ui Cloned The Experiment And Scheduled It In The Default Queue. After Doing This, I See That The Experiment Is Q

Hi folks, I did a deployment of ClearML using the K8s helm chart, and I set the agent using K8s Glue. I run a task locally, and I went to the UI cloned the e...

mlops

3 years ago

0 Votes

31 Answers

121K Views

0 Votes 31 Answers 121K Views

Hi Folks, I Am Trying To Run Clearml On A Local Kubernetes (Created With Rancher Desktop), But I Am Running Into Issues. I Admit I Am A Complete Noob To K8S, Helm, Clearml Etc. Etc. So I Am Not Sure If I Did Some Very Stupid Mistakes. I Have A K8S Cluste

Hi folks, I am trying to run ClearML on a local kubernetes (created with Rancher Desktop), but I am running into issues. I admit I am a complete noob to K8s,...

kubernetes

3 years ago

0 Votes

31 Answers

109K Views

0 Votes 31 Answers 109K Views

Hi Folks, I Just Deployed A Clearml Agent Using The Helm Chart. I Have A Few Doubts:

Hi folks, I just deployed a ClearML agent using the Helm chart. I have a few doubts: after the deployment, I see a new queue called k8s_scheduler, which I di...

mlops

3 years ago

0 Votes

31 Answers

124K Views

0 Votes 31 Answers 124K Views

Hi Folks, Occasionally When I Clone A Job And Enqueue It, Instead Of Being Processed By The Expected Queue, A New Queue (With Some Id That Looks Like An Hash) Is Created Instead, And The Experiment Hangs In A "Pending" State. When This Happens, If I Abor

Hi folks, occasionally when I clone a job and enqueue it, instead of being processed by the expected queue, a new queue (with some id that looks like an hash...

clearml

3 years ago

0 Hi Folks, Occasionally When I Clone A Job And Enqueue It, Instead Of Being Processed By The Expected Queue, A New Queue (With Some Id That Looks Like An Hash) Is Created Instead, And The Experiment Hangs In A "Pending" State. When This Happens, If I Abor

If now I abort the experiment (which is in a pending state and not running), and re-enqueue it again -- no parameters modifications this time...
and I re-enqueue it to the CPU queue, I see that it is sent to the right queue, and after a few seconds the job enters a running state and it completes correctly

3 years ago

0 Hi Folks, I Have Installed Clearml On Kubernets Using The Helm Chart, But I Had To Specify Three Different Domains For The Ui, Apiserver And Fileserver. Is There Any Way To Let Clearml Know That The Apiserver Is At

I can ping it without issues, but I am not sure if the communications are set correctly

3 years ago

0 Hi Folks, Any Of You Has Experience In Deploying Clearml To Kubernetes Using Argocd? I Managed To Make It Run Pointing It To The Clearml-Charts-Repo, It Recognizes The Helm Chart And It Works. But I Am Struggling A Bit To Write My Own Definition To Make I

Super!!! many thanks CostlyFox64 !

3 years ago

0 Hi Folks, I Am Trying To Run Clearml On A Local Kubernetes (Created With Rancher Desktop), But I Am Running Into Issues. I Admit I Am A Complete Noob To K8S, Helm, Clearml Etc. Etc. So I Am Not Sure If I Did Some Very Stupid Mistakes. I Have A K8S Cluste

just to understand well the problems you helped me fix:
for elastic search it looked like I wasn't running the cluster with enough memory

but what happened to the FileServer? and how can I prevent it happening in a potential "production" deployment?

3 years ago

0 Hi Folks, One Question: I Have A Script That Looks Like:

Oh I see... for some reason I thought that all the dependencies of the environment would be tracked by ClearML, but it's only the ones that actually get imported...

If locally one detects that pandas is installed and can be used to read the csv, wouldn't it be possible to store this information in the clearml server so that it can be implicitly added to the requirements?

3 years ago

0 Hi Folks, I Just Deployed A Clearml Agent Using The Helm Chart. I Have A Few Doubts:

3 years ago

0 Hi Folks, I Did A Deployment Of Clearml Using The K8S Helm Chart, And I Set The Agent Using K8S Glue. I Run A Task Locally, And I Went To The Ui Cloned The Experiment And Scheduled It In The Default Queue. After Doing This, I See That The Experiment Is Q

unfortunately I can't get info from the cluster

3 years ago

Thanks a lot!

3 years ago

0 Hi Folks, A Question Regarding The Clearml-Agent With K8S Glue. In The Agents We Mount An Nfs Volume So That Some Artifacts And Data Would Be Available For Training. I Have Seen That The K8S Glue Runs As Root (I Guess To Be Able To Spawn New Pods?), But

I see... because the problem it would be with permissions when creating artifacts to store in the "/shared" folder

3 years ago

0 Good Morning Folks, I Am Setting Up Clearml On A (Self-Hosted) K8S Cluster Using The

Hi AgitatedDove14 I have spent some time going through the helm charts but I admit I still haven't clear how things should work.

I see that with the default values (mostly what I am using), the K8s Glue agent is deployed (which is what you suggested to use).

3 years ago

0 Hi Folks, I Just Deployed A Clearml Agent Using The Helm Chart. I Have A Few Doubts:

OK, I'll report that, and see if we can get it fixed

3 years ago

0 Hi Folks, I Just Deployed A Clearml Agent Using The Helm Chart. I Have A Few Doubts:

that's what I wanted to ask, while the proper networking is setup (I don't manage the cluster),
can I do tests using the .kube/config?

3 years ago

0 Good Morning Folks, I Am Setting Up Clearml On A (Self-Hosted) K8S Cluster Using The

I guess to achieve what I want, I could disable the agent using the helm chart values.yaml
and then define pods for each of the agent on their respective nodes

3 years ago

I will!

3 years ago

0 Hi Everyone, I'Ve Seen That When Re-Running A Script It Sometimes Overwrites A Previous Task In The Dashboard Instead Of Creating A New Task. How Does Clearml Decides Whether To Create A New Task Or Overwrite An Existing?

or you can set the argument to False

3 years ago

0 Hi All! Question Around Resource Management Using

Hi Martin, thanks for the explanation! I work with Maggie and help with the ClearML setup.

Just to be sure, currently, the PodTemplate contains:

resources: limits: nvidia.com/gpu: 1
you are suggesting to add also, something like:
requests: memory: "100Mi" limits: memory: "200Mi"is that correct?

On a related note, I am a bit puzzled by the fact that all the 4 GPUs are visible.
In the https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus/ , i...

3 years ago

well there are already processes in place.. we aim at migrating everything to ClearML, but we hoped we could do it gradually

3 years ago

0 Good Morning Folks, I Am Setting Up Clearml On A (Self-Hosted) K8S Cluster Using The

Thanks, I'll try to understand how the default agent coming with the helm chart is configured and try to copy how to setup a different one from there then

3 years ago

0 Hi All, If Install Clearml Agent With Helm, How Do I Authenticate The Agent With Git? In Values.Yaml File, I Can Set Clearml_Agent_Git_User And Clearml_Agent_Git_Pass But When The Agent Run, Git Has Error "Remote: Support For Password Authentication Was R

PunyWoodpecker71 just create a Personal Access Token and use it as the value for CLEARML_AGENT_GIT_PASS, https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token

3 years ago

0 Hi Folks I Have A Problem I Can'T Understand. Plots Are Not Shown When Experiments Are Executed From The Ui. For Example, If I Run The Code On My Laptop, And I Go To The Experiment Page I Can See Correctly The Plots: But If I Then Clone The Task, And Ex

My local clearml.conf is:
# ClearML SDK configuration file api { # Notice: 'host' is the api server (default port 8008), not the web server. api_server: host web_server: host files_server: host # Credentials are generated using the webapp, `
# Override with os environment: CLEARML_API_ACCESS_KEY / CLEARML_API_SECRET_KEY
credentials {"access_key": "access_key", "secret_key": "secret_key"}
}
sdk {
# ClearML - default SDK configuration

storage {
   ...

3 years ago

0 Hi Folks, I Have A Question Related To The Storage Of Artifacts, As It Is Not Entirely Clear To Me Where To Configure It. If I Read The Documentation

when I run it on my laptop...
what I am trying to achieve is not having to worry about this setting, and have all the artifacts and models uploaded to the file server automatically

3 years ago

I am not aware of how clearml-dataset works, but I'll have a look 🙂

3 years ago

0 Hi Folks, One Question: I Have A Script That Looks Like:

but I can confirm that adding the requirement with Task.add_requirements() does the trick

3 years ago

0 Hi Everybody, I Am Having An Issues With A Self-Hosted Clearml Server... I Am Having A Problem Enqueuing Experiments Whose Code Is In A Git Repository, They Are In A Pending State And Proceed... However If I Copy The Same Code Out In A Folder With No Rep

but I was a bit set off track seeing errors in the logs

3 years ago

I see in bitnami's gh-pages branch a file https://github.com/bitnami-labs/sealed-secrets/blob/gh-pages/index.html to do the redirect that contains:

` <html>

<head> <meta http-equiv="refresh" content="0; url= ` ` "> </head> <p><a href=" ` ` ">Redirect to repo index.yaml</a></p> </html> ` A similar file is missing in the ` clearml-helm-chart ` ` gh-pages ` branch.

3 years ago

0 I Do Have One Questions About Using The Helm Chart, Is There Any Way To Specify The Users In The Values.Yaml?

great! thanks a lot!

3 years ago

so I assume clearml moves them from one queue to the other?

3 years ago

0 Hi Folks, One Question: I Have A Script That Looks Like:

Thanks a lot :)

3 years ago

Show more results