Hey, I encountered a problem with using user/pass git authentication on clearml agents. If I have a local repo cloned with ssh, the agent will attempt to rep...
one day ago
Hey, can someone help me setup the configuration to use minio? I have been trying to solve this puzzle for a few hours now. I have minio in my k8s on prem, w...
Hello, When sending new tasks using python script, I'm getting this error no matter how many times I retry the task, even though the commit is pushed and the...
10 days ago
Hello! I am new to clearml. I have clearml installation with helm chart. I am using k8s agent. I have configured a queue for the agent. I have created a simp...
11 days ago
Hey everyone, I'm new to clear ml, but my company is looking at rolling it out on our EKS cluster. We've installed everything through the helm charts and hav...
15 days ago
Hello, I am having issues using the dataset service pointing to the wrong fileserver url when running tasks remotely on the ClearML Agents running in k8s. I ...
Hey all, When using GCP Autoscaler I always get an error that no gpus are recognized the first time the autoscaler boots up the VM and runs the code. After t...
27 days ago
Hey everyone, What is the best way to export environment variables (especially the ones with secrets such as DB credentials) and make them available to a cle...
one month ago
Hey, i'm working with the clearml AWS autoscaler (for quite some time) and suddenly we encountered an issue with scaling GPU machines that torch inside the t...
one month ago
Good day, We have been using ClearML for project monitoring and task management. Recently, we decided to try the Google Cloud Platform Autoscaler to automate...
one month ago
Hi all, I am trying to expand our training infrastructure using Clearml-agents, I have a train_example script that I want an agent to be able to pick up and ...
2 months ago
Hey team, I had a question about executing the pipelines using clearml agent setup in K8s. When we define a pipeline script to be executing remotely and subm...
2 months ago
How to configure ClearML agent to keep pods around after they finish/fail? I want to debug a pod that crashes, but it gets deleted quickly
2 months ago
Hi, When using yolo in a Docker based clearml agent, I get the error below. How do I need to setup clearml agent to have access to CV2? Starting Task Executi...
3 months ago
Hi everyone, I’m testing ClearML and encountered an issue when launching the agent in docker-mode: it seems to ignore additional Docker arguments. For exampl...
3 months ago
hello! i had trouble running clearml-agent on k8s. i fixed it by modifying the helm chart to allow specifying runtimeClassName (which is needed when using nv...
3 months ago
Hi. I want to run clearml-agent inside a docker container. with the default image in my clearml.conf file, it is "image: "nvidia/cuda:11.0.3-cudnn8-runtime-u...
3 months ago
hey, I'm using clearml GCP autoscaler and it seems that task.connect is very slow compared to the same setup in clearml AWS autoscalers. it might takes up to...
3 months ago
Hi I got issue when I am trying to mount EBS to AWS EC2 instance when running ClearML pipeline, I've checked the dev/sdb is dev/nvme1n1 in ec2 and I was usin...
3 months ago
Hello everyone, I deployed clearml and clearml-agent on k8s and I can't get the agent to use the gpus. I have 3 machines with a GPU each correctly configured...
3 months ago
Hi, we are migrating from AWS to GCP machines and we experience issues with task.connect function. the issue is that on GCP machines that are spawn by the au...
👋 Hi everyone! Did anyone have this issue with clearml agent in k8s when trying to run a task remotely? │ k8s-glue ERROR: Could not push back task [11d1b317...
3 months ago
Hi folks! I’m looking to migrate a clearml server setup from using local storage to Azure blob storage. I am able to get data to upload to azure, and the cle...
4 months ago
Hi everyone, I'm experiencing an issue with ClearML running on K8S. After upgrading the ClearML server helm chart from version 7.11.5, I'm seeing the followi...
4 months ago
Hello We are using enterprise Version and the question is about the Agents and the queues We know that we can configure container image at the agent level Th...
4 months ago
Hi everyone, I want to clone a git repo with clearml-agent that has to following url format https://: ACCESS_TOKEN@mygitlab.com /user/repository.git ClearML ...
4 months ago
Hi everyone ! I am trying to launch multigpu training on remote clearm agent and stuck, because when i do accelerate launch train.py remote agent doesn’t ove...
4 months ago
Hi all, I was using the cleaning script, but it's (I think the elasticsearch, since it's a java process) consuming a lot of memory. So much that it's blockin...
4 months ago
Hi, I would like to know from you, maybe someone has encountered the problem that after deploying an agent inside Docker, the launch of the script itself occ...
4 months ago