I am playing around with agents on our self-hosted CML. Currently, and I’m having some trouble with the environment configuration. It’s a bit magical which v...
one year ago
Trying to run AWS autoscaler with poetry queue, and I get: Traceback (most recent call last): File "/root/.local/bin/poetry", line 5, in from poetry.console....
one year ago
I have question about a situation, when agent is running on a queue, but also we'll use clearml-agent execute --idHow will it work, a) will be run immediatel...
one year ago
With the Helm charts, what is the recommend way to automate getting an api secret pair for the k8 glue agent so you dont have to go into the UI and generate ...
one year ago
hello all, I'm trying to download a file hosted in the clearml server and I receive the following error : 2022-12-16 11:52:40,423 - clearml.storage - ERROR -...
one year ago
Hii everyone! I'm having an issue using an agent without a GPU. I'm using it on docker mode (to allow SSH), I changed the default docker image on the config ...
one year ago
Hello, we have issues with clearml-agent when using standalone mode. It seems when in standalone mode, the agent wont ever try to clone the repo 😓 it always...
one year ago
Hi, When running a agent during the pip installation of packages i get the following error: The user requested PyYAML==6.0 clearml 1.8.3 depends on PyYAML>=3...
one year ago
Hi there, I'm having a slight issue with my kubernetes pods silently failing after downloading a clearml registered dataset (which is around 60gb) as part of...
one year ago
Hey everyone, I have another question: Is it possible to change agent config for each task? E.g. agent.package_manager.system_site_packages = true should be ...
one year ago
Hey there! Quick question about clearml-agent, docker and conda. I’m trying to use conda as package manager with an agent, but I get the following error mess...
one year ago
Hi there! Is there an easy way to retrieve the site-package directory that was created by an agent from inside a task? Eg. task = Task.init(...) task.add_req...
one year ago
Hi all! Having a bit of an ssh issue, basically I'm running the clearml k8s-glue agent in a pod in k8s, which happily spins up new pods on a managed node gro...
2 years ago
Hello, Does anyone know how to bypass package management by clearml if using docker mode? I want to achieve the following - Run agent in docker mode Push a t...
2 years ago
Hi, do you know more or less how many workers can server work with. Have you make such stress-tests? The thing is that we have some power run agent on (for e...
2 years ago
Hi all! When I try to run tasks for a agent on machine without GPU this error occurs: docker: Error response from daemon: OCI runtime create failed: containe...
2 years ago
Hello everyone ! As you can observe in attached snipped, in my code i freeze the env, and the agent install every cached dependency with the same version. Is...
2 years ago
Hello! I have a quick question about the ClearML Hyperparameter Optimizations module. Is it possible to use it without using the clearml agent system? In oth...
2 years ago
Hello, when running a task with a remote interpreter i get clearml.Task - INFO - No repository found, storing script code instead . I am using Pycharm and i ...
2 years ago
Has anyone got any experience with C++ extensions in Python when using ClearML? In our setup.py we have: ext_modules=[ Extension( "file_io.extio", sources=["...
2 years ago
Hi all! Could do with some help on running registered task on a clearml-agent. My workflow so far is as follows: Execute a local training run (from within a ...
2 years ago
[WebUI-based options injection not working] Hey everyone! Since our training repo has gotten quite complex, we configure all setup in an options.yml file whi...
2 years ago
Is there any examples of mounting an AWS EFS mount to a self hosted k8 agent deploy? https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearm...
2 years ago
Hi, I just started using clearml, and it is amazing! However I've run into an issue - I have a windows machine which I've setup as a worker, with an agent ru...
Hey, would it be possible to add a way to edit autoscaler configs without having to clone them ? This is really frustrating especially when you reached the q...
2 years ago
Hello everyone ! Problem description: I have my virtual environment (conda) in which I do have detectron2 installed. When I run the task locally it is workin...
Heya, is there any plan for ClearML to leverage the new https://developer.nvidia.com/blog/getting-the-most-out-of-the-a100-gpu-with-multi-instance-gpu/ tech ...
2 years ago
Hi, I was trying to test the autoscaler feature, but I am getting the following error: 2022-10-21 02:06:43,599 - clearml.Auto-Scaler - INFO - Failed to start...
2 years ago
Hi, I am trying to test the whole stack on my local machine but I am unable to make clearml-agent and clearml-serving work. Every time I get: > clearml_agent...
2 years ago
Hey, currently on a PRO SaaS deployment using pipelines with the GCP autoscaler and setting some credentials into the init scripts of my provisionned VMs (in...
2 years ago