has anyone else benchmarked ClearML? I'm seeing catastrophic logging overhead: None for 50 numbers, ClearML's logging takes 3x as long as my entire LLM train...
one month ago
my linter (the default vscode python extension) doesn't understand TaskInstance = TypeVar("TaskInstance", bound="Task") . if I type clearml.Task.current_task...
one month ago
Hi, i tried to build my own image and uploaded it to harbor in order to use it as an image for pipelines and tasks, but the tasks didn't use the packages fro...
one month ago
Hi, is there a way to wait until a dataset finish uploading before proceed? because I want to upload dataset if it is not already exist and then process the ...
one month ago
Hello! I am trying to use an early stopping, or pruning mechanism in the hyperparameter optimization. Is there any of those mechanisms with OptimizerOptuna c...
one month ago
Hi, i try to execute pipeline with PipelineController and define it like this: pipe = PipelineController( name =config["clear_ml"]["pipeline_name"], project ...
one month ago
hi, I'm using huggingface trainer, is there a way to capture grad_norm per layer? Thanks!
one month ago
What is the recommended way of passing environment variables to Kubernetes pods executed using ClearML pipelines? I know I could create a “global” Kubernetes...
one month ago
Hi guys, im running into an issue when creating new clearml dataset version. I want to create new version of dataset from a local folder, but I don't want al...
one month ago
Hi everyone! I want to setup uv caching on 1.9.3 agent, but doesnt understand where i should add UV_CACHE_DIR in my clearml config. I have tried several opti...
one month ago
How does clearml-agent install -e python package ? I have a homemade python package which I just moved to pyproject.toml, that I am not familiar with so not ...
one month ago
Hi guys, I am trying to upload and serve a pre-existing 3-rdparty PyTorch model inside my ClearML cluster. However, after proceeding with the suggested seque...
one month ago
Hi, i see some strange behavior where the training fails when running on clearml (loss = nan) compared to running w/o clearml. This is entirely reproduceable...
one month ago
Hello, I wanted to test out clearml and installed the 7.14.2 helm chart. The deployment looks ok. I can access the webui and create workspace API credentials...
one month ago
Sporadic failure to retrieve Scalars and Console logs. Context: self-hosted in Azure with 2 separate Azure Container App for the UI and API server. ElasticSe...
one month ago
Hi all. After rebooting the server after "no space on disk" cannot see plots of one of the experiments.
one month ago
I'm using docker runtime to run clearml-agent. When I enqueue the task through web UI. I am getting errors related to invalid git credentials. How do I make ...
one month ago
Hi, I'm trying to use ClearML pipelines, but some of my components need to have some env variables defined. I can't seem to find anything in the documentatio...
one month ago
Hi, I am wondering after a task submitted to remote server finishing running. Will the docker container / disk space (really I am more interested about the d...
one month ago
Hi everyone, I'm trying to log a file using the ClearML logger like this: clearml.log_file(file_name=file_name, file_path=file_path) For example, if file_nam...
one month ago
Hello community, I'm planning to deploy a self-hosted ClearML server on AWS. Our usage pattern is to run it intensively once a week, with a few additional se...
one month ago
Hi everyone! I have no requirements.txt in repo, because it managed by poetry. Is it somehow possible to pass pyproject.tom in clearml-task cli? clearml-task...
one month ago
Is there some limit in the web UI or the configuration for number of debug sample images. Ours seems to never show past 32 images
one month ago
Hi, I'm trying to upload a dataset to s3 using dataset.upload(show_progress=True, verbose=True, compression=ZIP_STORED) which is supposed to upload without c...
one month ago
Hello everyone! I need to run the pipeline on schedule. Are there any restrictions on running pipelines through the scheduler? Would hidden project for pipe ...
one month ago
Within a ClearML task, is it possible to checkout another task code ? Context: I have a bit of a special use-case: we train our model using ClearML. Our code...
one month ago
Hello! I was wondering if it would be possible to integrate the optuna dashborard in the same run of clearml hyperparameter optimization. Like passing the sq...
one month ago
Hey, question about the logging of arguments parsed with a clearML task. When I run my experiment and parse an argument called 'train_dataset' with a clearml...
one month ago
Hi, I installed the open-source version of ClearML but couldn't connect using the admin role. Can you assist me with this? I want to set resource config and ...
one month ago
Hello everyone, Sorry for bothering on the weekend but I have some questions regarding ClearML that I would like to know to decide whether or not ClearML wou...
one month ago