Hello, does anybody here work with ClearML on preemptible instances? I'd like to achieve the following: - I enqueue a preemptible task A - Task A gets fetche...

Hi, I am trying to save my trained model weights in S3 bucket instead of using ClearML storage when using clearml-task for ml training remotely. I tried to u...

I have am issue getting a model from the model repository when running a task in a remote worker. I have a custom model that was saved with OutputModel: mode...

monitoring related question Good evening everyone, I followed the below documentation to implement the clearml monitoring using prometheus and grafana None I...

does anyone had experience with running ClearML in secure machine with iptables configured? I had allowed traffic in the ports ClearML is using but still the...

Hello. Is there any possibility to change horizontal axis in Scalars to some chosen metrics (e.g. epochs metric)? As far I have seen it's possible to use wal...

I am still going through all the docs and intro videos … but: is the only way to create a new experiment to run the script that contains the experiment at le...

Good evening everyone, I have a question on how to monitor model performance (in terms of accuracy of predictions) with grafana. In this tutorial: None , onl...

Hi, I'm using lightgbm package to train models. in my task execution I'm getting lots of warnings print from lightgbm. when running locally these prints are ...

Can Azure Managed identity (equivalent to AWS instance-profile) be used by Clearml Web server and clearml-agent ? If I assigned the appropriate Managed Ident...

Hello! I created a clearml.conf in my clearml server, then I added the S3 credentials under aws { s3 { region, key, secret } } and rebooted the server. Then,...

Hey guys 🙂 I am wondering what is the best way to make a clearml-server deployment robust? E.g. let's say my server may become unavailable because of a hard...

Hi all, I have a quick question regarding passing secrets to a docker container. Our set up is the following: we use GCP Autoscaler to spawn "workers" where ...

Hi! I am wondering if there is a way to check which S3 is associated to which project once you have created them? I am looking at the mongo docker container ...

Hello! I am wondering if someone has run in to a similar issue to this. I set up a new agent (pip mode) and one of my users set up their repo with poetry. It...

Hello everybody, I have a question about saving models. I have a train.py script to train a Neural Network using pytorch. I am using clearML task for experim...

Hi, I am looking for a way to report a single metric value of a trained model (lgbm for example). I'm currently using: logger.report_scalar(title='train', se...

Hello, I am testing my Hidra/OmegaConf with ClearML and I have a general question. Why is it necessary to indicate that I want to edit the configuration (set...

Hey, do you know if it's possible to execute a custom command just before ClearML Agent starts the container? I know it's possible to execute custom command ...

Hello everyone, are there any examples of integrating Clearml and VAST.AI . The goal is to have agents that will lift containers in a vast.AI environment on ...

Hi! Is there a way to get_local_copy but to download only the latest diff in dataset genealogy (that is, the files listed by list_added_files ), omitting eve...

Hi! I am setting up my first ClearML agent (EC2) connecting to my hosted ClearMLServer. I am at the step where I am granting the agent access to github. I am...

Trying to run get_tasks on AWS Lambda and getting the following error. Any suggestions on how to overcome this? { "errorMessage": "[Errno 38] Function not im...

Hello. Please tell me how to make sure that when you start the pipeline, nothing superfluous is installed in the service queue? @PipelineDecorator.pipeline( ...

Hi, I am trying to log the hydra configuration using clearml-task, and I am following the demo script: None . It's able to log the default hydra configs, but...

Hi all, I have a newbie question about clear-ml data. I have four data sources that get combined to train a model. I have put each of these datasets into cle...

Hey, I've spin up a worker using AWS autoscaler in ClearML self hosted server running on Kubernetes. However, I can't find the agent on the workers page. Any...

Hi, I am currently using clearml agent along with a k8s glue container that was installed via Helm in a Kubernetes cluster. I would like to understand the pr...

Hello, We are getting following timeout errors during the task run: 2023-08-10 13:53:36,361 - clearml.Metrics - ERROR - Action failed <500/100: events.add_ba...

Another quick question about fileservers and clearml-agent: clearml-agent seems to ignore the output destination set in the task config sdk.development.defau...