Hey everyone, I have an autoscaler configuration that runs different ec2 instances. I want the EC2 worker launched by the autoscaler could handle a bucket wi...
Can I upload debug samples to GCP? I only see aws and azure in the https://clear.ml/docs/latest/docs/configs/clearml_conf#sdk-section
Hi all, did anyone manage to connect the agent to aws s3 bucket when authenticating to AWS using SSO?
Hi, I am getting this error when using the aws auto_scaler service (with the PRO version): Traceback (most recent call last): File "/root/.clearml/venvs-buil...
2 years ago
Good day to all! Any clue how to make upload dataset to minio S3? I have setup a custom s3 in clearml.conf as per docs: aws { s3 { # default, used for any bu...
2 years ago
Hi there. I have my own clearml server working on http://clearml.10.68.0.250.nip.io , i try to push my artefact on a minio server hosted at the http://minio....
2 years ago
Hi, I would like to follow-up in this https://clearml.slack.com/archives/CTK20V944/p1646123127790389 happening on clearml server 1.2.0 (self hosted on a sing...
Not very important, but small suggestion for the web UI: under the QUEUES tab, in the queues wait time graph, would it be possible to switch from seconds to ...
2 years ago
Are GP3 volumes automatically deleted when the instance is spun down using the clearml aws autoscaler?
2 years ago
Hi, did anyone experiment with running on the aws autoscaler on spots and knows whether there is configuration for retry policy when spot get evacuated mid-job?
Hi all, Anyone also have issues with the Logger hang the whole task?? or doesn’t upload the reported images and scalers? I got many tasks that were just hang...
3 years ago
Hi community, noob question, how can I know the cloning repo location in an aws agent running a task?
Hi, in the aws autoscaler, is it possible to specify multiple regions (availability_zone)? I currently use eu-west-1a, and would like to start using eu-west-...
3 years ago
Hi all, I am running into SSL verification issues with trying to upload model artifacts to minio. We are running the clearml agent in a container, have mount...
Hi guys for the AWS auto-scaler I need to access aws ssm or create .env file locally when using the init script. Has anyone done this?
3 years ago
Hi, I attached an IAM role to an ec2 instance to grant access to an s3 bucket. The ec2 instance is running a clearml-agent (v1.1.0). I didn’t specify any key...
3 years ago
Hi, we recently upgraded clearml to 1.1.1-135 . 1.1.1 . 2.14. The task init is task=Task.init(project_name='myproject', task_name='mytask', output_uri=' s3:/...
3 years ago
Hi, I am using the aws autoscaler and getting the following error while trying to spin up spot instances: 2021-08-16 17:18:48 Spinning new instance type=v100...
Is it possible to have clearml launch aws instances to run clearml-agent , execute jobs and then shutdown after the jobs have been completed? I have two rele...
3 years ago
Hi, i'm running the following and encountering some SSL errors. SSL_CERT_FILE=ca.crt clearml-data upload --id 12314jhg42342j4j --storage clearml.storage - ER...
Hi guys, I want automate the clearml-init in a docker container. Ideally I would do this by having the clearml.conf file in the container and then read in en...
3 years ago
Hi again, I am trying to make the aws autoscaler work with ec2 instances, but it fails to setup the agent in the machine: the logs of the user-data script sh...
Hi, I see that there is a new parameter in aws autoscaler: max_spin_up_time_min - What is the difference with max_idle_time_min ?
3 years ago
Hello, I tried the clearml-session CLI to start a jupyter instance on an agent, but an error with the password, here is the full CLI log: $ clearml-session -...
3 years ago
Hi folks, Is it possible to use an aws p3 instance (which as several GPUs) with one agent per GPU, all controlled through ClearML AWS AutoScheduler? So Clear...
Hi, I'm using the aws autoscaler to spin instances. I'd like to use the clearml agent on the created instances with docker containers. However even if I set ...
Hi, I'm running the latest clearml server on aws for a week now and I regularily run into the "Fetch Experiments failed". I can't really find any more inform...
3 years ago
Hi guys, since I am done with implementing the AWS autoscaler, I would like to share some pain points that I encountered in the process with the hope that th...
3 years ago
Hi again, it seems like the aws autoscaler is not spinning instances with the EBS configuration I configured. Here is the configuration: resource_configurati...
Hi all, Would it be possible to make the aws autoscaler log each scale in/out operation in the console to help debugging/understanding the course of events?