aws { s3 { # S3 credentials, used for read/write access by various SDK elements # The following settings will be used for any bucket not specified below in t...
10 days ago
another question about the aws auto_scaler, i managed to get the scaler service running, it listens to a queue called "aws" (yes, very imaginative), when i q...
16 days ago
hey there! question about the aws autoscaler, the TLDR is that i can't get the aws_autoscaler.py when running with --remote flag to clone my git repository (...
18 days ago
Hi, I am using clearML own hosted server on aws ec2. When I am creating a task I am getting this error "Retrying (Retry(total=239, connect=239, read=240, red...
one month ago
Hello everyone, I am using self hosted clearml server on ec2 (clearml community AMIs). This ec2 instance is attached to s3 with IAM role. Now if I create or ...
one month ago
Hi everyone, I have some questions regarding clearml aws_autoscaler.py. First one: On AWS machine agent runs with this command: python -m clearml_agent --con...
**** solved **** i used variables from here - None os.environ['CLEARML_AGENT_GIT_USER'] = 'myuser' os.environ['CLEARML_AGENT_GIT_PASS'] = 'mypass' ----------...
3 months ago
Hey all, does anyone know how to query hidden aws autoscaler tasks using the python sdk? I've put such a task below Task.query_tasks(task_filter={"system_tag...
Hi! I started clearml server on EC2 using prebuilt image. Everything works fine, except one small thing: When web app shows image that stored on S3, it asked...
6 months ago
HI, I just started using ClearML and I love to test it. I am trying to update existing models that were already created before. When I upload my custom model...
6 months ago
Hello guys, Can anyone help me?? I got this message when I tried to ran script through clearml-task botocore.exceptions.NoCredentialsError: Unable to locate ...
7 months ago
Hello! I have a hard time connecting to non-aws s3 bucket to use it as a storage to clearml Dataset. Even though I add access and secret key in ~/clearml.con...
7 months ago
Hi guys, My git repo is installed with its python dependencies inside a local docker image. Is it possible to run my docker image on aws autoscaler and skip ...
Hi guys, I have set up the clearml-server on aws ec2 instance using the released clearml AMI in EC2 instance (there is a 24/7 running EC2 instance for runnin...
8 months ago
I’m trying to use minio with ClearML as a external storage. I am having problems with the configuration file for the ClearML client When I use the output_uri...
8 months ago
Hello all, I'm trying to run a few pipeline tasks remotely via a private docker image but struggling to find any documentation on how/where the docker login ...
9 months ago
Hey! i was trying to use my minio instance for artifacts storage but there is not way of making it work. Maybe i am missing something. This is my clearml.con...
one year ago
hello, i am trying to run clearml-agent on google colab, and i want to setup aws s3 key-secret. i cannot find ~/clearml.conf on google colab. where actually ...
one year ago
Hi, I am trying to use the aws autoscaler to assign instance profiles to new machines. This is a better way than managing credentials. I added the configurat...
Hi everyone, im trying to use the aws autoscaler service. Provided the pac but is not able to clone the repo. It is not using the pac (using gitlab)
I started two pipelines (using AWS autoscaler in app.clear.ml ). The pipelines ran concurrently, using the same pipeline code. Both failed in the same compon...
Hey everyone, I have an autoscaler configuration that runs different ec2 instances. I want the EC2 worker launched by the autoscaler could handle a bucket wi...
Can I upload debug samples to GCP? I only see aws and azure in the https://clear.ml/docs/latest/docs/configs/clearml_conf#sdk-section
Hi all, did anyone manage to connect the agent to aws s3 bucket when authenticating to AWS using SSO?
Hi, I am getting this error when using the aws auto_scaler service (with the PRO version): Traceback (most recent call last): File "/root/.clearml/venvs-buil...
one year ago
Good day to all! Any clue how to make upload dataset to minio S3? I have setup a custom s3 in clearml.conf as per docs: aws { s3 { # default, used for any bu...
one year ago
Hi there. I have my own clearml server working on http://clearml.10.68.0.250.nip.io , i try to push my artefact on a minio server hosted at the http://minio....
one year ago
Hi, I would like to follow-up in this https://clearml.slack.com/archives/CTK20V944/p1646123127790389 happening on clearml server 1.2.0 (self hosted on a sing...
Not very important, but small suggestion for the web UI: under the QUEUES tab, in the queues wait time graph, would it be possible to switch from seconds to ...
one year ago
Are GP3 volumes automatically deleted when the instance is spun down using the clearml aws autoscaler?
one year ago