Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
EnchantingPenguin77
Moderator
13 Questions, 46 Answers
  Active since 03 August 2023
  Last activity 8 months ago

Reputation

0

Badges 1

46 × Eureka!
0 Votes
1 Answers
805 Views
0 Votes 1 Answers 805 Views
Hi, I Was Using Pipeline Controller To Run Pipeline Tasks With 2 Steps, The 1St Step Is Supposed To Create 51 Task And The 2Nd Task Will Compute Result Based On The 51St Tasks Output In The 1St Step. But I Only See 34 Tasks In Step 1, And Got Error Of The
Hi, I was using pipeline controller to run pipeline tasks with 2 steps, the 1st step is supposed to create 51 task and the 2nd task will compute result based...
7 months ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi, Is
Hi, Is clearml-task --docker able to take docker image > 10GB? I got some issue when using clearml-task --docker with AWS autoscaler. The error shows no spac...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, I Got Some Issue When Using
Hi, I got some issue when using clearml-task --docker with AWS autoscaler. The error shows no space left on device , and my docker image is 12GB. I've tested...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, Is There A Way To Have The Docker Extra Arguments Takes
Hi, is there a way to have the docker extra arguments takes dockerd command instead of docker run ? I tried dockerd --storage-opt dm.basesize=20G in docker e...
one year ago
0 Votes
10 Answers
962 Views
0 Votes 10 Answers 962 Views
Hi, I'M Using Aws Ec2 Instance To Trian My Models With Clearml Autoscaler, But It Says Cuda Device Is Not Avaliable. The Code Runs Well On My Local Pc And It Runs Well On Clearml With Ec2 Yesterday, But It Suddenly Doesn'T Work Today. Is There Anyway To S
Hi, I'm using AWS EC2 instance to trian my models with ClearML autoscaler, but it says CUDA device is not avaliable. The code runs well on my local PC and it...
9 months ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Hi, I Am Using Aws Autoscalaer To Train Model. I Have A Fair Large Dataset(400G) And The Data Is Private So I Can'T Really Store It In Clearml Dataset. Everytime When I Launch A Job, It'S Going To Take Very Long Time To Download The Data From S3. Is There
Hi, I am using AWS autoscalaer to train model. I have a fair large dataset(400G) and the data is private so I can't really store it in ClearML dataset. Every...
2 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Hello Team, I Got An Issue Of
Hello Team, I got an issue of dataloader's workers are out of shared memory using AWS Autoscaler even though I've raised the shared memory to be 64gb in dock...
2 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Hi, I Am Trying To Save My Trained Model Weights In S3 Bucket Instead Of Using Clearml Storage When Using Clearml-Task For Ml Training Remotely. I Tried To Use --Skip-Task-Init In Clearml-Task And Set Task.Init In My Scripts, But It Doesn'T Seem To Work.
Hi, I am trying to save my trained model weights in S3 bucket instead of using ClearML storage when using clearml-task for ml training remotely. I tried to u...
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Hi, I Am Trying To Save My Trained Model Weights In S3 Bucket Instead Of Using Clearml Storage When Using Clearml-Task For Ml Training Remotely. I Tried To Use --Skip-Task-Init In Clearml-Task And Set Task.Init In My Scripts, But It Doesn'T Seem To Work.
Hi, I am trying to save my trained model weights in S3 bucket instead of using ClearML storage when using clearml-task for ml training remotely. I tried to u...
2 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Hi, I Am Trying To Log The Hydra Configuration Using Clearml-Task, And I Am Following The Demo Script:
Hi, I am trying to log the hydra configuration using clearml-task, and I am following the demo script: None . It's able to log the default hydra configs, but...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi, Is There Anything Changed On Clearml? I Saw The Web Ui Was Updated, And After Then, I Am Experiencing Package Not Found Issue Shown In The Log. I Have The Exactly Same Docker Image And Aws Ami Setting As Before, And Using The Same Previous Git Branch
Hi, is there anything changed on clearml? I saw the web UI was updated, and after then, I am experiencing package not found issue shown in the log. I have th...
aws
9 months ago
0 Votes
38 Answers
169K Views
0 Votes 38 Answers 169K Views
Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr
Hi all, I was trying to use clearml-task to run a custom docker(with poetry to install all the python dependencies and activated the environment) using clear...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi I Got Issue When I Am Trying To Mount Ebs To Aws Ec2 Instance When Running Clearml Pipeline, I'Ve Checked The Dev/Sdb Is Dev/Nvme1N1 In Ec2 And I Was Using
Hi I got issue when I am trying to mount EBS to AWS EC2 instance when running ClearML pipeline, I've checked the dev/sdb is dev/nvme1n1 in ec2 and I was usin...
8 months ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

The queue will be empty when I run task

2 years ago
0 Hi, I Am Trying To Save My Trained Model Weights In S3 Bucket Instead Of Using Clearml Storage When Using Clearml-Task For Ml Training Remotely. I Tried To Use --Skip-Task-Init In Clearml-Task And Set Task.Init In My Scripts, But It Doesn'T Seem To Work.

Hi @<1523701087100473344:profile|SuccessfulKoala55> I was able to solve this issue after upgrade clearml to 1.12.2, but my training/val loss become nan after the update

2 years ago
0 Hi, Is There Anything Changed On Clearml? I Saw The Web Ui Was Updated, And After Then, I Am Experiencing Package Not Found Issue Shown In The Log. I Have The Exactly Same Docker Image And Aws Ami Setting As Before, And Using The Same Previous Git Branch

sucessful run

9 months ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

Thanks @<1523701205467926528:profile|AgitatedDove14> . I just got an issue running clearml-task remotely, it has been working fine before today, but now every time I run clearml-task, it shows pending, and I've been waiting for 3 hours the status is still pending. The autoscalers was charging the hourly rate even though the task is still pending for 3 hours. From the console log of Clearml GPU instance, I saw it is listening to the queue, but there is no log even after 3 hours. There is not...

2 years ago
0 Hi, Is There A Way To Have The Docker Extra Arguments Takes

Hi @<1523701087100473344:profile|SuccessfulKoala55> , I just to start an EC2 instance manually and pull the docker, it is able to pull the docker without seeing the no space left issue

one year ago
0 Hi, Is There A Way To Have The Docker Extra Arguments Takes

@<1523701087100473344:profile|SuccessfulKoala55> Thanks, it is the AMI issue

one year ago
0 Hi, I Got Some Issue When Using

dockerd --storage-opt dm.basesize=20G

one year ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

but it still not is able to run any task after I abort and rerun another task

2 years ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

image

2 years ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

@<1523701205467926528:profile|AgitatedDove14> I'm trying to run Clearml GPU compute(RTX 3080) with pytorch-lightning but keep getting CUDA error. Is there any specific CUDA/Ubuntu/torch/python version required? I tried several different version but can't make it work

FROM nvidia/cuda:11.8.0-cudnn8-devel-ubuntu22.04 as telos_algorithms

  File "/code/.venv/lib/python3.10/site-packages/lightning/pytorch/trainer/trainer.py", line 1013, in _run_stage
    with isolate_rng():
  Fi...
2 years ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

the gpu arugment is actually inside my example.yaml:

defaults:
  - default.yaml

accelerator: gpu
devices: 1
2 years ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

I've added gpu:True to my hydra config file but the GPU is still not used

2 years ago
0 Hi, I'M Using Aws Ec2 Instance To Trian My Models With Clearml Autoscaler, But It Says Cuda Device Is Not Avaliable. The Code Runs Well On My Local Pc And It Runs Well On Clearml With Ec2 Yesterday, But It Suddenly Doesn'T Work Today. Is There Anyway To S

@<1523701070390366208:profile|CostlyOstrich36> sorry wrong log uploaded, here is the error:
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location=torch.device('cpu') to map your storages to the CPU.

9 months ago
0 Hi, I Got Some Issue When Using

@<1523701070390366208:profile|CostlyOstrich36> Isn't the docker extra arguments only takes docker run command instead of dockerd ?

one year ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

@<1523701205467926528:profile|AgitatedDove14> Is there any reason why you mentioned that the "correct" way to work with python and containers is to actually install everything on the system (not venv)?

2 years ago
0 Hi, I'M Using Aws Ec2 Instance To Trian My Models With Clearml Autoscaler, But It Says Cuda Device Is Not Avaliable. The Code Runs Well On My Local Pc And It Runs Well On Clearml With Ec2 Yesterday, But It Suddenly Doesn'T Work Today. Is There Anyway To S

screenshot of AWS Autoscaler setup, cpu mode is NOT enabled
image

9 months ago
Show more results compactanswers