Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
EnchantingPenguin77
Moderator
13 Questions, 46 Answers
  Active since 03 August 2023
  Last activity 6 months ago

Reputation

0

Badges 1

46 × Eureka!
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, is there a way to have the docker extra arguments takes dockerd command instead of docker run ? I tried dockerd --storage-opt dm.basesize=20G in docker e...
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Hi, I am trying to log the hydra configuration using clearml-task, and I am following the demo script: None . It's able to log the default hydra configs, but...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hello Team, I got an issue of dataloader's workers are out of shared memory using AWS Autoscaler even though I've raised the shared memory to be 64gb in dock...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, I got some issue when using clearml-task --docker with AWS autoscaler. The error shows no space left on device , and my docker image is 12GB. I've tested...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi, Is clearml-task --docker able to take docker image > 10GB? I got some issue when using clearml-task --docker with AWS autoscaler. The error shows no spac...
one year ago
0 Votes
10 Answers
739 Views
0 Votes 10 Answers 739 Views
6 months ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi I got issue when I am trying to mount EBS to AWS EC2 instance when running ClearML pipeline, I've checked the dev/sdb is dev/nvme1n1 in ec2 and I was usin...
6 months ago
0 Votes
1 Answers
853 Views
0 Votes 1 Answers 853 Views
aws
7 months ago
0 Votes
1 Answers
599 Views
0 Votes 1 Answers 599 Views
5 months ago
0 Votes
38 Answers
152K Views
0 Votes 38 Answers 152K Views
2 years ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

@<1523701205467926528:profile|AgitatedDove14> Is there any reason why you mentioned that the "correct" way to work with python and containers is to actually install everything on the system (not venv)?

2 years ago
0 Hi, I Am Trying To Save My Trained Model Weights In S3 Bucket Instead Of Using Clearml Storage When Using Clearml-Task For Ml Training Remotely. I Tried To Use --Skip-Task-Init In Clearml-Task And Set Task.Init In My Scripts, But It Doesn'T Seem To Work.

@<1523701087100473344:profile|SuccessfulKoala55> Hi Jake, I tried to use --output-uri in clearml-task but got the same error clearml.storage - ERROR - Failed uploading: ' LazyEval Wrapper ' object cannot be interpreted as an integer

2 years ago
0 Hi, I Am Trying To Log The Hydra Configuration Using Clearml-Task, And I Am Following The Demo Script:

Hi @<1523701435869433856:profile|SmugDolphin23> I see, but is there anyway to see the overridden config in OmegaConf so I can easily compare the difference between 2 experiments?

2 years ago
0 Hi, I Am Trying To Save My Trained Model Weights In S3 Bucket Instead Of Using Clearml Storage When Using Clearml-Task For Ml Training Remotely. I Tried To Use --Skip-Task-Init In Clearml-Task And Set Task.Init In My Scripts, But It Doesn'T Seem To Work.

Hi @<1523701087100473344:profile|SuccessfulKoala55> I was able to solve this issue after upgrade clearml to 1.12.2, but my training/val loss become nan after the update

one year ago
0 Hi, I Got Some Issue When Using

dockerd --storage-opt dm.basesize=20G

one year ago
0 Hi, I Got Some Issue When Using

@<1523701070390366208:profile|CostlyOstrich36> Isn't the docker extra arguments only takes docker run command instead of dockerd ?

one year ago
0 Hi, Is

Hi @<1523701087100473344:profile|SuccessfulKoala55> , what preconfiguration is needed for the docker service to make? I've tried to run the docker pull manually in AWS EC2 with the same docker image without the space limit issue.

one year ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

@<1523701205467926528:profile|AgitatedDove14> I'm trying to run Clearml GPU compute(RTX 3080) with pytorch-lightning but keep getting CUDA error. Is there any specific CUDA/Ubuntu/torch/python version required? I tried several different version but can't make it work

FROM nvidia/cuda:11.8.0-cudnn8-devel-ubuntu22.04 as telos_algorithms
  File "/code/.venv/lib/python3.10/site-packages/lightning/pytorch/trainer/trainer.py", line 1013, in _run_stage
    with isolate_rng():
  Fi...
2 years ago
0 Hi, Is There A Way To Have The Docker Extra Arguments Takes

@<1523701087100473344:profile|SuccessfulKoala55> Thanks, it is the AMI issue

one year ago
0 Hi I Got Issue When I Am Trying To Mount Ebs To Aws Ec2 Instance When Running Clearml Pipeline, I'Ve Checked The Dev/Sdb Is Dev/Nvme1N1 In Ec2 And I Was Using

Hi @<1808672071991955456:profile|CumbersomeCamel72> , the error instance is launched from ClearML AWS Autoscaler on the webpage. The sucessful mounted instance is launch manually from AWS web

6 months ago
0 Hi I Got Issue When I Am Trying To Mount Ebs To Aws Ec2 Instance When Running Clearml Pipeline, I'Ve Checked The Dev/Sdb Is Dev/Nvme1N1 In Ec2 And I Was Using

@<1808672071991955456:profile|CumbersomeCamel72> It can be mount without docker, but can't be mounted if I run a docker on the instance

6 months ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr
# 

from typing import List, Optional, Tuple
import pyrootutils
import lightning
import hydra
from clearml import Task
from omegaconf import DictConfig, OmegaConf
from lightning import LightningDataModule, LightningModule, Trainer, Callback
from lightning.pytorch.loggers import Logger

pyrootutils.setup_root(__file__, indicator="pyproject.toml", pythonpath=True)
# ------------------------------------------------------------------------------------ #
# the setup_root above is...
2 years ago
0 Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

Thanks @<1523701205467926528:profile|AgitatedDove14> . I just got an issue running clearml-task remotely, it has been working fine before today, but now every time I run clearml-task, it shows pending, and I've been waiting for 3 hours the status is still pending. The autoscalers was charging the hourly rate even though the task is still pending for 3 hours. From the console log of Clearml GPU instance, I saw it is listening to the queue, but there is no log even after 3 hours. There is not...

2 years ago
Show more results compactanswers