Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
RattyBluewhale45
Moderator
6 Questions, 91 Answers
  Active since 13 August 2024
  Last activity 2 months ago

Reputation

0

Badges 1

89 × Eureka!
0 Votes
8 Answers
210 Views
0 Votes 8 Answers 210 Views
Hello! I Am Having A Dependency Issue With Clearml. Would Someone Be Able To Help Me Understand How To Debug It/Replicate It?
Hello! I am having a dependency issue with clearml. Would someone be able to help me understand how to debug it/replicate it? from ultralytics import YOLO Im...
2 months ago
0 Votes
5 Answers
140 Views
0 Votes 5 Answers 140 Views
Hello! I Get This Error When Running Multiple Jobs On The Same Dataset, Would Someone Be Able To Help Debug?:
Hello! I get this error when running multiple jobs on the same dataset, would someone be able to help debug?: FileNotFoundError: Image Not Found /clearml_age...
2 months ago
0 Votes
29 Answers
244 Views
0 Votes 29 Answers 244 Views
Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv
Hello! I have an issue reproducing my runs. The task.Create completes successfully. When I clone and enqueue a completed task the clone fails. It fails durin...
3 months ago
0 Votes
41 Answers
7K Views
0 Votes 41 Answers 7K Views
Hey Guys! I'M Having Some Issues With Pytorch And Clearml. I Am Starting A New Task Using Task.Create And Setting Pytorch As A Requirement Under `Packages`. For Some Reason Pytorch With Cuda 12 Is Being Installed, But I Need Cuda 11. Do You Know How To Se
Hey guys! I'm having some issues with pytorch and clearml. I am starting a new task using task.create and setting pytorch as a requirement under packages. Fo...
3 months ago
0 Votes
13 Answers
153 Views
0 Votes 13 Answers 153 Views
Hello! Are You Able To Help Be Debug This Message?
Hello! Are you able to help be debug this message? RuntimeError: unable to write to file : No space left on device (28) 2024-09-09 14:29:50,124 - clearml.rep...
2 months ago
0 Votes
23 Answers
204 Views
0 Votes 23 Answers 204 Views
Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?
Hello! My Workers Utilization is empty and not showing any graphs. Do you know how I can troubleshoot this?
3 months ago
0 Hey Guys! I'M Having Some Issues With Pytorch And Clearml. I Am Starting A New Task Using Task.Create And Setting Pytorch As A Requirement Under `Packages`. For Some Reason Pytorch With Cuda 12 Is Being Installed, But I Need Cuda 11. Do You Know How To Se

@<1523701070390366208:profile|CostlyOstrich36> I'm now running the agent with --docker , and I'm using task.create(docker="nvidia/cuda:11.0.3-cudnn8-runtime-ubuntu20.04")

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Setting agent.venvs_cache path back to ~/.clearml/venvs-cache seems to have done the trick!

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Resetting and enqueuing task which has built successfully also fails 😞

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

"Original PIP" is empty as for this task we can rely on the docker image to provide the python packages

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv 
DEBUG   Installing build dependencies ... [?25l- \ | / - done
[?25h  Getting requirements to build wheel ... [?25l- error
  [1;31merror[0m: [1msubprocess-exited-with-error[0m
  
  [31m×[0m [32mGetting requirements to build wheel[0m did not run successfully.
  [31m│[0m exit code: [1;36m1[0m
  [31m╰─>[0m [31m[21 lines of output][0m
  [31m   [0m Traceback (most recent call last):
  [31m   [0m   File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/pip/_vendor/pyproject_hooks/_i...
3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Thank you so much for your help @<1523701205467926528:profile|AgitatedDove14> !

2 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

WebApp: 1.16.0-494 • Server: 1.16.0-494 • API: 2.30

3 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

agents

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

is this what you had on the Original manual execution ?

Yes this installed packages list is what succeeded via manual submission to agent

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Thank you for your help @<1523701205467926528:profile|AgitatedDove14>

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Task log

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Docker mode

2 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

Hey, yes I can see machine statistics on the experiments themselves

3 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

@<1523701070390366208:profile|CostlyOstrich36> thank you for your help in advance

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Hi @<1523701205467926528:profile|AgitatedDove14>
ClearML Agent 1.9.0

2 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

image

3 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

None

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

agent.package_manager.pip_version=""

2 months ago
0 Hi All Im Trying To Save My Model Checkpoints During Runtime But Am Running Into A Confusing Snag. I'M Using The Huggingface Architecture For A Transformer. Using Their Training Module To Control Training. In The Training Args, I Have The

Try save_safetensors=False in TrainingArguments . Not sure if clearML supports safetensors

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

It was pointing to a network drive before to avoid the local directory filling up

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Container nvcr.io/nvidia/pytorch:22.12-py3

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv 
WARNING:clearml_agent.helper.package.requirements:Local file not found [torch-tensorrt @ file:///opt/pytorch/torch_tensorrt/py/dist/torch_tensorrt-1.3.0a0-cp38-cp38-linux_x86_64.whl], references removed
2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Full log for the failed clone

2 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

Looks okay there

3 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

We are using allegroai/clearml:latest API server

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

As I get a bunch of these warnings in both of the clones that failed

2 months ago
0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

Yes, sure!

3 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Thanks @<1523701205467926528:profile|AgitatedDove14> , will take a look

2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

@<1523701205467926528:profile|AgitatedDove14> if we go with the ultralytics case:

INSTALLED PACKAGES for working manual execution

absl-py==2.1.0
albucore==0.0.13
albumentations==1.4.14
anaconda-anon-usage @ file:///croot/anaconda-anon-usage_1710965072196/work
annotated-types==0.7.0
anyio==4.4.0
archspec @ file:///croot/archspec_1709217642129/work
astor==0.8.1
asttokens @ file:///opt/conda/conda-bld/asttokens_1646925590279/work
astunparse==1.6.3
attrs @ file:///croot/attrs_169571782329...
2 months ago
0 Hello! I Have An Issue Reproducing My Runs. The Task.Create Completes Successfully. When I Clone And Enqueue A Completed Task The Clone Fails. It Fails During The Python Requirements Installation. Why Is This? Do You Know How I Can Debug? Thank You In Adv

Maybe it's related to this section?

WARNING:clearml_agent.helper.package.requirements:Local file not found [anaconda-anon-usage @ file:///croot/anaconda-anon-usage_1710965072196/work], references removed
2 months ago
Show more results compactanswers