SoggyDuck67

2 Questions, 6 Answers

Active since 08 January 2025

Last activity 4 days ago

Reputation

Badges 1

6 × Eureka!

Questions 2
Answers 6

0 Votes

8 Answers

257 Views

0 Votes 8 Answers 257 Views

Any Tips Running My First Tasks In

Any tips running my first tasks in clearml-agent daemon --docker ? My task is configured with my tried-and-true Docker image (from before using ClearML) with...

mlops

2 months ago

0 Votes

2 Answers

47 Views

0 Votes 2 Answers 47 Views

How Can I Search For Training Tasks That Use A Given Dataset? The Dataset Was Linked To The Task: After I Initialized The Task, I Called Dataset.Get(..., Alias="Training Examples") And So I See The Dataset'S Id In The Clearml Ui On The Task Hyperparamete

How can I search for training Tasks that use a given Dataset? The Dataset was linked to the Task: after I initialized the Task, I called Dataset.get(..., ali...

clearml

5 days ago

0 How Can I Search For Training Tasks That Use A Given Dataset? The Dataset Was Linked To The Task: After I Initialized The Task, I Called Dataset.Get(..., Alias="Training Examples") And So I See The Dataset'S Id In The Clearml Ui On The Task Hyperparamete

Good find! It works!

5 days ago

0 Any Tips Running My First Tasks In

Logs:

Executing task id [f5f619e4d2074438b6b9ff2b7a15d246]:
repository = git@github.com:myorg/nigel.git
branch = clearml
version_num = 7b1d97e5b73d8abab8407b58a764e199b8943fd0
tag = 
docker_cmd = myorg.io/nigeltrain/train_env:dev-bdae4ce766c01568037ac57757f7e8ef6d930950
entry_point = train_classifier.py
working_dir = nigeltrain_pkg/nigeltrain/command_code

/usr/bin/python3.10: No module named virtualenv
WARNING: virtualenv call failed: Command '['python3.10', '-m', 'virtualenv', '/root/...

2 months ago

0 Any Tips Running My First Tasks In

I had set the binary to python (which on the Docker image is a symlink to python3.11 and it worked fine. All is working now. Thank you for your help

2 months ago

0 Any Tips Running My First Tasks In

Trying to wrap my head around what's happening: It seems as though clearml is making modifications to the running container itself, which is a surprising thing to do at runtime but I guess it may be needed to instrument my training script?

2 months ago

0 Any Tips Running My First Tasks In

You're correct! The "execution" tab shows BINARY: python3.10 , that must have been copied from a previous task that I cloned. When I clone it again and edit it to BINARY: python then the execution gets past this.
Update: Looks like I can also set ignore_requested_python_version: true on the agent, which was not set before.

2 months ago

0 Any Tips Running My First Tasks In

if it does not find the request python version, it should output a warning and default to the python installed.
If you can provide the full log it will be helpful to see what happened there

Agreed, I would have expected a warning, not failure. Here is the log, if it's helpful. But I am unblocked now.

2 months ago