Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I'M Having Issue With Running Clearml-Agent In Docker Mode. I Spin Up An Agent In The Following Way:

Hi,
I'm having issue with running clearml-agent in docker mode. I spin up an agent in the following way:
clearml-agent daemon --queue docker_test --docker nvidia/cuda:11.0-devel-ubuntu20.04 --cpu-only

and I create and enqueue a task from a jupyter notebook like so:

task = Task.create(project_name='foo', task_name=f'barr',
                   script='docker_dummy_test.py',
                   docker='nvidia/cuda:11.0-devel-ubuntu20.04',
                   docker_args="-v /some/disk:/root/disk",
                   argparse_args=[("frames", "1-10")]
                  )
Task.enqueue(task.id, queue_name='docker_test')

The output runs a bunch of cmmands to install the env inside the docker. It reaches a point where it does "pip install clearml-agent" and once that command ends, the task just hangs (it never seems to start running the actual python script).

Also, it runs with "--disable-monitoring" for some reason. why is that?
NVIDIA_VISIBLE_DEVICES=none $LOCAL_PYTHON -u -m clearml_agent execute --disable-monitoring --id <TID>

  
  
Posted 10 months ago
Votes Newest

Answers


UPDATE: The issue in clearml.conf
In the API settings, the server address used an alias which was not defined in the docker. Once that was replaced with the explicit IP address, everything worked as expected

  
  
Posted 10 months ago
591 Views
1 Answer
10 months ago
10 months ago
Tags