Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey. Is It Possible To Keep Docker Container Once Job Finished/Failed? I See In Logs That "--Rm" Is Passed To "Docker Run". Is It Possible To Avoid It?

hey. is it possible to keep docker container once job finished/failed? I see in logs that "--rm" is passed to "docker run". Is it possible to avoid it?

  
  
Posted 2 years ago
Votes Newest

Answers 10


correct

  
  
Posted 2 years ago

nono. that one is clear. i am about general workflow...

but from diagrams it looks like its worker who runs that worker.py you pointed above.

  
  
Posted 2 years ago

but who exactly executes agent in this case?

with both execute / build commands, you execute it on your machine, for debugging purposes. make sense ?

  
  
Posted 2 years ago

but who exactly executes agent in this case? does it happen on my machine, server or worker?

  
  
Posted 2 years ago

ah, stupid me. I was looking everywhere but not in clearml-agent 🙂 thanks!

  
  
Posted 2 years ago

yeah. I am getting logs, but they are extremely puzzling to me. I would appreciate to actually have access to whole package structure..

Actual packages are updated back to "Installed Packages" section (under the execution tab).

indeed. can you maybe point where the docker command is composed.

https://github.com/allegroai/clearml-agent/blob/178af0dee84e22becb9eec8f81f343b9f2022630/clearml_agent/commands/worker.py#L3694
🙂
BTW: you can run/build the entire thing on your machine with:
clearml-agent execute --docker --id <task_id>or
clearml-agent build --docker --id <task_id> --target <image_name_here>

  
  
Posted 2 years ago

yeah. I am getting logs, but they are extremely puzzling to me. I would appreciate to actually have access to whole package structure.. indeed. can you maybe point where the docker command is composed. looking for it for past 30 mins or so. not so familiar with internals really 😕

  
  
Posted 2 years ago

Aren't you getting logs from the docker via ClearML? I think you can build that capability fairly easily with ClearML, maybe add a PR?

  
  
Posted 2 years ago

if want to debug why it failed if it failed due to tiny issue - maybe to fix it locally and restart the training command from within docker, not to wait for docker to get assembled again

  
  
Posted 2 years ago

Why do you want to keep containers running after the code finished executing?

  
  
Posted 2 years ago
953 Views
10 Answers
2 years ago
one year ago
Tags
Similar posts