TimelyPenguin76 what version of clearml are you using? my task.set_base_docker only has a single positional command. am I using an old version?
TimelyPenguin76 ok, I'll try it out, thanks.
ThickDove42 you can get the version with
clearml-agent --version
which clearml
and clearml-agent
versions are you using?
try pip install clearml==0.17.6rc1
ThickDove42 you mean setting the docker init script?
TimelyPenguin76 I've been using this for a bit now, I would like to set it from code, just like I set docker image, for example. Can you point me in the right direction? I couldn't find anything in the docs
You can try set_base_docker
:
t = Task.init(project_name="examples", task_name="set docker parames") t.set_base_docker( docker_cmd="nvidia/cuda:11.1", docker_arguments="-e ENV=1", docker_setup_bash_script=['apt update', 'apt-get install -y gcc'] )
This is a great feature for debugging setup. kinda feels like a superpower 🙂 I already used it to work around another issue with my docker setup. now I'll only need to update the docker file after I iron everything out and I will already have the startup shell script as documentation for what should be fixed. awesome.
Hi ThickDove42 , you are right, I can verify I also got the same (clone, edit script, enqueue and when the worker start to run the SETUP SHELL SCRIPT
got empty), feels like a bug. will update you once it solved.
Is this shell script you want to run common for all your tasks or just for specific one?
TimelyPenguin76 setting what appears in the GUI as "SETUP SHELL SCRIPT"
ThickDove42 you need the latest cleaml-agent RC for the docker setup script (next version due next week)pip install clearml-agent==0.17.3rc0
hi TimelyPenguin76 I tried doing this, but it didn't work. When enqueueing the task the contents of the textbox were emptied and the script was not run. I did make sure that it was saved before clicking on enqueue (by changing to another task and back and making sure the script appeared).
Hi ThickDove42 ,
The SETUP SHELL SCRIPT is the bash script to run at the beginning of the docker before launching the Task itself.
You can just try edit it, for example:
apt update apt-get install -y gcc