Hi @<1523701205467926528:profile|AgitatedDove14>
I'm having a similar issue.
Also notice the cleaml-agent will not change the entry point of the docker meaning if the entry point does not end with plain bash, it will not actually run anything
Not sure I understand how to run a docker_bash_setup_script
and then run a python script - Do you have an example? I could not find one.
Here is our CLI command
clearml-task --name <TASK NAME> \
--project <PRJ NAME> \
--repo git@github.com:<REPO NAME>.git \
--script pytorch/main.py \
--args dataset_dir='.' \
--task-type training \
--docker_bash_setup_script pre_installations.sh \
--docker gcr.io/path/to/image \
--queue default
running on clearml-agent Version 1.9.0
- but the
pytorch/main.py
file doesn't run.
What do you have on the Task itself? is this the correct script ?
Any chance you can send a full log ? (you can DM it if it helps)
yes - the pre_installations.sh
runs and completes - but the pytorch/main.py
file doesn't run.
so the Task completes successfully but without running the script
@<1523701323046850560:profile|OutrageousSheep60> the assumption is that you have "pre_installations.sh" locally (i.e. when you are calling clearml-task
) what will happen is that this bash script will be put on top of the Task and executed before everything else inside the container
does that make sense ?
@<1523701205467926528:profile|AgitatedDove14> I'm having a similar issue. I'm trying to run to get a task to run using a specific docker image and to source a bash script before execution of the python script.
I'm using docker_bash_setup_script
but there is no indication that it was ever run.
Any idea how to get this to work?
. I'm trying to run to get a task to run using a specific docker image and to source a bash script before execution of the python script.
Are you running an agent in docker mode ? if so you should be able to see the Output of your bash script first thing in the log
(and it will appear in the docker CMD)
@<1523701205467926528:profile|AgitatedDove14> actually no. I was unaware that was needed. I will try that and let you know
LazyFish41 just making sure, you built a container from the docker file, and used it as base docker image for the Task, is that correct ?
Also notice the cleaml-agent will not change the entry point of the docker meaning if the entry point does not end with plain bash, it will not actually run anything
So, this is probably a really dumb idea, but can you addRUN source /root.bashrc
or perhaps set the entrypoint?