Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hi All! I'M Running A Pipeline From Functions. I Have One Task In The Pipeline Where I Want To Call A Specific Function From Commend Line So I'Ve Put It Into A Bash Script And While Running Pipeline Locally It Worked Fine Because Bash File Was Available O

Hi all! I'm running a pipeline from functions. I have one task in the pipeline where I want to call a specific function from commend line so I've put it into a bash script and while running pipeline locally it worked fine because bash file was available on my local machine. However, I need to run it on remote clearml agent and it of course can't find my bash script. Until now I was importing all of the needed functions for tasks using helper_functions but as bash script isn't a python function I don't quite get how should I make it accessible for the pipeline task?
The code that I need to run can be alternatively ran on the docker container. I thought that passing docker image via docker would help. I couldn't find any examples how and will the docker container be started? Passing docker image to the task doesn't seem to be doing something. I would appreciate any insights 😊

Posted one year ago
Votes Newest

Answers 2

Thank you. I was considering this possibility but I hoped for another solution because this would require having multiple agents running on the same machine but in different docker containers for dfferent tasks. I couldn't find how to set up clearml.conf parameters so that multiple agents could run on same machine with different base images

Posted one year ago

Hi @<1544853721739956224:profile|QuizzicalFox36> , I think the correct method in that case is to run from docker. The agent handles the docker, the only thing is that you need to run the agent in docker mode using --docker . You can then then pass it in docker_args in add_function_step or even better you can add the entire script to the shell script that runs after docker init using docker_bash_setup_script also in add_function_step

Posted one year ago
2 Answers
one year ago
one year ago