i need to read and write, i do have access from genesis autoscaler when i set off all firewall rules. but this is not recommend by microsoft.

I need to add specific firewall rules for the genesis machines, to allow them to authorize to my azure blob storage

im trying to figure out
i'll play with it a bit and let you know

this is not an error per se, rather an INFO log

so i think debian (and python 3.9)

@<1523701070390366208:profile|CostlyOstrich36>
hey john, let us know if you need any more information

(still doesn't work)

ok, it is solved with the force_git_root_python_path: true in clearml.conf

yes,
so basically I should create a services queue, and preferably let it contain its own workers

the base image is python:3.9-slim

yeah

and:

just a sec

ok so i accidentally (probably with luck) noticed the max_connection: 2 in the azure.storage config.
canceled that, and so now everything works

another question: if i save heavy artifcats, should my services worker ram be at least as high? (or is it enough for the default queue workers to have that)

basically, only test.py need the packages, but for somereason pipeline_test installs them as well

hey martin thanks for the reply.
im doing the calling at the main function

not using it in the code

ok, yeah, makes sense. thanks John!

@<1523701205467926528:profile|AgitatedDove14>

well, also, now, my runs are showing off problems as well:

it worked! thank you 🙂

yes it does work.
looking at the logs, i see that clearml runs the docker with a gpu flag
idk why or if its related

basicaly now i understand that I do need to define a PYTHONPATH inside my dockerimage
my only problem is that the path depends on the clearml worker
for example, i see that the current path is:
File "/root/.clearml/venvs-builds/3.10/task_repository/palmers.git

is there a way for me to know that dynamiclly?

@<1523701087100473344:profile|SuccessfulKoala55> hey jake, in case you've missed my answer
am i making sense?

yes jake 🙂 thank you 🙂

we use the clearml hosted server, so i don't know the version

i can send you our pipeline file and task

?

only sometimes, the pipeline runs using local machines

WebApp: 3.16.3-949 • Server: 3.16.1-974 • API: 2.24