im trying to figure out
i'll play with it a bit and let you know

no, i just commented it and it worked fine

thanks for the help 🙂

ok so i accidentally (probably with luck) noticed the max_connection: 2 in the azure.storage config.
canceled that, and so now everything works

@<1523701205467926528:profile|AgitatedDove14>

@<1523701087100473344:profile|SuccessfulKoala55> hey jake, in case you've missed my answer
am i making sense?

thank you! i'll try it

basicaly now i understand that I do need to define a PYTHONPATH inside my dockerimage
my only problem is that the path depends on the clearml worker
for example, i see that the current path is:
File "/root/.clearml/venvs-builds/3.10/task_repository/palmers.git

is there a way for me to know that dynamiclly?

yes jake 🙂 thank you 🙂

i updated to 1.10
i am uploading the model inside the main() function, using this code:

model_path = model_name + '.pkl'
with open(model_path, "wb") as f:
    pickle.dump(prophet_model, f)

output_model.update_weights(weights_filename=model_path, iteration=0)

why doesn't it try to use ssh as default? the clearml.conf doesn't contain user name and password

the unsuccesslful:
Using cached meteostat-1.6.5-py3-none-any.whl (31 kB)
Requirement already satisfied: neuralprophet==0.5.3 in /usr/local/lib/python3.9/site-packages (from -r /tmp/cached-reqs58y_jg9f.txt (line 9)) (0.5.3)
Requirement already satisfied: numpy==1.23.5 in /usr/local/lib/python3.9/site-packages (from -r /tmp/cached-reqs58y_jg9f.txt (line 10)) (1.23.5)
Requirement already satisfied: pandas==1.5.3 in /usr/local/lib/python3.9/site-packages (from -r /tmp/cached-reqs58y_jg9f.txt (lin...

Hey @<1523701087100473344:profile|SuccessfulKoala55> , thanks for the quick response
I'm not sure I understand, but that might just be my lack of knowledge, to clarify:

i am running the task remotely on a worker with the --docker flag.
how can i add the root folder to PYTHONPATH?
as far as I understand, clearml is creating a new venv inside this docker, with its own python executeable, (which i don't have access to in advance)

ok, thanks jake
what will be the fastest fix for it?

that's the one, I'll add a comment (I didn't check the number of connections it opens, so idk the right number)

i'll send you the file in private

(im running it on docker)

for some reason the agent tries to install the locally installed pip packages

yeah

hey, matrin
this script actuall does work

it is installed as a pip package
but i am not using it in the code

hey martin thanks for the reply.
im doing the calling at the main function

the base image is python:3.9-slim

then it works
i opened a new, clean venv just now

but why does it matter if i ran it on a remote agent?

why those library need to run on a pipelinecontroller task, this task requires no libraries at all

martin*

ok, yeah, makes sense. thanks John!

well, also, now, my runs are showing off problems as well:

how do i access the clearnl.conf custom variables then?
or - how do i configure and access env variables that way?

the use case is simple:
i wanna fetch data from an sql table, inside a task.
so i want to execcute a query, and then do some operations on it, from within a task, to do that i have to connect to the db,
and i don't want the connection details to be logged