awesome martin, thanks

Okay, so if my python script imports some other scripts I've written - I must use git?

How would I do that?

you want to see its contents?

Okay, so the agent automatically inherits the launching environment's variables?

Depending on where the agent is, the value of DATA_DIR might change

For example I have a DATA_DIR environment variable which points to the directory where disk-data is stored

I have a single IAM, my question is what kind of permissions I should associate with the IAM so that the autoscaler task will work

I only have like 40 tasks including the example ones

Even assuming it suspects me, why doesn't the captcha prove my innocence? Isn't it what it is for O_O

Github actions allows to use self hosted runners

Config == conf_obj no?

Confirmed working 😄

it seems apiserver_conf doesn't even change

when using the first checkout action, it goes checks out the repo

Another thing I noticed now it happens on my personal computer, when I execute the same pipeline from the exact same commit with exact same data on another host it works without these problems

iwhat if

But what does it do?

Okay, looks interesting but actually there is no final task, this is the pipeline layout

I know I can configure the file server on trains-init - but that only touches the client side, what about the container on the trains server?

Thia is just keeping getting better and better.... 🤩

I tried what you said in the previous response, setting sdk.aws.s3.key and sdk.aws.s3.secret to the ones in my MINIO. Yet when I try to download an object, i get the following
` >>> result = manager.get_local_copy(remote_url="s3://*******:9000/test-bucket/test.txt")
2020-10-15 13:24:45,023 - trains.storage - ERROR - Could not download s3://*****:9000/test-bucket/test.txt , err: SSL validation failed for https://*****:9000/test-bucket/test.txt [SSL: WRONG_VERSION_NU...

To be clearer - how to I refrain from using the built in file-server altogether - and use MINIO for any storage need?

Continuing on this discussion... What is the relationship between configuring files_server and all the rest we just talked about and the the default_output_uri ?

So just to be clear - the file server has nothing to do with the storage?

Yep, if communication is both ways, there is no way (that I can think of) it can be solved for offline mode.

But if the calls that are made from the server to the client can be redundant in a specific setup (some functionality will not work, but enough valuable functionality remains) then it is possible in the manual way

I'll anonimyze it and paste it in a sec

I'll tr yto work with that