AgitatedDove14

So nope, this doesn't solve my case, I'll explain the full use case from the beginning.

I have a pipeline controller task, which launches 30 tasks. Semantically there are 10 applications, and I run 3 tasks for each (those 3 are sequential, so in the UI it looks like 10 lines of 3 tasks).

In one of those 3 tasks that run for every app, I save a dataframe under the name "my_dataframe".
What I want to achieve is once all tasks are over, to collect all those "my_dataframe" arti...

got it

💪

if I set it to 24 does it explode?

the explicity of the variable queue makes it feels like it runs somewhere else

yeah but I see it gets enquequed to the default which I don't know what it is connected to

If I execute this task using python .....py will it execute the machine I executed it on?

This worked ✔

💪

👍

Searched for "custom plotly" and "log plotly" in search, didn't thinkg about "report plotly"

Yes, I'll prepare something and send

AgitatedDove14 just so you'd know this is a severe problem that occurs from time to time and we can't explain why it happens... Just to remind, we are using a pipeline controller task, which at the end of the last execution gathers artifacts from all the children tasks and uploads a new artifact to the pipeline's task object. Then what happens is that Task.current_task() returns None for the pipeline's task...

ShinyLobster84

AgitatedDove14

I suspect that it has something to do with remote execution / local execution of pipelines, because we play with this , so sometimes the pipeline task itself executes on the client, and sometimes on the host (where the agent is also)

Maybe the case is that after start / start_locally the reference to the pipeline task disappears somehow? O_O

I'll check if this works tomorrow

I'm using ip address show

sudo curl https://raw.githubusercontent.com/allegroai/trains-server/master/docker-compose.yml -o /opt/trains/docker-compose.yml

but I don't really know

If you want we can do live zoom or something so you can see what happens

AgitatedDove14 sorry for the late reply,

It's right after executing all the steps. So we have the following block which determines whether we run locally or remotely

if not arguments.enqueue: pipe.start_locally(run_pipeline_steps_locally=True) else: pipe.start(queue=arguments.enqueue)
And right after we have a method that calls Task.current_task() which returns None

It's kind of random, it works sometimes and sometimes it doesn't

after you create the pipeline object itself , can you get Task.current_task() ?

AgitatedDove14 no I can't... Just checked this. This is a huge problem for us, it used to work before and it just stopped working and I can't figure out why.

It's a problem for us because we made it a methodology of running some tasks under a pipeline task and saving summary iunfo to the pipeline task - but now since Task.current_task() doesn't work on the pipeline object we have a serious problem

checking and will let you know

EagerOctopus10

The weirdest thing, is that the execution is "completed" but it actually failed

Okay so regarding the version - we are using 1.1.1

The thing with this error it that it happens sometimes, and when it happens it never goes away...
I don't know what causes it, but we have one host where it works okay, then someone else checks out the repo and tried and it fails for this error, while another guy can do the same and it will work for him

So could you re-explain assuming my piepline object is created by pipeline = PipelineController(...) ?