SuccessfulKoala55 alright, it turns out my local python version is mismatched with the python version in the docker image i defined. Question - why is this the expected behavior?

the agent installed in the worker is 3.8, in my docker it is 3.7

Warning: could not locate requested Python version 3.8, reverting to version 3.7

Thanks, let me encode them into multiple files and try again.

Got it, i’d want to get all the tasks that are created by a particular pipeline - either to check on their status or to remove them programmatically

do u think this could be the error?

it is ok, please ignore the question. 🙃

looks good, this is what i’m looking for, thanks

hi DeterminedCrab71 AgitatedDove14 do you have any updates on this? I have accumulated a lot of data (artifacts and datasets) on my bucket and I'll need a way to delete them whenever I remove my tasks

ok let me pin pandas version to 1.3.5 and see if it works, thanks

yes, running which python3.7 in the docker container gives /usr/bin/python3.7

I don't mind running the cleanup service periodically so long i have an avenue to do so. Actually, if you can build such a service, then wouldn't it make sense to just call this service whenever a task ID is deleted?

I'm getting the same error when using TaskScheduler. Is there any updates on this?