hi DeterminedCrab71 AgitatedDove14 do you have any updates on this? I have accumulated a lot of data (artifacts and datasets) on my bucket and I'll need a way to delete them whenever I remove my tasks

Warning: could not locate requested Python version 3.8, reverting to version 3.7

yes, running which python3.7 in the docker container gives /usr/bin/python3.7

looks good, this is what i’m looking for, thanks

Got it, i’d want to get all the tasks that are created by a particular pipeline - either to check on their status or to remove them programmatically

it is ok, please ignore the question. 🙃

SuccessfulKoala55 alright, it turns out my local python version is mismatched with the python version in the docker image i defined. Question - why is this the expected behavior?

ok let me pin pandas version to 1.3.5 and see if it works, thanks

do u think this could be the error?

I don't mind running the cleanup service periodically so long i have an avenue to do so. Actually, if you can build such a service, then wouldn't it make sense to just call this service whenever a task ID is deleted?

I'm getting the same error when using TaskScheduler. Is there any updates on this?

Thanks, let me encode them into multiple files and try again.

the agent installed in the worker is 3.8, in my docker it is 3.7