@<1533619716533260288:profile|SmallPigeon24> , failed task should not actually be reused (i.e. cached), are you saying a failed Task is being reused? or are you saying that you want to "invalidate" the cache in the execution but still leave the Task as completed ?
Yes. Sometimes, task (on HIL finish but fails on the HIL and does not produce output. Is it possible to not fail the task and still mark it as uncacheable?
If possible, I would like the second option and invalidate caching that completed task. But I am considreing just failing the task.
But I am considreing just failing the task.
This will of course work, just raise exception in the Task itself, and protect the call from the pipeline logic function with try/except
regrading the second option, try to nullify the hash on the Component Task:
# running the Task component here
# if we do not want someone to use us
Task.current_task()._set_runtime_properties({"pipeline_job_hash": None})
Hi @<1533619716533260288:profile|SmallPigeon24> , can you please elaborate on your usecase ?
