In my case I have a similar need; I wrote a never-ending Task similar to this one used for cleanup: https://github.com/allegroai/clearml/blob/master/examples/services/cleanup/cleanup_service.py
Is There A Clearml Way To Write A Scheduler To Watch A Folder And Publish A Dataset When There Are X Number Of Files In That Folder, Or Do I Have To Write A Normal Python Scheduler?
2 years ago
10 months ago
Is There An Example Of Simple Pipeline Using Task Scheduler? I Want To Create A Simple Pipeline Where First A Folder Is Monitored Using A Taskscheduler, And Under Certain Conditions, Data Is Uploaded And Dataset Id Is Given To The Next Step In The Pipeli
Another Question, I Have Written A Code That Includes A Task Scheduler That Calls A Function. That Function Watches A Folder And If There Are Sufficient Images, It Creates And Publishes The Dataset, After Which It Clears The Folder. Problem, For Some Rea