You're right yes 👍 , and this is precisely what I do 😁 . But when trying to access the fourth "page" with scroll_id
returned on the third "page" I get above error and I am not able to access data on that fourth "page". This seems to be systematic: Using the scroll_id
of the penultimate "page" doesn't allow to access to the very last "page" 🤔 .
I debugged using my browser and following URLs (based on the scheme "api_server" + "/events.get_task_events" + "?task=" + "<my-task_id>" + "&scroll_id=" + "<scroll_id-of-the-previous-page>") to see if I can access the events:
- ✅ First page: duck.erx:8008/events.get_task_events?task=41d606f6bd274d7e8c1297b50507b8a9
- ✅ Second page: None
- ✅ Third page: None
- ❌ Fourth (and final) page (with
KeyError
and impossibility to access remaining events): None
I my Python code, I use therequests
package providing followingparams
(containing thescroll_id
I iteratively retrieve) to therequests.get()
function:
params = {"scroll_id": scroll_id}
Same observation here as well: It works fine until reaching the very last "page" where the scroll_id
of the penultimate "page" doesn't allow to access the data on this very last page 🙄 .
I am not sure, but I suppose there is an issue in ClearML API file "clearml/apiserver/bll/event/events_iterator.py" 🤔 , what do you think?