Hi @<1523701205467926528:profile|AgitatedDove14> ,
Thanks a lot for your recommendation, that's exactly that! 🤩
I was able to use the scroll_id
of the current "page" to access to events of the next "page"!
This works fine and I can now delete almost all debug samples.
I say "almost" because, apparently, using this technique of the scroll_id
systematically does not allow to access to the events of the very last "page"...
In fact, as you can see on the picture below ⤵ , I have a total of 2014 events. I can trouble-free access to the events of the first, second and third "pages" (with respectively 500, 506 and 507 events) but unfortunately, providing the scroll_id
value of the third "page", I cannot access to the remaining 2014-(500+506+507) = 501 events of the very last "page".
As you can see, I get following error:
Traceback (most recent call last):\n File "/opt/clearml/apiserver/service_repo/service_repo.py", line 288, in handle_call\n ret = endpoint.func(call, company, call.data_model)\n File "/opt/clearml/apiserver/services/events.py", line 382, in get_task_events\n res = event_bll.events_iterator.get_task_events(\n File "/opt/clearml/apiserver/bll/event/events_iterator.py", line 51, in get_task_events\n res.events, res.total_events = self._get_events(\n File "/opt/clearml/apiserver/bll/event/events_iterator.py", line 132, in _get_events\n "must": must + [{"term": {key.field: events[-1][key.field]}}]\nKeyError: 'iter'\n
This error suggests that there's an issue with accessing a key named iter
within the code handling the pagination. It seems to be related to ClearML API server code itself.
Have you ever encountered such a KeyError
issue? Would you also expect using scroll_id
until the very last "page" to fetch the very last remaining data?
Again, thank you very much for your recommendation and help! 🙇