When using the clearml.backend_api to get tasks, is there a way to know a-priori how many pages I will need for all results? Right now I keep requesting until returned page size is smaller than 500, is there a better check?from clearml.backend_api import Session from clearml.backend_api.services import tasks, projects ... tasks_res = session.send(tasks.GetAllRequest(project=project_ids, page_size=500, page=i))Thanks
What exactly are you using from each experiment?
Are you using only_fields to make sure you don't get stuff you don't need? 🙂
Hi SuperficialDolphin93 , not at the moment 😞 - is there any specific use-case to your query? I'm asking since pulling large number of experiments seems not to so optimal?
It's for collecting experiment results at the analysis stage.
