Hi, currently running Dataset.list_datasets() on a giant list of datasets takes a very long time to return the full datasets list. Similarly running Dataset.get() also takes a fairly long time to run and retrieve a single dataset object. Does anyone know if there is a way to retrieve a whole list of datasets and getting a single dataset faster?
Hi @<1747428509627715584:profile|CumbersomeDuck6> , are you using a self hosted server?
currently not, but the aim is to host it locally. Would that make retrieval much faster?
So you're using the community server? Response time really depends on the resources of the machine that is running the server and amount of data to filter
