I reached over 1M API calls in about one week using clearml-serving
Oh that makes sense now 🙂
If I remember correctly, adding an additional model to a signal clearml-serving instance should not actually change the number of API calls, they are mostly affected by the number of clearml-serving / containers and not in the number of models.
Hi @<1523701205467926528:profile|AgitatedDove14> , thanks for your answer!
I reached over 1M API calls in about one week using clearml-serving on one machine with only calling the deployed model a few hundred times for testing purpose. So I wanted to dig a little bit deeper on that. Thanks for the channel suggestion, I will repost my question there. :)
Hi @<1526371965655322624:profile|NuttyCamel41>
I think that the only way to actually get huge number of api calls is with a lot of machines.
For example, regardless of the amount of console-logs you print, it will only be a single call, as these are packages every 2-10 seconds. The same with metric reporting etc.
On the free tier you cal already test the amount of API calls, I think the mechanism is exactly the same
fyi: I would put this question in the channel