Hi ObedientToad56 , where is the agent deployed in this scenario? a single machine? a k8s cluster?
In that case, if you do not require a GPU you can use the agent in services
mode (running several tasks in parallel). Otherwise scaling solution are using the AWS autoscaler, or deploying several agents, or using a k8s cluster
SuccessfulKoala55 , it's on a single machine.