Very helpful this was thank you!

Hi David
So I want to execute more than two tasks simultaneously using an agent
To my understanding one agent can execute only one task at a time and queues the remaining.
So what I want to achieve is to spin up N agents of there are N tasks

What's the best way to do it?

Also im looking to start new clearly agents based on the number of tasks

hi TenderCoyote78
can you please give some more precision about what you intend to achieve ? I am afraid not to well understand your question

Hi TenderCoyote78 ,

You can get it with the APIClient

from clearml.backend_api.session.client import APIClient api_client = APIClient() tasks_in_queue = api_client.queues.get_by_id(<queue_id>).entries

One agent is assigned to one queue ; so he will execute one task at the time, sequentially, according to their rank in the queue. But you can create as many queues as you want, and assign an agent for each one. You simply fire each agent from a terminal, with a command like :
clearml-agent daemon --queue my_queue_i
if you have more than one gpu, you can also choose for each agent which gpu(s) to allocate