[Auto scaler / API client does not see tasks in queue]
We had used the AWS auto scaler (based on the
aws_autoscaler.py script in the repo) and it worked great.
Now we have implemented a GCP auto scaler script after we have switched clouds (happy to share that btw, it is very lightweight.)
clearml.automation.auto_scaler.AutoScaler object does not seem to see the tasks in the specified queue - any idea why that is?
Specifically, I’ve tested the code:
autoscaler.api_client.queues.get_by_id("QUEUE ID").entries # Returns  autoscaler.api_client.queues.get_all() # Successfully returns all the queues, including the "a100-auto-spot" one
I had queued 2 experiments into that queue and when I started an agent by hand using
clearml-agent daemon --queue a100-auto-spot --gpus all --detached and it starts working on the tasks right away (still loving the Agent functionality btw 😉 )
Any help is appreciated!