Hello everyone, We’re encountering a persistent issue with our autoscaler setup and could really use some help. Despite having the autoscaler running and the...
one month ago
CourageousCoyote72
1
Question,
4
Answers
Active since 15 July 2025
Last activity
one month ago
Reputation
0
Badges 1
4 × Eureka!
0
Hello Everyone,
We’Re Encountering A Persistent Issue With Our Autoscaler Setup And Could Really Use Some Help.
Despite Having The Autoscaler Running And The Queue (Default_Cpu) Properly Populated (87 Jobs Pending), The Tasks Are Never Picked Up And Exe
Our jobs are now running on the online app š
Thank you
one month ago
0
Hello Everyone,
We’Re Encountering A Persistent Issue With Our Autoscaler Setup And Could Really Use Some Help.
Despite Having The Autoscaler Running And The Queue (Default_Cpu) Properly Populated (87 Jobs Pending), The Tasks Are Never Picked Up And Exe
Unfortunately, the issue is only partially resolved: while some jobs are running on one instance, on another instance (default_gpu), our jobs are still pendingā¦ š¢
one month ago
0
Hello Everyone,
We’Re Encountering A Persistent Issue With Our Autoscaler Setup And Could Really Use Some Help.
Despite Having The Autoscaler Running And The Queue (Default_Cpu) Properly Populated (87 Jobs Pending), The Tasks Are Never Picked Up And Exe
Hello
Sorry for my late reply.
Iām running into an issue with my default_gpu queue: the ClearML auto-scaler detects the job and puts it into the āPendingā state, but it never actually runs. From the auto-scaler logs (see screenshot 1), this seems expected since it only checks the queue every 5 minutes. Iāve also attached the relevant log file.
However, I donāt see anything in the logs that clearly explains the problem. Looking at AWS, I can see that the instance starts, stays in āInitializi...
one month ago
0
Hello Everyone,
We’Re Encountering A Persistent Issue With Our Autoscaler Setup And Could Really Use Some Help.
Despite Having The Autoscaler Running And The Queue (Default_Cpu) Properly Populated (87 Jobs Pending), The Tasks Are Never Picked Up And Exe
I do not see any artifacts linked to the jobs in the default_gpu queue. We have not changed the configuration; as a debugging step, we simply restarted the instance.
one month ago