another question: if i save heavy artifcats, should my services worker ram be at least as high? (or is it enough for the default queue workers to have that)
Yes. But the services queue doesn't need a GPU, just a simple CPU machine to handle the controllers which don't take much resources (unless you did something crazy inside the controller like heavy computation)
Hi @<1544853695869489152:profile|NonchalantOx99> , as the error states:
raise ValueError('Could not find queue named "{}"'.format(queue_name))
ValueError: Could not find queue named "services"
It couldn't find the queue services. This is for the pipeline controller to run on. Pipelines consist of steps and the controller and they all can run on different machines. By default, the controller will try to run on the services queue. Makes sense? 🙂
yes,
so basically I should create a services queue, and preferably let it contain its own workers
I don't think so, but it's worth to try 🙂