Not from a pipeline. I have a base task, then execute the hyperparameters optimizer from the base task.

Are you launching the task from a pipeline? If this is the case, your agent is probably already executing the pipeline task, which remains up till the end of the pipeline, and there's no room for the real task to start. Try to spawn another agent.