Hi. I'm having a bit of trouble understanding here. To have something pulled from the queue you need to have a worker running against that queue.

I'm not quite familiar with IBM LSF, is it kinda like Google Cloud Run?
What do you mean by 'submitting new agents' to the lsf system? Do you mean running new agents on the platform?
You can execute specific tasks via the command clearml-agent execute <TASK_ID>

Otherwise is there an option to start task locally that submit the task to the lsf cluster then somehow to connect the task to the original task once it is running on the cluster?

Can you please explain with a more specific example?

thanks thats exactly what i looked for!!

Woot woot
ChubbyLouse32 when you get it working please PR it, this is very very cool!
(I'll be happy to help 🙂 )

Hi ChubbyLouse32
If I understand correctly you can relatively easy take a clearml Task and launch it on LSF, an integration would be something like:

` from clearml import Task
from clearml.backend_api.session.client import APIClient

while True:
result = client.queues.get_next_task(queue=q_id)
if not result or not result.entry:
sleep(5)
continue
task_id = result.entry.task

here is where we create the LSF job, this is just a pseudo code

os.system("lsf-launch-cmd 'clearml-agent execute --id {}'".format(task_id)) `wdyt?