Unanswered
I'M Working On Lsf Cluster And Wonder What Is The Easiest Way To Use The Queue Without Having Permanent Agent Or Submitting New Agents To The Lsf System Periodically. Otherwise Is There An Option To Start Task Locally That Submit The Task To The Lsf Clust
Hi ChubbyLouse32
If I understand correctly you can relatively easy take a clearml Task and launch it on LSF, an integration would be something like:
` from clearml import Task
from clearml.backend_api.session.client import APIClient
while True:
result = client.queues.get_next_task(queue=q_id)
if not result or not result.entry:
sleep(5)
continue
task_id = result.entry.task
here is where we create the LSF job, this is just a pseudo code
os.system("lsf-launch-cmd 'clearml-agent execute --id {}'".format(task_id)) `wdyt?
187 Views
0
Answers
2 years ago
one year ago