Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I'M Working On Lsf Cluster And Wonder What Is The Easiest Way To Use The Queue Without Having Permanent Agent Or Submitting New Agents To The Lsf System Periodically. Otherwise Is There An Option To Start Task Locally That Submit The Task To The Lsf Clust

I'm working on lsf cluster and wonder what is the easiest way to use the queue without having permanent agent or submitting new agents to the lsf system periodically. Otherwise is there an option to start task locally that submit the task to the lsf cluster then somehow to connect the task to the original task once it is running on the cluster?

  
  
Posted 2 years ago
Votes Newest

Answers 4


Hi. I'm having a bit of trouble understanding here. To have something pulled from the queue you need to have a worker running against that queue.

I'm not quite familiar with IBM LSF, is it kinda like Google Cloud Run?
What do you mean by 'submitting new agents' to the lsf system? Do you mean running new agents on the platform?
You can execute specific tasks via the command clearml-agent execute <TASK_ID>

Otherwise is there an option to start task locally that submit the task to the lsf cluster then somehow to connect the task to the original task once it is running on the cluster?

Can you please explain with a more specific example?

  
  
Posted 2 years ago

Hi ChubbyLouse32
If I understand correctly you can relatively easy take a clearml Task and launch it on LSF, an integration would be something like:

` from clearml import Task
from clearml.backend_api.session.client import APIClient

while True:
result = client.queues.get_next_task(queue=q_id)
if not result or not result.entry:
sleep(5)
continue
task_id = result.entry.task

here is where we create the LSF job, this is just a pseudo code

os.system("lsf-launch-cmd 'clearml-agent execute --id {}'".format(task_id)) `wdyt?

  
  
Posted 2 years ago

thanks thats exactly what i looked for!!

  
  
Posted 2 years ago

Woot woot
ChubbyLouse32 when you get it working please PR it, this is very very cool!
(I'll be happy to help 🙂 )

  
  
Posted 2 years ago
1K Views
4 Answers
2 years ago
one year ago
Tags