Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi There, I Am Having Issues Executing A

Hi there, I am having issues executing a pipeline on a schedule . If I run the schedule with a simple function using schedule_function , it executes on the queue remotely. However, when I change the schedule to rather use schedule_task_id and specify the id of the pipeline that I have already run manually and got the id from the ClearML UI, then I get an error that it can't find the queue.

See error and code example in the comments.

  
  
Posted 9 months ago
Votes Newest

Answers 5


Error when executing schedule with a pipeline task ID defined:

Launching job: ScheduleJob(name='Simple Pipeline Schedule Run Test', base_task_id='4cf5b603e3ae4593a8c2dd6c34190c6d', base_function=None, queue='megan_testing', target_project=None, single_instance=False, task_parameters={}, task_overrides={}, clone_task=True, _executed_instances=None, execution_limit_hours=None, recurring=True, starting_time=datetime.datetime(1970, 1, 1, 0, 0), minute=2, hour=None, day=None, weekdays=['monday', 'tuesday', 'wednesday', 'thursday', 'friday'], month=None, year=None, _next_run=datetime.datetime(1970, 1, 5, 0, 2), _execution_timeout=None, _last_executed=None, _schedule_counter=0)
Scheduling Job Simple Pipeline Schedule Run Test, Task 3997a7c1de6e446e9ac0d8a87aec3db8 on queue megan_testing.
2024-01-25 09:38:02,317 - clearml.automation.job - WARNING - Error enqueuing Task <clearml.task.Task object at 0x7f6c6f065600> to megan_testing: Could not find queue named "megan_testing"
  
  
Posted 9 months ago

Schedule testing code:

# Schedule for running the pipeline daily

from clearml import Task
from clearml.automation import TaskScheduler


def simple_function():
    print('This code is executed in a background thread, '
          'on the same machine as the TaskScheduler process')
    # add some logic here
    print('done')

if __name__ == "__main__":

    scheduler = TaskScheduler(force_create_task_name='megan-test-remote-pipeline')

    scheduler.add_task(
        name='Simple Pipeline Schedule Run Test',
        schedule_function=simple_function,
        # schedule_task_id='4cf5b603e3ae4593a8c2dd6c34190c6d',
        queue='megan_testing',
        minute=2,
        weekdays=['monday', 'tuesday', 'wednesday', 'thursday', 'friday'],
        recurring=True,
        execute_immediately=True
    )

    scheduler.start_remotely()
    # scheduler.start()

    print('This line will run remotely')
  
  
Posted 9 months ago

I have an agent running and assigned to the queue megan-testing :
image

  
  
Posted 9 months ago

@<1654294828365647872:profile|GorgeousShrimp11> Any change your queue is actually named megan-testing and not megan_testing ?

  
  
Posted 9 months ago

Oh my word 🙈 Yes, I just saw this just and came back to reply on here. Thank you!

  
  
Posted 9 months ago