Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hey Everyone! Is It Possible To Trigger A Pipeline Run Via Api? We Have A Repo That Builds An Image For Serving To Clearml Server But We'Ve Wrapped It Inside A Fastapi Application So It Can Be Called From Another Web Service.

Hey everyone!

Is it possible to trigger a pipeline run via API? We have a repo that builds an image for serving to ClearML server but we've wrapped it inside a FastAPI application so it can be called from another web service.

Posted 2 months ago
Votes Newest

Answers 6

Hi @<1692345677285167104:profile|ThoughtfulKitten41>

Is it possible to trigger a pipeline run via API?

Yes! a pipeline is at the end a Task, you can take the pipeline ID and clone and enqueue it

pipeline_task = Task.clone("pipeline_id_here") 
Task.enqueue(pipeline_task, queue_name="services")

You can also monitor the pipeline with the same Task inyerface.

Posted 2 months ago

Thanks @<1523701205467926528:profile|AgitatedDove14> ! I can try it out and get back to you

Posted 2 months ago

Is there any way to make that increment from last run?

pipeline_task = Task.clone("pipeline_id_here", name="new execution run here") 
Task.enqueue(pipeline_task, queue_name="services")


Posted 2 months ago

@<1523701205467926528:profile|AgitatedDove14> that works. Many thanks!

Posted 2 months ago

I suspect there's an easier way to do this, as running the pipeline results in this. ClearML only picks up the script but not the modules in the repo:

Environment setup completed successfully
Starting Task Execution:
Traceback (most recent call last):
  File "/root/.clearml/venvs-builds/3.10/code/main_clearml.py", line 5, in <module>
    from clearml_pipeline.pipeline import executing_pipeline
ModuleNotFoundError: No module named 'clearml_pipeline'
Leaving process id 428
DONE: Running task 'df90d78f3d1b48ebaaac095cfcb04331', exit status 1
Process failed, exit code 1
Posted 2 months ago

I'm able to clone and run a pipeline! However this cloning using the ID still retains the pipeline run #number.

Is there any way to make that increment from last run?

Posted 2 months ago
6 Answers
2 months ago
2 months ago