Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Has Anyone Done This Exact Use Case - Updates To Datasets Triggering Pipelines?

Has anyone done this exact use case - updates to datasets triggering pipelines?

  
  
Posted 3 years ago
Votes Newest

Answers 12


Which would also mean that the system knows which datasets are used in which pipelines etc

  
  
Posted 2 years ago

AgitatedDove14 - any thoughts?

  
  
Posted 2 years ago

Which would also mean that the system knows which datasets are used in which pipelines etc

Like input artifacts per Task ?

  
  
Posted 2 years ago

Good news a dedicated class for exactly that will be out in a few days 🙂
Basically task scheduler and task trigger scheduler, running as a service cloning/launching tasks either based on time (cron alike) or based on a trigger).
wdyt?

  
  
Posted 2 years ago

Has anyone done this exact use case - updates to datasets triggering pipelines?

Hi TrickySheep9 seems like this is following a diff thread, am I missing something ?

  
  
Posted 3 years ago

time-based, dataset creation, model publish (tag),
Anything you think is missing ?

  
  
Posted 2 years ago

or atleast a way to register these

  
  
Posted 2 years ago

What could those triggers be?

  
  
Posted 2 years ago

yeah

  
  
Posted 2 years ago

More interested in some way for doing this ssytem wide

  
  
Posted 2 years ago

Sorry if it was confusing. Was asking if people have setup pipelines automatically triggered on update to datasets

  
  
Posted 2 years ago
629 Views
12 Answers
3 years ago
one year ago
Tags