Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! I'M Following The Guide To Run A Pipeline Locally. I Cannot Find The

Hi! I'm following the guide to run a pipeline locally. I cannot find the task related to the pipeline in projects page.

  • It seems the task exists, because I can click into it through "pipeline" -> "step" -> "Full details" , then I can see the title "workspae / PROJECTS / data processing 20231019 / ingest"
    the pipeline code:
from clearml import PipelineDecorator

@PipelineDecorator.component(cache=True, execution_queue="default")
def step(size: int):
    import numpy as np
    return np.random.random(size=size)

@PipelineDecorator.pipeline(
    name='ingest',
    project='data processing 20231019',
    version='0.1'
)
def pipeline_logic(do_stuff: bool):
    if do_stuff:
        return step(size=42)

if __name__ == '__main__':
    # run the pipeline on the current machine, for local debugging
    # for scale-out, comment-out the following line (Make sure a
    # 'services' queue is available and serviced by a ClearML agent
    # running either in services mode or through K8S/Autoscaler)
    PipelineDecorator.run_locally()

    pipeline_logic(do_stuff=True)

image
image

  
  
Posted one year ago
Votes Newest

Answers 5


however if I click "projects" -> "data processing 20231019", it's empty.
I expect the "ingest" task be there instead.
image

  
  
Posted one year ago

hi @<1523701087100473344:profile|SuccessfulKoala55> thanks, that explains why I cannot see the task from "projects/data processing 20231019"

  
  
Posted one year ago

@<1626028586563538944:profile|SmoggyHawk49> pipeline tasks are hidden by default, and you can see the pipeline from the pipelines panel - inside it, you have an option for more details which would lead you to the task

  
  
Posted one year ago

It can usually be controlled in your profile settings page in the UI

  
  
Posted one year ago

however I can see it from "projects/All Experiments", does that mean the hidden logic only apply to projects with names, but not apply to "All Experiments" ?

  
  
Posted one year ago