Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello! Basic

hello! basic ClearML Pipeline question here.

let's say I've declared pipeline like so:

pipe = PipelineController(
        project="Stevens AutoScan",
        name="Dataset Formation Pipeline",
        repo=".git",
        skip_global_imports=False,
    )

then I add a step

 pipe.add_function_step(
        name="Annotation Extraction",
        function=run_annotation_extraction,
    )

after this i try to start it locally ( pipe.start_locally(run_pipeline_steps_locally=True) ). and immediately got an import error.

Additional context:
inside the module where run_annotation_extraction is defined I do import some functions from the other module.

The structure:
├── requirements.txt
├── src
│ ├── utils
│ │ ├── annotator
| | └── main.py
|. └── common
|. └── rotator.py

so i do run python -m src.utils.main
where I have imported run_annotation_extraction function, which requires quads_rotator which is imported like so: from src.common.rotator import quads_rotator in same module where run_annotation_extraction is defined.

The resulted standalone task script is turned out to be in the /tmp/ folder with imports as if it was inside the project's root. Any suggestions? Seems like I'm overlooking something pretty obvious.

  
  
Posted 2 months ago
Votes Newest

Answers


Hi @<1717350332247314432:profile|WittySeal70> , can you provide a simple standalone example that reproduces this behavior? Also please provide full logs of the controller + step

  
  
Posted 2 months ago
210 Views
1 Answer
2 months ago
2 months ago
Tags