Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I Created A Pipeline From One Block, Passed The Initial Parameters. Please Tell Me, Is It Possible To Make A New Launch Of The Pipeline, But With Different Parameters, Just Like In The Draft Mode Of Usual Experiments. Globally, I Want To Init

Hi everyone! I created a pipeline from one block, passed the initial parameters. Please tell me, is it possible to make a new launch of the pipeline, but with different parameters, just like in the draft mode of usual experiments. Globally, I want to initialize the pipeline once and then launch the pipeline from web UI, but with different parameters

My task and pipeline form task in screenshot and below

from clearml.automation import PipelineController


pipe = PipelineController(
    name="Creating labelsudio task", project="examples", version="0.0.1", add_pipeline_tags=False
)

pipe.set_default_execution_queue("default")


pipe.add_parameter(
    name="title_project",
    default="Creating from api test",
    description="New name of project",
)

pipe.add_parameter(
    name="description_project",
    default="Project for ocr markup",
    description="Project Description",
)

pipe.add_parameter(
    name="template",
    default="ocr.xml",
    description="Template type for annotation",
)

pipe.add_parameter(
    name="auth_token",
    default="123123123123123123123123123",
    description="Auth token for labelstudio",
)

pipe.add_parameter(
    name="bucket",
    default="my_bucket",
    description="S3 bucket",
)

pipe.add_parameter(
    name="prefix",
    default="test_folder/",
    description="Path data from bucket",
)

pipe.add_step(
    name="stage_data",
    base_task_id='feb20dd5f79049d48e3bf4f94651b542',

    parameter_override={
        'General/title_project': "${pipeline.title_project}",
        'General/description_project': "${pipeline.description_project}",

        'General/template': "${pipeline.template}",
        'General/auth_token': "${pipeline.auth_token}",

        'General/bucket': "${pipeline.bucket}",
        'General/prefix': "${pipeline.prefix}",
    }
)

pipe.start(queue='default')

print("done")

image
image

  
  
Posted 9 months ago
Votes Newest

Answers 13


@<1523701070390366208:profile|CostlyOstrich36> While pipeline in pending process, i can set new run, but after compliting not
image

  
  
Posted 9 months ago

after running I already can't set new params
image

  
  
Posted 9 months ago

image

  
  
Posted 9 months ago

@<1523701070390366208:profile|CostlyOstrich36>
It's strange, during the first remote start I could set the options. But now I can't again. With what it can be connected?
image

  
  
Posted 9 months ago

Hi @<1524560082761682944:profile|MammothParrot39> , I think you need to run the pipeline at least once (at least the first step should start) for it to "catch" the configs. I suggest you run once with pipe.start_locally(run_pipeline_steps_locally=True)

  
  
Posted 9 months ago

when I start a new run I can't change initial parametrs
image

  
  
Posted 9 months ago

That's strange indeed. What if you right click one of the pipeline executions and click on run?

  
  
Posted 9 months ago

@<1523701070390366208:profile|CostlyOstrich36>
Yes, it's work)
Thank you so much

  
  
Posted 9 months ago

@<1523701070390366208:profile|CostlyOstrich36>
image

  
  
Posted 9 months ago

@<1523701070390366208:profile|CostlyOstrich36> A simple run with the options I changed in the second run

  
  
Posted 9 months ago

@<1523701070390366208:profile|CostlyOstrich36> Second run was remotely

  
  
Posted 9 months ago

Did the second run, run remotely or locally?

  
  
Posted 9 months ago
497 Views
13 Answers
9 months ago
9 months ago
Tags