Unanswered
Hi There, Another Triton-Related Question:
Are We Able To Deploy
@<1547028116780617728:profile|TimelyRabbit96>
Pipelines has little to do with serving, so let's not focus on that for now.
Instead, if you need a ensemble_scheduling
block, you can use the CLI's --aux-config
command to add any extra stuff that needs to be in the config.pbtxt
For example here, under the Setup section step 2, we use the --aux-config
flag to add a dynamic batching block: None
152 Views
0
Answers
one year ago
one year ago