Unanswered
Is Clearml-Serving Using Either System Or Cuca Shared Memory? Or Planning To? In Our Experiments Using Perf_Analyzer The Shared Memory Experiments Showed A Huge Improvement
And If We Wanted To Look Into This, Do You Have Any Pointers Of Where We Can Do T
I see, okay so using
shm_size: '2gb'
we still need to modify the infrence logic to register and input and output on shmem, no?
95 Views
0
Answers
7 months ago
7 months ago