Why I decided to use NVIDIA Triton for inference
Oct 12, 2022 · 4 min read · Neural networks are cool. They can solve various tasks and are used everywhere. Let's image you have trained one for medicine. It performs well. What's next? Nobody has access to it yet. You need somehow to inference it. I've faced the same problem. ...
Join discussion