Why I decided to use NVIDIA Triton for inference

Neural networks are cool. They can solve various tasks and are used everywhere. Let's image you have trained one for medicine. It performs well. What's next? Nobody has access to it yet. You need somehow to inference it. I've faced the same problem. ...