shesshes.hashnode.dev·Oct 12, 2022Why I decided to use NVIDIA Triton for inferenceNeural networks are cool. They can solve various tasks and are used everywhere. Let's image you have trained one for medicine. It performs well. What's next? Nobody has access to it yet. You need somehow to inference it. I've faced the same problem. ...Discuss·189 readstriton