Can we have a scalable fastapi service with common cache ?
So as it goes, we were using FastAPI for one of the apps. Our app uses a lot of memory(for ml models).
Premise: I wanted to launch multiple workers of the app as Python is single-threaded and also be able to have a common cache across.
We can use Uvi...
engineering.oohalo.com3 min read