Hey Yash, cool and informative post! Have you tried using any managed kubernetes providers for some of this? It can make things quite fast sometimes. I know AWS can be quite expensive but there are definitely better alternatives like symbiosis.host
(Disclaimer: part of the team)