Why not do both? Stay with your current job as it seems to be decent, then in your spare time build the app and build a user base, if it takes off you can always leave if it fails, no harm done.
Good idea, but check your contract and applicable laws for potential copyright problems. In some cases, the employer gets copyright on things you produce outside work hours.