Sorry, never used PassportJS. When I was looking to add authentication to my app, I landed on jsonwebtoken.
I wrote about how I use it here: decembersoft.com/posts/authenticating-a-session-c…
The article is written assuming TypeScript... but it's easy enough to convert back to JavaScript by stripping out the type information.
But it looks like Passport.js can do a lot more than just username/password logins... such as Facebook and Twitter integration. I didn't need those as I'm working on a corporate app.