Authorization !== Authentication
The OP clearly stated this. Passport is an Authentication module, which identifies your users.
Storing user roles in the passport user object is implementing one's own ACL solution which is "building a custom solution", again something the OP asked to avoid.
Google brought me here, stayed for the bad answers