How to Check if a Port Is Open on a Remote Server

When troubleshooting a production network, one of the first questions is: Can I reach <server>:<port> from this machine? This is different from asking whether the application is healthy. For example