How to access a non-public AWS RDS MySQL database with MySQL WorkBench.

Trying to access my database in AWS with MySQL Work Bench, but the only way I'm able to access it is by making the database public and open to all inbound traffic. This is a huge security risk and I do not want to do this.

I've tried adding my IP to my RDS security group, but still, I'm not able to connect to my Database through MySql Workbench.