You can use branch automerge instead of PR automerge for internal dependencies like that, and skip the notifications. Alternatively use Octobox.io for better notification filtering than GitHub's native interface.