I tried to recreate this. I created a private repo and gave access to another account B. Made a commit with GitHub interface using account B and the private contribution was showing up right everywhere. I starred the repo from account B. And removed access to account B.
The contribution was gone. Am I missing something? How do I make this work?