Definitely. I've experienced it myself relatively recently, especially when CSS Modules gained in popularity to the point that I didn't have the free time to stay on top of all the activity on GitHub. That, coupled with my very busy work schedule, and having young kids at home, meant that I was stretching myself too thin, and the open source guilt was really dragging me down.
Switching off for a while and making more space in my life was the only way out of it for me. It took me a while, but I've learned to ensure there's always enough slack time in my schedule. I try to do as much as I can during work hours so that I can tune everything out afterwards. I love open source, but doing it in my spare time wasn't working for me anymore, so I've instead focused on getting more open source activity happening during work hours, which has worked wonders for me.