For things like that I just use system libraries. After all, most standard Linux installations (debian, in my case) already come with quite a few python packages preinstalled.
I'd only consider using a virtual environment (or a container), if I thought the tool would be a security compromise, but I haven't encountered that yet.