When is the right moment to release software to the world?

This question has bothered me for quite a while. Writing a program or library you use is one thing. But at some point, you want to release it to the world for others to use. But then again, you think about your messy code and interfaces, all the feat...