How to setup that browser tab icon for your website

Those are called 'favicon's. It's the small icon for your website displayed within the browser tabs and bookmarks bar. It helps users visually identify your brand. How do you set it up? You can use any image (preferably your brand logo) in a 32x32 ...