I also have physical shop premises. Can I include details of this in my online shop too?

If you have physical shop premises associated with the online business you can choose to include details of this on your website.
WooCommerce Frequently Asked Questions