Setup low cost shared Hosting with a hosting company like Bluehost, GoDaddy. This is best suited for a low traffic web site like a brochure site.
Setup a Virtual Private Server with a hosting company like BlueHost or Atlantic for e-commerce and or high traffic.
Setup basic WordPress installation: WP Core files, MySQL database and basic theme.
Install and configure iThemes Security to secure your site against intruders using standard security industry standards.
Install and configure BackWPup scheduled backups to create local and offsite copies of your WordPress web site.
Signup and configure a free Google Analytics account to provide you with statistics to guide you running your web site.
Setup Yoast SEO to provide basic organic Search Engine Optimization.
Setup WooCommerce to sell your product or service online using the best e-commerce plugin for WordPress.