Wordpress.org - you host the website yourself. Recommended as it allows you to upload themes from third party sites. The themes from third party sites are normally a lot better than the ones on the Wordpress website. This is normally cheaper as you can opt for a cheaper host provider and domain registrar.
Wordpress.com - Wordpress hosts the website for you. Not recommended as the themes you can download and pay for are limited.