iThemes has published a nice ebook called “How-to Install WordPress Manually: Securing and de-bloating WordPress”.
It contains a short section on why you want to do this. Short version:
- better security of your site
- better control over exactly what gets installed
It also starts by telling you how to create your own database.
Download the ebook in PDF format here: How-to-Install-WordPress-Manually-eBook