if someone hits my domain, my router login is showing up, which is a bad thing =)

How can I prevent that? Do I need to install a webserver? Can I set up some sort of redirect to a site like google or even a blank page?

Thanks

There should be a setting in the router where you can enable/disable web login for it.