By Lenora on

Hi Guys,

I don't quite understand how to keep search engine robots off my drupal site while I'm constructing it. I know I have to create a robots.txt file, and I have a sample one that I got off this site, but I don't think it keeps the entire Drupal folder out of sight.

I wonder: If I password protect it, does that keep the robot off?

Thanks to anyone who can help.

Lenora

Comments

Uwe Hermann’s picture

Uwe Hermann commented

I'd password-protect the whole site. It keeps search engines as well as humans away.

Uwe.
--
hermann-uwe.de | crazy-hacks.org | unmaintained-free-software.org

Lenora’s picture

Lenora commented

Sounds good and easy to me. I just wasn't sure the padlock would keep out search engines. That'll be a snap through Cpanel.

Thanks!

Lenora