Robots.txt and Sitemap

As I mentioned in an earlier post DigitalFrap.com has been missing from the Google searches lately. Not really sure if it’s a glitch or whether Google found something wrong with this site. Anyway I’m just on wait and see mode right now, hoping that the site goes back to normal in due time.

For now I’m editing my robots.txt file and  adding a sitemap to DigitalFrap.com, hopefully this will help in bringing things to normal. In case you are wondering (like I was) what the difference is between robots.txt and a sitemap is:

I already have a robots.txt file, do I still need to submit a sitemap.xml file to Google?

You sure do! Using a robots.txt file is great way to tell Google what ‘not’ to index. Using a sitemap.xml file is a way of telling Google, ‘Hey, check out these new or updated pages’. It’s like the reverse of the robots.txt file, but even better.

And in terms of precedence, robots.txt goes first…