SEO in The Desert - The Web Optimist of Palm Springs

Sitemap Spider Food

SEO April 26th, 2007

Just a reminder, you no longer have to go to Google or Yahoo to submit your sitemap file location manually. The major engines have (mercifully) agreed to a common sitemap protocol that allows the spiders to find your sitemap file by way of your robots.txt file (for a change, robots.txt tells the spiders where to go instead of where NOT to go).

Just place this line in your robots.txt file and you’re set:

Sitemap: http://www.yourdomain.com/sitemap.xml

Naturally, you need to change the yourdomain.com to whatever your actual domain is.

Sitemap files are terrific for getting all of the pages on your site found by the search engines. If you’ve got a large site and want a free way to spider it and generate a sitemap for you, take a look at SiteMapBuilder.net.



If you found this page useful, consider linking to it.
Simply copy and paste the code below into your web site (Ctrl+C to copy)
It will look like this: Sitemap Spider Food



One Comment to “Sitemap Spider Food”

  1. Jaan Kanellis | April 26th, 2007 at 10:10 pm

    Yes this is a nice feature, but I would still use Google Webmaster Console tools, because with this robots.txt option you don’t get feedback on if their are issues when the sitemap is parsed. You could have problems and not even know it!!

Leave a Comment




Copyright © Richard Burckhardt, The Web Optimist
P.O. Box 5507
Palm Springs, CA 92263
(707) 276-0144 Voicemail/Fax
Twitter: weboptimist
Home: weboptimist
Skype me! | Richard Burckhardt | View Richard Burckhardt's profile on LinkedIn
View Evoca Profile | View MySpace Profile
SEMPO - Search Engine Marketing Professionals Organization