XML Sitemap Guide : Create Upload Submit Ping

admin — Mon, 09 Jun 2008 20:02:36 +0000

What are XML Sitemaps
It’s a special sitemap document protocol to help search engines index websites. This protocol uses XML for describing its content. The full name is XML Sitemaps Protocol, but is commonly referred to as XML Sitemaps. The idea and format was conceived by Google, and was in the beginning called Google Sitemaps. If you are unsure what the difference it between XML Sitemaps, HTML sitemaps, RSS feeds etc. you can check this sitemaps article.

Create XML Sitemap
A quick search on Google shows various services and products for creating XML sitemaps. Read our create XML sitemaps tutorial for more information.

Upload XML Sitemap
After creating your XML sitemaps, you will need to upload it either using your favorite FTP program or use the built-in FTP functionality (if any) in your chosen sitemap generator tool. For more information, check our XML sitemap FTP upload tutorial.

Submit XML Sitemap
You can submit XML sitemaps to all primary search engines, or/and add a reference to your XML sitemap in robots.txt to allow for search engine XML sitemap auto discovery. For more information about both options, check this submit XML sitemap article.

Ping Search Engines with XML Sitemap
While search engines will check your XML sitemap for changes themselves, you can speed this process by pinging search engines when your XML sitemap has changed. You can see how in the XML sitemaps ping post.

Submit XML Sitemaps with Robots.txt

admin — Fri, 28 Mar 2008 14:19:30 +0000

Search engines and robots.txt
Since the birth of internet search engines, the robots.txt file has been how webmasters could let search engines like Google know what content should get crawled and indexed. However, as part of Google Sitemaps, later named XML Sitemaps Protocol, the usage was expanded with Sitemaps Autodiscovery. It is now possible for webmaster to direct search engines to the website XML sitemap. The moment a search engine has found your website and the robots.txt file, it will also know where to find your XML sitemap.

Submit your XML sitemaps
In the beginning XML sitemaps submission required you had created and verified a Google Webmaster Tools account. You also had to submit your sitemap files manually. Now, instead of submitting XML sitemaps to all search engines individually, you can be done with them all in seconds.

After crawling your website and creating the XML sitemap, the sitemap generator program can create the robots.txt file with correct and complete path to your XML sitemap.

As see from above, to add XML sitemaps autodiscovery to a robots.txt file, add the fully qualified XML sitemap file path like this: Sitemap: http://www.example.com/sitemap.xml.

Complete robots.txt example for XML sitemaps autodiscovery
User-agent: * Disallow: Sitemap: http://www.example.com/sitemap.xml

If you have created a sitemap index file, you can also reference that:
User-agent: * Disallow: Sitemap: Sitemap: http://www.example.com/sitemap-index.xml

Manual XML sitemap submission
There can be good reasons to submit your sitemaps manually the first time, e.g. to get acquainted with the different search engine and webmaster tools available:

Advanced manage and submit sitemaps
In the beginning no search engines supported cross submit multiple websites in one XML sitemap file. However, now most include support for new ways of managing sitemaps across multiple sites. Requirement is you need to verify ownership of all websites:

Sitemaps protocol: Cross sitemaps submit and manage using robots.txt.
Google: More website verification methods than sitemaps protocol defines.

Best results with XML sitemaps
When updating your website, create, upload and ping sitemaps regularly.

XML Sitemaps Generator » Submit XML Sitemaps

XML Sitemap Guide : Create Upload Submit Ping

Submit XML Sitemaps with Robots.txt