Site maps can assist in overcoming both those problems. Its really important that you have a version for each problem… If you are using WordPress as your Content Management System, there are two plugins that solve both issues very effectively.
- an external file aimed specifically at the search engine spiders. These are a less than pretty list of pages, with last update, priority and rate of change indicators. The major search engines all agreed to a specification and location format. The correct convention is that the file should be called sitemap.xml, should be located in the root directory, and should be referenced in the robots.txt file as follows; Sitemap: http://www.yoursite.com/sitemap.xml
The Google XML Plugin fulfill the role of automated creation/ updates of the sitemap file, according to basic parameters that you set.
- an internal website file that provides an overview of the internal page structure of the site. This page can be accessed by visitors who are not sure what is where – and also provide additional clues to search engines. The Dagon Design Sitemap Generator, once installed and configured, automatically manages your HTML sitemap. The sitemap becomes another item on your menu that anyone can access.
]]>