Crawler Settings

• The user can inform Elite Site Optimizer about how they wish to read SEO information from their domain.
• There are two options provided
  • • ESOBOT
    • Sitemap.xml
• ESOBOT is the name of the web crawler of the Elite Site Optimizer application. If the user selects ESOBOT, then the Elite Site Optimizer web crawler will crawl the website and all its web pages to collect the SEO meta information and audit.
• If the user selects Sitemap.xml, then the Elite Site Optimizer will look for the sitemap XML in their website root path, follow the web pages described in the sitemap.xml and follow the links in these web pages to collect the SEO meta information and audit.