Create a sitemap trigger
Sitecore Search can index content from URLs listed in your sitemap or sitemap index using a trigger.
A sitemap index is a list of sitemaps. For example, a multi-market online retailer that has a sitemap for each market based on country. They can consolidate all the sitemap URLs into one sitemap index where each sitemap node points to a sitemap.
A sitemap index file can only point to sitemaps that are found on the same site as the sitemap index file.
This topic describes how to create a sitemap or sitemap index trigger for an advanced web crawler.The procedure to create a sitemap or sitemap index trigger for a web crawler source is slightly different because, for a web crawler source, you define a trigger in the Web Crawler Settings section of the Source Settings page.
Sitemap triggers leverage the last modified date (lastmod) field for each URL in your sitemap. This increases the indexing speed and improves the efficiency of your content updates.
To configure a sitemap or sitemap index trigger:
-
On the Source Settings page, click
Edit next to Triggers. -
Click
Add Trigger. -
In the Trigger Type drop-down menu:
-
If you have a sitemap, click Sitemap.
-
If you have a sitemap index, click Sitemap Index.
-
-
In the TIMEOUT field, enter the time, in milliseconds, that the crawler waits to get a response. Enter a large number here because sitemaps can take very long to load, and you do not want the crawler to time out when it reaches the maximum number of seconds to wait.
For example, enter 10000.
-
In the URL field, click
Add Item and then enter the URL of the sitemap or sitemap index.For example, enter https://www.sitecore.com/sitemap.xml.
-
Click Save.