Create a sitemap trigger
Use a sitemap or sitemap index trigger when you have a sitemap or sitemap index that includes all the URLs you want to index.
This topic describes how to create a sitemap or sitemap index trigger for an advanced web crawler or API crawler source. The procedure to create a sitemap or sitemap index trigger for a web crawler source is slightly different because, for a web crawler source, you define a trigger in the Web Crawler Settings section of the Source Settings page.
To configure a sitemap or sitemap index trigger:
-
On the Source Settings page, click Edit
next to Triggers. -
Click
Add Trigger. -
In the Trigger Type drop-down menu, click Sitemap or Sitemap Index.
-
In the TIMEOUT field, enter the time, in milliseconds, that the crawler waits to get a response. Enter a large number here because sitemaps can take very long to load, and you do not want the crawler to time out when it reaches the maximum number of seconds to wait.
For example, enter 10000.
-
In the URL field, click
Add Item and then enter the URL of the sitemap or sitemap index.For example, enter https://www.sitecore.com/sitemap.xml.
-
Click Save.