Create a request trigger
Define a request trigger when you want the crawler to start crawling from a single URL or if your content can be accessed by a REST API endpoint.
You can use a request trigger with the web crawler, advanced web crawler, and API crawler sources.
This topic describes how to create a request trigger for an advanced web crawler or API crawler source. The procedure to create a trigger for a web crawler source is slightly different because, for a web crawler source, you define a trigger in the Web Crawler Settings section of the Source Settings page.
To configure a request trigger:
-
On the Source Settings page, click Edit
next to Triggers. -
Click
Add Trigger. -
In the Trigger Type drop-down field, select Request.
-
Optionally, in the Body field, enter the body of the request.
NoteIf you use a
POSTorPatchrequest, you have to enter a request body. -
Optionally, to configure a header, click Add Header and enter values in the Key and Value fields.
For example, enter user-agent as the Key and sitecorebot as the Value.
-
Optionally, in the Method drop-down menu, click POST, PUT, or PATCH. By default, GET is selected.
-
In the URL field, paste the URL you want to use as the trigger.
For example, paste https://dev.sitecore.net/