1. Triggers

Create a request trigger

Define a request trigger when you want the crawler to start crawling from a single URL or if your content can be accessed by a REST API endpoint.

Note

You can use a request trigger with the web crawler, advanced web crawler, and API crawler sources.

This topic describes how to create a request trigger for an advanced web crawler or API crawler source. The procedure to create a trigger for a web crawler source is slightly different because, for a web crawler source, you define a trigger in the Web Crawler Settings section of the Source Settings page.

To configure a request trigger:

  1. On the Source Settings page, click Edit pencil_grey.png next to Triggers.

  2. Click Plus_add__grey.png Add Trigger.

  3. In the Trigger Type drop-down field, select Request.

  4. Optionally, in the Body field, enter the body of the request.

  5. Optionally, to configure a header, click Add Header and enter values in the Key and Value fields.

    For example, enter user-agent as the Key and sitecorebot as the Value.

  6. Optionally, in the Method drop-down menu, click POST, PUT, or PATCH. By default, GET is selected.

  7. In the URL field, paste the URL you want to use as the trigger.

    For example, paste https://dev.sitecore.net/

If you have suggestions for improving this article, let us know!