Add a pipeline step to iterate the data read from a source file

Abstract

How to create a pipeline step in Sitecore Data Exchange Framework to iterate data from a source file.

The first step in this pipeline adds a pointer to a location where subsequent pipeline steps can access it. You must configure the second step to access the data so it can iterate over the lines read from the text file, and pass the data to the other pipeline that handles the data.

To do so:

  1. Navigate to the pipeline item City Info from File to City Info Item Sync Pipeline.

    Read City Info from File pipeline in the content tree
  2. Add a new Iterate Data and Run Pipelines Pipeline Step and name it Iterate Rows from Text File and Run Pipeline.

  3. Select the new item.

    Iterate Rows from Text File and Run Pipeline pipeline step in the content tree
  4. Set the following field values:

    Field

    Value

    Pipelines

    Pipelines/City Info from File to City Info Item Sync Pipeline

    Iterable Data Location

    Pipeline Context Iterable Data

    Data Location

    Pipeline Context Source

  5. Save the item.

  6. Make the new item the second step in the pipeline.

    Move the Iterate Rows from Text File and Run Pipeline pipeline step in the content tree