Sitecore Cortex Processing Engine

Version:

The Sitecore Cortex™ Processing Engine service performs data processing tasks at scale.

Note

For information on how to work with and extend the processing engine, see the Sitecore Experience Platform documentation.

For information on how to work with and extend the processing engine, see the Sitecore Experience Platform documentation.

For information on how to work with and extend the processing engine, see the Sitecore Experience Platform documentation.

Supported infrastructure

You can host the Sitecore Cortex Processing Engine service on:

  • Windows Service
  • Azure Web Job

Refer to the Sitecore compatibility table for compatible versions.

Reference structure

The Sitecore Cortex Processing Engine service has its place in the Sitecore reference structure. It can be referenced by other roles, and it can also reference other roles.

Illustration showing the Sitecore Cortex™ Processing Engine service's place in the Sitecore reference structure.

Referenced by

The Sitecore Cortex Processing Engine service is not referenced by other roles.

References

The Sitecore Cortex Processing Engine service references the following roles:

Storage roles

Abstract

Introduction and links to to Sitecore Storage roles.

Role nameConnection string namePortTypeNotes
Processing Storageprocessing.engine.storage1433SQL
Processing Tasks databaseprocessing.engine.tasks1433SQL
xDB Reporting databasereporting1433SQL
Message Busmessaging1433SQL
443Azure Message BusIf you install Sitecore on Azure, Azure Service Bus is the default provider. Azure Service Bus is available in 9.2 and later.

Application roles

Abstract

Introduction and links to to Sitecore Application roles.

Role nameConnection string namePortTypeNotes
xConnect Collection servicexconnect.collection443HTTPS
xConnect Collection Search servicexconnect.search443HTTPS
Microsoft Machine Learning Serverprocessing.engine.mrs443HTTPSThis connection string is optional. It is only required if you are using the Microsoft Machine Learning Server integration.
Note

Set the xconnect.configuration connection string value to the same value as xconnect.collection. There is no separate configuration service role.

The following client certificates are required in a secure production environment:

RoleConnection string nameTypeNotes
xConnect Collection Search servicexconnect.search.certificateCertificate
xConnect Collection servicexconnect.collection.certificateCertificate
xConnect Collection service (no separate configuration role)xconnect.configuration.certificateCertificate

References to Processing Blob and Table Storage services

The Sitecore Cortex Processing Engine service's connection strings file stores connection strings for the Sitecore Cortex Processing Blob and Table Storage services and associated certificates.  However, the Sitecore Cortex Processing Engine service accesses the Sitecore Cortex Processing Storage database directly and does not use the Sitecore Cortex Processing Blob and Table Storage services. The following connection string values are used by the Microsoft Machine Learning Server integration only.

RoleConnection string namePortTypeNotes
Sitecore Cortex Processing Blob Storage serviceprocessing.webapi.blob443HTTPS
Sitecore Cortex Processing Table Storage serviceprocessing.webapi.table443HTTPS
Connection string nameNotes
processing.webapi.blob.mrs.certificateConnection string should contain path and password for the blob service client authentication certificate. Certificate must be in PKCS #12 (.p12/.pfx) format and must be located on the Microsoft Machine Learning Server compute nodes.
processing.webapi.table.mrs.certificateConnection string should contain path and password for the table service client authentication certificate. Certificate must be in PKCS #12 (.p12/.pfx) format and must be located on the Microsoft Machine Learning Server compute nodes.
processing.webapi.certificate.authorityConnection string should contain the path to public certificate of certification authority that issued the certificate for the blob and table service endpoints. Certificate must be in Base64 encoded format and must be located on the Microsoft Machine Learning Server compute nodes.

Privacy and security

The Sitecore Cortex Processing Engine service handles personal data in the following ways:

  • Processing workers can read contact and interaction data from an xConnect data source.
If you have suggestions for improving this article, let us know!