Sitecore Cortex Processing Engine

Current version: 9.3

The Sitecore Cortex™ Processing Engine service performs data processing tasks at scale.

Note

For information on how to work with and extend the processing engine, see the Sitecore Experience Platform documentation.

For information on how to work with and extend the processing engine, see the Sitecore Experience Platform documentation.

For information on how to work with and extend the processing engine, see the Sitecore Experience Platform documentation.

Supported infrastructure

You can host the Sitecore Cortex Processing Engine service on:

  • Windows Service

  • Azure Web Job

Refer to the Sitecore compatibility table for compatible versions.

Reference structure

The Sitecore Cortex Processing Engine service has its place in the Sitecore reference structure. It can be referenced by other roles, and it can also reference other roles.

Illustration showing the Sitecore Cortex™ Processing Engine service's place in the Sitecore reference structure.

Referenced by

The Sitecore Cortex Processing Engine service is not referenced by other roles.

References

The Sitecore Cortex Processing Engine service references the following roles:

Storage roles

Role name

Connection string name

Port

Type

Notes

Processing Storage

processing.engine.storage

1433

SQL

Processing Tasks database

processing.engine.tasks

1433

SQL

xDB Reporting database

reporting

1433

SQL

Message Bus

messaging

1433

SQL

443

Azure Message Bus

If you install Sitecore on Azure, Azure Service Bus is the default provider. Azure Service Bus is available in 9.2 and later.

Application roles

Role name

Connection string name

Port

Type

Notes

xConnect Collection service

xconnect.collection

443

HTTPS

xConnect Collection Search service

xconnect.search

443

HTTPS

Microsoft Machine Learning Server

processing.engine.mrs

443

HTTPS

This connection string is optional. It is only required if you are using the Microsoft Machine Learning Server integration.

Note

Set the xconnect.configuration connection string value to the same value as xconnect.collection. There is no separate configuration service role.

The following client certificates are required in a secure production environment:

Role

Connection string name

Type

Notes

xConnect Collection Search service

xconnect.search.certificate

Certificate

xConnect Collection service

xconnect.collection.certificate

Certificate

xConnect Collection service (no separate configuration role)

xconnect.configuration.certificate

Certificate

References to Processing Blob and Table Storage services

The Sitecore Cortex Processing Engine service's connection strings file stores connection strings for the Sitecore Cortex Processing Blob and Table Storage services and associated certificates.  However, the Sitecore Cortex Processing Engine service accesses the Sitecore Cortex Processing Storage database directly and does not use the Sitecore Cortex Processing Blob and Table Storage services. The following connection string values are used by the Microsoft Machine Learning Server integration only.

Role

Connection string name

Port

Type

Notes

Sitecore Cortex Processing Blob Storage service

processing.webapi.blob

443

HTTPS

Sitecore Cortex Processing Table Storage service

processing.webapi.table

443

HTTPS

Connection string name

Notes

processing.webapi.blob.mrs.certificate

Connection string should contain path and password for the blob service client authentication certificate. Certificate must be in PKCS #12 (.p12/.pfx) format and must be located on the Microsoft Machine Learning Server compute nodes.

processing.webapi.table.mrs.certificate

Connection string should contain path and password for the table service client authentication certificate. Certificate must be in PKCS #12 (.p12/.pfx) format and must be located on the Microsoft Machine Learning Server compute nodes.

processing.webapi.certificate.authority

Connection string should contain the path to public certificate of certification authority that issued the certificate for the blob and table service endpoints. Certificate must be in Base64 encoded format and must be located on the Microsoft Machine Learning Server compute nodes.

Privacy and security

The Sitecore Cortex Processing Engine service handles personal data in the following ways:

  • Processing workers can read contact and interaction data from an xConnect data source.

Do you have some feedback for us?

If you have suggestions for improving this article,