Tuesday, February 13, 2024

Azure Data Factory: Change data capture

Azure Data Factory - Data Integration Service | Microsoft Azure

Integrate all your data with Azure Data Factory, a fully managed, serverless data integration service. Visually integrate data sources with more than 90 built-in, maintenance-free connectors at no added cost. Easily construct ETL (extract, transform, and load) and ELT (extract, load, and transform) processes code-free in an intuitive environment or write your own code. Then deliver integrated data to Azure Synapse Analytics to unlock business insights.

Azure Data Factory => Pipeline  => Using JSON as “code”

The changed data including inserted, updated and deleted rows can be automatically detected and extracted by ADF mapping data flow from the source databases. No timestamp or ID columns are required to identify the changes since it uses the native change data capture technology in the databases.

No comments: