Applies to Product - Dynamics 365 Finance
What’s happening?
Duplicate records are observed in CDM data files exported from Dynamics 365 Finance & Operations via Azure Synapse Link when using Append-only mode with CSV format and incremental folder updates.
Reason:
This behavior is by design. When using Append-only mode with CSV format and incremental folder updates, deleted rows are not physically removed from the destination data. Instead, an additional row is appended to indicate the deletion, marked with the column "isDelete=True". These rows are intended to indicate deletions and should not be considered part of the active dataset.
This behavior is by design. When using Append-only mode with CSV format and incremental folder updates, deleted rows are not physically removed from the destination data. Instead, an additional row is appended to indicate the deletion, marked with the column "isDelete=True". These rows are intended to indicate deletions and should not be considered part of the active dataset.
Resolution:
When manipulating or analyzing the exported data, ensure to filter out records marked with the column isDelete=True. These rows represent deleted records and should not be included as part of the active dataset.
When manipulating or analyzing the exported data, ensure to filter out records marked with the column isDelete=True. These rows represent deleted records and should not be included as part of the active dataset.