web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / Deletion of records wi...
Power Apps
Unanswered

Deletion of records with Azure Synapse Link for Dataverse

(0) ShareShare
ReportReport
Posted on by

Hi, Is data in sync using Synapse Link for Dataverse?

If the records in Microsoft dataverse database is deleted , does it reflect on Azure database?

Or is it possible to get the list of deleted records?

Thank you!

I have the same question (0)
  • Drew Poggemann Profile Picture
    9,287 Most Valuable Professional on at

    Hi @kavyakrishna ,


    I just set this up and yes the updates to the Synapse environment will handle add, update, deletes and it will also even support schema changes to Dataverse and reflect this to the Synapse environment.

     

    There is also a way to integrate from the Synapse environment to Azure SQL as well following this approach:  https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics 

  • Balam1984 Profile Picture
    10 on at

    Hi @dpoggemann -  Can you pls help me with any samples how to delete records with Azure Synapse Link for Dataverse.

  • Drew Poggemann Profile Picture
    9,287 Most Valuable Professional on at

    Hi  @Balam1984 

     

    How do you have the integration from Dataverse to Synapse connected?  Are you utilizing the incremental updates?

     

    If so then this will actually be "append only" data into the Synapse environment, not an upsert method.  You will see all records in the Synapse for create, every update, and delete and each will be independent records.  You need to configure the integration in the near real-time mode (not incremental updates) if you want to be able to update the records in place and delete like you are probably expecting.  https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-synapse#access-near-real-time-data-and-read-only-snapshot-data 

    Screen Shot 2023-02-02 at 6.41.26 AM.png

    If you did want to keep in append mode you can configure down to an Azure SQL environment from Synapse which will give you the type of data you are looking for (with some delay vs. near real time).  https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics 

     

  • Balam1984 Profile Picture
    10 on at

    @dpoggemann - How to delete unmatched records in Azure SQLDB with Lake Database (Dataverse)

  • Balam1984 Profile Picture
    10 on at

    Hi @dpoggemann  -  We are not using incremental method. How to identify the deleted rows in Dataverse CRM entity

  • Drew Poggemann Profile Picture
    9,287 Most Valuable Professional on at

    Hi @Balam1984 ,

     

    If you are using the upsert method vs incremental then the Synapse environment will remove the records when you remove them in your Dataverse environment.  After the delete is processed into Synapse, if you query for the record in Synapse it will not exist.   See details here on in-place updates:  https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-advanced-configuration#in-place-updates-vs-append-only-writes 

     

    Is this what you are asking?  Sorry if I am misunderstanding.

     

    Thanks,

    Drew

  • Balam1984 Profile Picture
    10 on at

    @dpoggemann  - we are using only upset method and deleting records in CRM D365 and at the same time records removed from Dataverse environment. But the records are not removed in MY Local SQL DB(Azure Synapse). So I need your help for identifying the removed records in My SQL DB (Azure Synapse) vs Dataverse.


     

  • Drew Poggemann Profile Picture
    9,287 Most Valuable Professional on at

    Hi @Balam1984 ,

     

    I might be misunderstanding what you are saying, sorry.  You are saying Azure Synapse and My local SQL DB as being the same thing.  These are different things with Azure Synapse supporting a large set of T-SQL commands but it is not a SQL database.  If the setup of your Dataverse to Synapse is setup and the tables are configured to be upsert method then when you query for the record in the Azure Synapse Workspace it should not exist if it was deleted in Dataverse and the update pushed successfully to Synapse.  

     

    Have you connected a SQL database to the Azure Synapse environment through a Synapse or Azure Data Factory configuration?  If you then you need to make sure you follow the steps here to delete the records from the connected Azure SQL environment:

    https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-incremental-updates 

     

    which means the Synapse environment must be in Append Only vs Upsert mode.

     

  • Balam1984 Profile Picture
    10 on at

    @dpoggemann  -  How to create Pipeline job in Azure Synapse to Delete records ?

  • PSCJohnM Profile Picture
    18 on at

    Due to performance and cost, I would strongly advise NOT using the Azure Synapse Link pipelines solution linked to above - I outlined my reasons in more detail at https://github.com/MicrosoftDocs/powerapps-docs/issues/5291#issue-2223703489

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Apps

#1
WarrenBelz Profile Picture

WarrenBelz 711 Most Valuable Professional

#2
Michael E. Gernaey Profile Picture

Michael E. Gernaey 319 Super User 2025 Season 2

#3
Power Platform 1919 Profile Picture

Power Platform 1919 268

Last 30 days Overall leaderboard