web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / Power Platform Dataflo...
Power Apps
Unanswered

Power Platform Dataflow incremental refresh inconsistent behavior and duplicates the records.

(0) ShareShare
ReportReport
Posted on by

Dear all,

I am having an issue that is now frustrating me. I am building some insights for financial application and the amount of data will be in billions. So, we have selected the Power Platform Dataflows. Currently, In order to test/demo the functionality, I have created a dataflow and import contact entity from Dynamics 365 CRM and apply incremental refresh on the entity.

 

However, I have found inconsistent behavior, whenever I make some changes in my data (i.e. also the field which is in my incremental refresh condition) the data gets duplicated. Please see the configuration of incremental refresh and duplicate data in attached snapshots.

 

Please see the records in contact entity. Following steps I have made to check either incremental refresh working fine or not and I found inconsistency.

 

1. I renamed the last names of Edward and Sandy to Owen-updated first and their ID Expiry Dates were Sandy - 1/14/2021 and Edward - 1/26/2021 and refresh my dataflow. It brings the correct data this time.

 

2. Then I renamed the last names of Edward and Sandy to Owen and the ID Expiry of Edward to 1/28/2021 and refresh the dataflow. This time you can see Sandy was not updated (that is fine) because it does not match the incremental refresh criteria but it did not update the Edward but bring the previous and latest record as a separate row.

 

Can you please help me out where I am wrong and why is this happening?

I have the same question (0)

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Apps

#1
WarrenBelz Profile Picture

WarrenBelz 796 Most Valuable Professional

#2
Michael E. Gernaey Profile Picture

Michael E. Gernaey 327 Super User 2025 Season 2

#3
Power Platform 1919 Profile Picture

Power Platform 1919 268

Last 30 days Overall leaderboard