Notifications
Announcements
Hi all,
I have set up incremental refresh on Dataflow that loads data from sql server to Dataverse table. I have also checked the option Only refresh Data for Complete Days. My refresh frequency is Every 1 day @ 8 PM UTC. I am located in Mountain Time zone (currently UTC -6 hours). So if I have records that are updated yesterday and today before 8 PM UTC i.e. refresh starts, it loads records for yesterday and Today both. It supposed to load only complete day records i.e. yesterday not today which is partial day. and Tomorrow it will also lead the same Today's records so making it duplicate again.
Any thoughts please ?
Hi @Anonymous ,
You have to have a query field on which the entity should be filtered for increments. This field only contains DateTime fields. You can't use incremental refresh if your entity doesn't contain a DateTime field.
Make sure that this field has the data/time of the record change (this can be Modified on column)
For more information: https://docs.microsoft.com/en-us/power-query/dataflows/incremental-refresh
Hi @AhmedSalih ,
I have the Date field used in the incremental setup. The question is incremental refresh does work but it also loads partial day data after checking the option not to load it.
please check the screen shots that I have attached in the original post. For your reference I am attaching it again.
Under review
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.
In our never-ending quest to improve we are simplifying the forum hierarchy…
We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…
These are the community rock stars!
Stay up to date on forum activity by subscribing.
WarrenBelz 765 Most Valuable Professional
Michael E. Gernaey 343 Super User 2025 Season 2
Power Platform 1919 272