web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Removing Duplicate Items
Power Automate
Unanswered

Removing Duplicate Items

(0) ShareShare
ReportReport
Posted on by 10

Hi all,

 

I am running a PowerBI on button click command which imports a list of items (~200) from PowerBI to a sharepoint list. This button will be clicked everyday to import these items from PowerBI to a sharepoint. We expect the sharepoint to be housed with at least 2-3 months worth of data (4000-6000 entries) before building an archival function.

 

It is expected that there may be around 70-80 duplicates values in columns A, B and C, and I would like to do a few things:

 

1) if duplicate detected in A, B and C, pull the row out and check for the following:

2) is column D a duplicate?

 

3) If column D is also a duplicate, delete the new entry entirely

4) If column D is not a duplicate, update the old entry with the new value in column D. After updating, delete the new entry entirely.

 

I have tried using the inbuilt condition function but due to the number of items we expect in the sharepoint, the iteration takes very long to complete. I would appreciate any sort of feedback to achieve the above intention while maintaining the performance of the flow.

Categories:
I have the same question (0)
  • takolota1 Profile Picture
    4,980 Moderator on at

    @tanshaun95 

     

    You may be able to achieve this with this remove duplicates function.

    https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Find-and-Remove-Duplicates/m-p/2191403#M1611

     

    And if you sort your data based on Column D, then you can keep either the oldest or newest record.

    You may have to modify things more if you want that duplicate to update the old one though.

    https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Find-and-Remove-Duplicates/m-p/2191403#M1611

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Introducing the 2026 Season 1 community Super Users

Congratulations to our 2026 Super Users!

Kudos to our 2025 Community Spotlight Honorees

Congratulations to our 2025 community superstars!

Congratulations to the March Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Automate

#1
Haque Profile Picture

Haque 592

#2
Valantis Profile Picture

Valantis 340

#3
11manish Profile Picture

11manish 284

Last 30 days Overall leaderboard