web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Need help with removin...
Power Automate
Answered

Need help with removing duplicates from SP list

(0) ShareShare
ReportReport
Posted on by Microsoft Employee

Hello. 

 

I dont know how ill do this task:

 

cbnt_0-1658320501426.png

I want to remove the duplicates based on the field "campo", i need to get only unique values on "campo" column but i also need the ID values for those unique "campos", anybody can help me?

 

Categories:
I have the same question (0)
  • David- Profile Picture
    1,254 on at
  • ScottShearer Profile Picture
    25,290 Most Valuable Professional on at

    @Anonymous 

    What do you want to do with the ID values?  

  • Verified answer
    ScottShearer Profile Picture
    25,290 Most Valuable Professional on at

    @Anonymous 

    See my example below.  If you want to save of the ID values anywhere, do it right before the Delete item action.  The key is to sort by the column with the duplicate values - RefNo in my case.  Also, if you have more than 100 items in your list, before to go to the Get items settings and turn on pagination and set the threshold to a number larger than the number of items (5000 max for standard license).

    image.pngimage.pngimage.pngimage.png

  • rajasubr Profile Picture
    75 on at

    Please check this post also. This may help.

     

    https://powerusers.microsoft.com/t5/Building-Flows/Delete-duplicates-in-a-SharePoint-List/m-p/796999#M110889

  • Community Power Platform Member Profile Picture
    Microsoft Employee on at

    Thank you so much, Scott.

     

    That's exactly what i needed, i'm forever in debt with you, if you come to Brazil give me a call!

     

     

  • Community Power Platform Member Profile Picture
    Microsoft Employee on at

    Scott, got another one for you,  is it possible to do this procedure without the sharepoint list just using variables?  For example: 

    Those values I shared are extracted from their source using select on my flow, is it possible to select those values store in a array and do the trick to remove the dupes?

  • takolota1 Profile Picture
    4,980 Moderator on at

    @Anonymous 

     

    This thread may help you remove duplicates from CSV-like data within a flow without calling on other datasets.

    It will also avoid the more inefficient Apply to each looping.

    https://powerusers.microsoft.com/t5/Building-Flows/Filter-duplicates-from-CSV-file/m-p/1670607

  • takolota1 Profile Picture
    4,980 Moderator on at

    This template will help find & remove duplicates in any JSON array, based on whichever columns you select:

    https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Find-and-Remove-Duplicates/m-p/2191403#M1611

  • vkatariya Profile Picture
    5 on at

    need  help for remove duplicate row  from sharepoint list.remove record based on the  within 2 minutes inserted record we want to delete keep only unique record

    vkatariya_0-1717561793519.png

    question.PNG

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Introducing the 2026 Season 1 community Super Users

Congratulations to our 2026 Super Users!

Kudos to our 2025 Community Spotlight Honorees

Congratulations to our 2025 community superstars!

Congratulations to the March Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Automate

#1
Haque Profile Picture

Haque 592

#2
Valantis Profile Picture

Valantis 340

#3
11manish Profile Picture

11manish 284

Last 30 days Overall leaderboard