Skip to main content
Community site session details

Community site session details

Session Id : RhIVzuM8N9qUpbS2OGuJZW
Power Automate - General Discussion
Answered

Need help with removing duplicates from SP list

Like (0) ShareShare
ReportReport
Posted on 20 Jul 2022 12:39:05 by

Hello. 

 

I dont know how ill do this task:

 

cbnt_0-1658320501426.png

I want to remove the duplicates based on the field "campo", i need to get only unique values on "campo" column but i also need the ID values for those unique "campos", anybody can help me?

 

Categories:
  • vkatariya Profile Picture
    5 on 05 Jun 2024 at 04:32:09
    Re: Need help with removing duplicates from SP list

    need  help for remove duplicate row  from sharepoint list.remove record based on the  within 2 minutes inserted record we want to delete keep only unique record

    vkatariya_0-1717561793519.png

    question.PNG

  • takolota1 Profile Picture
    4,911 Moderator on 09 Jun 2023 at 16:50:18
    Re: Need help with removing duplicates from SP list

    This template will help find & remove duplicates in any JSON array, based on whichever columns you select:

    https://powerusers.microsoft.com/t5/Power-Automate-Cookbook/Find-and-Remove-Duplicates/m-p/2191403#M1611

  • takolota1 Profile Picture
    4,911 Moderator on 22 Jul 2022 at 01:41:58
    Re: Need help with removing duplicates from SP list

    @Anonymous 

     

    This thread may help you remove duplicates from CSV-like data within a flow without calling on other datasets.

    It will also avoid the more inefficient Apply to each looping.

    https://powerusers.microsoft.com/t5/Building-Flows/Filter-duplicates-from-CSV-file/m-p/1670607

  • Community Power Platform Member Profile Picture
    on 21 Jul 2022 at 21:58:59
    Re: Need help with removing duplicates from SP list

    Scott, got another one for you,  is it possible to do this procedure without the sharepoint list just using variables?  For example: 

    Those values I shared are extracted from their source using select on my flow, is it possible to select those values store in a array and do the trick to remove the dupes?

  • Community Power Platform Member Profile Picture
    on 21 Jul 2022 at 12:00:36
    Re: Need help with removing duplicates from SP list

    Thank you so much, Scott.

     

    That's exactly what i needed, i'm forever in debt with you, if you come to Brazil give me a call!

     

     

  • rajasubr Profile Picture
    75 on 21 Jul 2022 at 07:34:16
    Re: Need help with removing duplicates from SP list

    Please check this post also. This may help.

     

    https://powerusers.microsoft.com/t5/Building-Flows/Delete-duplicates-in-a-SharePoint-List/m-p/796999#M110889

  • Verified answer
    ScottShearer Profile Picture
    25,236 Most Valuable Professional on 20 Jul 2022 at 20:20:15
    Re: Need help with removing duplicates from SP list

    @Anonymous 

    See my example below.  If you want to save of the ID values anywhere, do it right before the Delete item action.  The key is to sort by the column with the duplicate values - RefNo in my case.  Also, if you have more than 100 items in your list, before to go to the Get items settings and turn on pagination and set the threshold to a number larger than the number of items (5000 max for standard license).

    image.pngimage.pngimage.pngimage.png

  • ScottShearer Profile Picture
    25,236 Most Valuable Professional on 20 Jul 2022 at 19:55:35
    Re: Need help with removing duplicates from SP list

    @Anonymous 

    What do you want to do with the ID values?  

  • David- Profile Picture
    1,254 on 20 Jul 2022 at 18:33:41

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing our 2025 Season 2 Super Users!

A new season of Super Users has arrived, and we are so grateful for…

Paul Stork – Community Spotlight

We are honored to recognize Paul Stork as our July 2025 Community…

Congratulations to the June Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Automate

#1
Tomac Profile Picture

Tomac 986 Moderator

#2
stampcoin Profile Picture

stampcoin 699 Super User 2025 Season 2

#3
Riyaz_riz11 Profile Picture

Riyaz_riz11 577 Super User 2025 Season 2

Loading started
Loading complete