Get Items Returned Duplicates

[JohnnySkye365]

This is a pretty strange one that I've not been able to replicate.

My Flow is pretty big and does quite a lot.  Essentially it gets items from a SharePoint list, does some calculations, creates items in another list, gets those items and creates a CSV file.

In Get Items step before creating the CSV I have a run that has returned 199 items, but there was only 197 items in the list.  On checking the Outputs from the Get Items step I found 2 duplicate items (i.e. the same internal ID). 

I have run the flow again and it didn't happen, but the fact that it has happened is causing some concern and I'm trying to find some kind of explanation as to why it happened.

Has anyone had anything similar or any suggestions as to why it might have occurred? 

Thanks in advance...

[CFernandes]

Hey Mate @JohnnySkye365 

 You might want to use the Union() function to bring them both together and result in only the unique rows.

If this reply has answered your question or solved your issue, please mark this question as answered. Answered questions helps users in the future who may have the same issue or question quickly find a resolution via search. If you liked my response, please consider giving it a thumbs up. THANKS!

P.S. take a look at my blog here and like & subscribe to my YouTube Channel thanks.

[JohnnySkye365]

Hey man,

Thanks for getting back to me.  I'm not sure I understand what you are proposing.

I only need to Output of 1 Get Items, to give me all the items in a list.  It is within this Get Items step that the duplicate has been created, there's no duplicates in the list, the function has returned the same item twice.  

Are you suggesting I should do something after the Get Items in case this happens again?

Thanks again....

JohnnySkye

[CFernandes]

Hey Mate,

This is what I was trying to suggest - https://powerusers.microsoft.com/t5/General-Power-Automate/Remove-Duplicates-from-a-Sharepoint-List/... 

If this reply has answered your question or solved your issue, please mark this question as answered. Answered questions helps users in the future who may have the same issue or question quickly find a resolution via search. If you liked my response, please consider giving it a thumbs up. THANKS!

P.S. take a look at my blog here and like & subscribe to my YouTube Channel thanks.

[JohnnySkye365]

Ahh I understand now.  The issue isn't duplicates in the list, it's that Get Items returned the same item twice.

[CFernandes]

@JohnnySkye365 Yep - Filter the "Get Items" after you get the items in Power Automate.

[CFernandes]

@JohnnySkye365 Yep - Filter the "Get Items" after you get the items in Power Automate.

[JohnnySkye365]

Sorry for the delayed response...

Surely the Get Items step shouldn't return the same item twice anyway? In this one run, it returned 2 items with the same InternalID.

[JonBenito]

No solutions yet for this issue? Still experiencing duplicate internal ID till now. Thanks

[JonBenito]

Think I found a solution, and it worked. Not sure which either of this, but I did (1) turn off Concurrency Control in apply to each and in (2) Get Items, just keep Order by parameter blank. No more dupes after the re-run.

[panchomx]

Was this issue solved?

I'm currently facing same issue, whenever I execute the "Get Items" it's retreiving duplicates (for example rows with same SharePoint internal ID), it's not always having this behavior.

Regards,

Francisco

[JonBenito]

Hi,

For the last two days it did not have duplicates. But on the third day, the flow is stucked and is not finished yet. Currently running this on a recurrence trigger, like creating daily reports with computations.

[JonBenito]

I think it has something to do with the throttling issue because it hangs in Apply to each. I'll update as soon as I have a stable flow. Thanks 

https://powerusers.microsoft.com/t5/Building-Flows/Apply-to-each-Hangs-Inexplicably/td-p/774441

[panchomx]

What I did to avoid duplicated records on Get Items is to add 2 additional steps:

1) Create an array variable using the Get Items output as the input

2) Use a compose using Union expresion

You can now use the compose output having unique records (avoiding duplicated SP internal IDs)

Hope this helps you!

[AshleyGambino]

I know it's been over a year since this was originally posted, but I had the same exact issue and was finally able to figure out what was happening. Again, the issue was that I was creating an HTML table with a filtered Get Items action, but the HTML table was only returning the first item in every single row. Weiiiiird right?

In case anyone else comes across this post and needs the solution:

In the Create HTML Table action, when you are selecting dynamic content for the Value column, make sure you are selecting the value from the "Get Items" section, NOT the "When an item is created or modified" section (or whatever your initial trigger was).

In the screenshots you can see that I searched for "link" in the dynamic content pop-up window and there are two values for "Link to item": one is in the Get Items section, and one is in the When an item is created or modified section. Again, pick the one in the Get Items section.

[ShehanMP]

I'm facing the exact same issue. There are no duplicates in the SharePoint list items but when I run the flow, in Get Items Output it clearly shows some duplicate items.

Can we write this to Microsoft?

[Dexrend]

I also have this issue. I have 20 items in the list and it returns 40. Is anyone working on this issue?

[PR001]

I'm also getting the same issue with the outputs of the Get Items is returning duplicates for certain rows.  Clearly appears to be a bug.

[ronald_caro]

Hi @panchomx good day! Are you able to share your expression used in Compose for "union()" so that we can see and pattern it to our side?  Thanks!

[martmoldau]

Seems as Get Items bug for me too. Removing orderby value is a workaround which fixed it for me.