How can I efficiently load 10,000 items from a SharePoint List into a Collection?

[pwrappr01]

@yashag2255,

I just noticed that the ListItems collection includes some duplicates that need to be removed. How can I correct this? Here is the code I modified based on our previous discussion:

ClearCollect(LoopCount,FirstN([0, 2000, 4000, 6000, 8000, 10000, 12000],RoundUp(First(Sort('Item Tracker',ID,Descending)).ID/2000,0)));

Clear(ListItems);
ForAll(LoopCount,Collect(ListItems,Filter('Item Tracker',ID > Value)));

[yashag2255]

@pwrappr01  Do you have duplicates in your SP list or is it getting collected inside the collection?

[pwrappr01]

@yashag2255,

I just verified my SP List to ensure there were no duplicates there.

[Rens_]

---

@pwrappr01 wrote:

@yashag2255,

I just noticed that the ListItems collection includes some duplicates that need to be removed. How can I correct this? Here is the code I modified based on our previous discussion:

ClearCollect(LoopCount,FirstN([0, 2000, 4000, 6000, 8000, 10000, 12000],RoundUp(First(Sort('Item Tracker',ID,Descending)).ID/2000,0)));

Clear(ListItems);
ForAll(LoopCount,Collect(ListItems,Filter('Item Tracker',ID > Value)));

---

Thanks for your solution. 

For SharePoint this seems to be working, but it isn't for Excel.