Hello friends. I created a basic reminder flow on a library that has 50,000 items. Understanding that the flow can only process 5000 items, i am using a filter query to only process records who's termination date (the column i'm interested in) is equal to today's date.
concat(concat('Termination_x0020_Reminder_x0020_Date',' ge ', '''',outputs('Today_+_x_days')),'''',' and ', concat('Termination_x0020_Reminder_x0020_Date',' lt ','''', outputs('x_Days_+_1'),''''))
This query should only return a handful of items. When running the flow, i get no results, and in the output section of get items, i see a 200 status code and this message in the body
{
"@odata.nextLink": "https://flow-apim-msmanaged-na-centralus-01.azure-apim.net/apim/sharepointonline/shared-sharepointon...",
"value": []
}
{
"Message": "Missing Authorization header for a privileged call on connection.",
"Source": "product policy"
}
Hi!
You added the following as Filter Query input, right?
Perhaps the problem is that Filter Query expects ODATA expressions, with a different syntax.
Please check this great post to find explanation of the syntax and commands applying to Sharepoint Get items (also apply to Get file -properties only-)
https://sharepains.com/2018/11/12/sharepoint-get-items-odata-filter-query/
Not with my laptop, so unable to test the ODATA expression
Hope this helps
Proud to be a Flownaut!
hey @efialttes no, this was the default query added when you create a reminder workflow off a date column in a modern library. I did not touch this.
Hi!
Can you share a screenshot from your current Flow design?
Thanx!
Proud to be a Flownaut!
Hi again
Please also note Flow can process more than 5,000 items. If you are working with Sharepoint Lists, you can activate pagination, if working with libraries you can implement a Do Until approach.
Details here:
https://alextofan.com/2019/08/22/how-to-get-more-than-5000-item-from-sharepoint-online-in-flow/
Thanx!
Proud to be a Flownaut!
As you can see, this is a basic OOB flow reminder workflow. The only thing i did was changed the reminder to 0 days after the flow was created, but this can be left @ 1. I have an identical flow running on a library with 1 document and its working fine.
Im not sure i agree with this - the filter query should address this. While there are 50,000 items, for the test purposes, the filter query should only return 1 item and i didnt get the list threshold error message.
OMG!
You are totally right! I mean, it is a valid ODATA expression!
So the problem seems to be changing the REminder into 0 days, or... flow design not valid for libraries with more than 5,000 files. Did you already try with Reminder 1 day in this same huge library, just for testing purposes?
THanx!
Proud to be a Flownaut!
Yes, I tried with reminder set to 0 and 1 - both fail. Again, for confirmation, 1 have 2 libraries. One with 1 document and this flow works perfectly. The other with 50,000 items and i don't get the threshold error, but i get the other error code even with filter put in place. The natural guess is that it has something to do with the large size library - but cant seem to figure out why this error appears and more importantly what it means.
Hi again
Sounds really bad, I mean this is the only reference to this same error I just found in the Power Automate community
Hope this helps
Proud to be a Flownaut!
Hi did you solve this problem? I have similar problem only with document library... Strange thing is, that if I try to filter only first folder it works perfectly, but when I filter other then first folder (so I do not get 5000 items) it does not work. And there is no info about this problem at all 😕
I tried to contact support, but guys from Nigeria did not understand me so it ends up in no sulotion 😕 very anoying...
First folder is working
2nd folders - does not work
Exactly the same probem this week, on a flow that's been running fine for 6+ months. Struggling to find anything much about the issue. Anyone know what the issue might be?
Same error here, using Azure Logic App instead of flow.
When using "Get Files (properties only)" from SPO document library, default (not limiting to any folder) or limiting to just the "Shared Documents" folder works. Limiting to any subfolder under "Shared Documents" produces the "Missing Authorization" error.
@frankh @Kirill-PRG Ok moments after I made my previous post, I think I figured out the bug (if you haven't yet):
The "Include Nested Items" option must be set to "No" when "Limit Entries to Folder" is enabled on non-root level folders. When set to Yes (default) the error occurs.
I assume this means to use "Limit Entries to Folder" one must give up subfolders/files nested under that folder for now.
Hope this helps.
Hi @startover909 , thank you for your post. Actualy I solved this problem with work around. So I made 3 flows insted of 1. Problem is to work with huge document libraries (more then 5000 items in total sub folder and files and folders). So I think if anybody want to work with that big libraries, it is better to make workaround.
For example I needed to send email with all new files from particular folder to particular user. So I made 3 flow like this:
1. First I made list for the User in sharepoint.
2. I made flow "When files is added to folder" - make an item in list.
3. Filter all new items from list and send new one to the user (once a day)
4. After one week I delete all items from list (because when it will be bigger then 5000 items, same proble will happen again). So flow once a week for each item - DELETE 🙂
@frankh I guess your flow stoped working after few months, reason is that your library is bigger and bigger, so I recomend to make workaround 😉
User | Count |
---|---|
88 | |
37 | |
26 | |
13 | |
13 |
User | Count |
---|---|
121 | |
55 | |
37 | |
24 | |
21 |