Hello friends. I created a basic reminder flow on a library that has 50,000 items. Understanding that the flow can only process 5000 items, i am using a filter query to only process records who's termination date (the column i'm interested in) is equal to today's date.
concat(concat('Termination_x0020_Reminder_x0020_Date',' ge ', '''',outputs('Today_+_x_days')),'''',' and ', concat('Termination_x0020_Reminder_x0020_Date',' lt ','''', outputs('x_Days_+_1'),''''))
This query should only return a handful of items. When running the flow, i get no results, and in the output section of get items, i see a 200 status code and this message in the body
{
"@odata.nextLink": "https://flow-apim-msmanaged-na-centralus-01.azure-apim.net/apim/sharepointonline/shared-sharepointon...",
"value": []
}
{
"Message": "Missing Authorization header for a privileged call on connection.",
"Source": "product policy"
}
Hi!
You added the following as Filter Query input, right?
Perhaps the problem is that Filter Query expects ODATA expressions, with a different syntax.
Please check this great post to find explanation of the syntax and commands applying to Sharepoint Get items (also apply to Get file -properties only-)
https://sharepains.com/2018/11/12/sharepoint-get-items-odata-filter-query/
Not with my laptop, so unable to test the ODATA expression
Hope this helps
Proud to be a Flownaut!
hey @efialttes no, this was the default query added when you create a reminder workflow off a date column in a modern library. I did not touch this.
Hi!
Can you share a screenshot from your current Flow design?
Thanx!
Proud to be a Flownaut!
Hi again
Please also note Flow can process more than 5,000 items. If you are working with Sharepoint Lists, you can activate pagination, if working with libraries you can implement a Do Until approach.
Details here:
https://alextofan.com/2019/08/22/how-to-get-more-than-5000-item-from-sharepoint-online-in-flow/
Thanx!
Proud to be a Flownaut!
As you can see, this is a basic OOB flow reminder workflow. The only thing i did was changed the reminder to 0 days after the flow was created, but this can be left @ 1. I have an identical flow running on a library with 1 document and its working fine.
Im not sure i agree with this - the filter query should address this. While there are 50,000 items, for the test purposes, the filter query should only return 1 item and i didnt get the list threshold error message.
OMG!
You are totally right! I mean, it is a valid ODATA expression!
So the problem seems to be changing the REminder into 0 days, or... flow design not valid for libraries with more than 5,000 files. Did you already try with Reminder 1 day in this same huge library, just for testing purposes?
THanx!
Proud to be a Flownaut!
Yes, I tried with reminder set to 0 and 1 - both fail. Again, for confirmation, 1 have 2 libraries. One with 1 document and this flow works perfectly. The other with 50,000 items and i don't get the threshold error, but i get the other error code even with filter put in place. The natural guess is that it has something to do with the large size library - but cant seem to figure out why this error appears and more importantly what it means.
Hi again
Sounds really bad, I mean this is the only reference to this same error I just found in the Power Automate community
Hope this helps
Proud to be a Flownaut!
Hi did you solve this problem? I have similar problem only with document library... Strange thing is, that if I try to filter only first folder it works perfectly, but when I filter other then first folder (so I do not get 5000 items) it does not work. And there is no info about this problem at all 😕
I tried to contact support, but guys from Nigeria did not understand me so it ends up in no sulotion 😕 very anoying...
First folder is working
2nd folders - does not work
Exactly the same probem this week, on a flow that's been running fine for 6+ months. Struggling to find anything much about the issue. Anyone know what the issue might be?
Same error here, using Azure Logic App instead of flow.
When using "Get Files (properties only)" from SPO document library, default (not limiting to any folder) or limiting to just the "Shared Documents" folder works. Limiting to any subfolder under "Shared Documents" produces the "Missing Authorization" error.
@frankh @Kirill-PRG Ok moments after I made my previous post, I think I figured out the bug (if you haven't yet):
The "Include Nested Items" option must be set to "No" when "Limit Entries to Folder" is enabled on non-root level folders. When set to Yes (default) the error occurs.
I assume this means to use "Limit Entries to Folder" one must give up subfolders/files nested under that folder for now.
Hope this helps.
Hi @startover909 , thank you for your post. Actualy I solved this problem with work around. So I made 3 flows insted of 1. Problem is to work with huge document libraries (more then 5000 items in total sub folder and files and folders). So I think if anybody want to work with that big libraries, it is better to make workaround.
For example I needed to send email with all new files from particular folder to particular user. So I made 3 flow like this:
1. First I made list for the User in sharepoint.
2. I made flow "When files is added to folder" - make an item in list.
3. Filter all new items from list and send new one to the user (once a day)
4. After one week I delete all items from list (because when it will be bigger then 5000 items, same proble will happen again). So flow once a week for each item - DELETE 🙂
@frankh I guess your flow stoped working after few months, reason is that your library is bigger and bigger, so I recomend to make workaround 😉
Episode Seven of Power Platform Connections sees David Warner and Hugo Bernier talk to Dian Taylor, alongside the latest news, product reviews, and community blogs. Use the hashtag #PowerPlatformConnects on social media for a chance to have your work featured on the show.
Super Users – 2023 Season 1 We are excited to kick off the Power Users Super User Program for 2023 - Season 1. The Power Platform Super Users have done an amazing job in keeping the Power Platform communities helpful, accurate and responsive. We would like to send these amazing folks a big THANK YOU for their efforts. Super User Season 1 | Contributions July 1, 2022 – December 31, 2022 Super User Season 2 | Contributions January 1, 2023 – June 30, 2023 Curious what a Super User is? Super Users are especially active community members who are eager to help others with their community questions. There are 2 Super User seasons in a year, and we monitor the community for new potential Super Users at the end of each season. Super Users are recognized in the community with both a rank name and icon next to their username, and a seasonal badge on their profile. Power Apps Power Automate Power Virtual Agents Power Pages Pstork1* Pstork1* Pstork1* OliverRodrigues BCBuizer Expiscornovus* Expiscornovus* ragavanrajan AhmedSalih grantjenkins renatoromao Mira_Ghaly* Mira_Ghaly* Sundeep_Malik* Sundeep_Malik* SudeepGhatakNZ* SudeepGhatakNZ* StretchFredrik* StretchFredrik* 365-Assist* 365-Assist* cha_cha ekarim2020 timl Hardesh15 iAm_ManCat annajhaveri SebS Rhiassuring LaurensM abm TheRobRush Ankesh_49 WiZey lbendlin Nogueira1306 Kaif_Siddique victorcp RobElliott dpoggemann srduval SBax CFernandes Roverandom schwibach Akser CraigStewart PowerRanger MichaelAnnis subsguts David_MA EricRegnier edgonzales zmansuri GeorgiosG ChrisPiasecki ryule AmDev fchopo phipps0218 tom_riha theapurva takolota Akash17 momlo BCLS776 Shuvam-rpa rampprakash ScottShearer Rusk ChristianAbata cchannon Koen5 a33ik Heartholme AaronKnox okeks Matren David_MA Alex_10 Jeff_Thorpe poweractivate Ramole DianaBirkelbach DavidZoon AJ_Z PriyankaGeethik BrianS StalinPonnusamy HamidBee CNT Anonymous_Hippo Anchov KeithAtherton alaabitar Tolu_Victor KRider sperry1625 IPC_ahaas zuurg rubin_boer cwebb365 Dorrinda G1124 Gabibalaban Manan-Malhotra jcfDaniel WarrenBelz Waegemma drrickryp GuidoPreite If an * is at the end of a user's name this means they are a Multi Super User, in more than one community. Please note this is not the final list, as we are pending a few acceptances. Once they are received the list will be updated.
Join us for an in-depth look into the latest updates across Microsoft Dynamics 365 and Microsoft Power Platform that are helping businesses overcome their biggest challenges today. Find out about new features, capabilities, and best practices for connecting data to deliver exceptional customer experiences, collaborating, and creating using AI-powered capabilities, driving productivity with automation—and building towards future growth with today’s leading technology. Microsoft leaders and experts will guide you through the full 2023 release wave 1 and how these advancements will help you: Expand visibility, reduce time, and enhance creativity in your departments and teams with unified, AI-powered capabilities.Empower your employees to focus on revenue-generating tasks while automating repetitive tasks.Connect people, data, and processes across your organization with modern collaboration tools.Innovate without limits using the latest in low-code development, including new GPT-powered capabilities. Click Here to Register Today!
We are excited to share the ‘Power Platform Communities Front Door’ experience with you! Front Door brings together content from all the Power Platform communities into a single place for our community members, customers and low-code, no-code enthusiasts to learn, share and engage with peers, advocates, community program managers and our product team members. There are a host of features and new capabilities now available on Power Platform Communities Front Door to make content more discoverable for all power product community users which includes ForumsUser GroupsEventsCommunity highlightsCommunity by numbersLinks to all communities Users can see top discussions from across all the Power Platform communities and easily navigate to the latest or trending posts for further interaction. Additionally, they can filter to individual products as well. Users can filter and browse the user group events from all power platform products with feature parity to existing community user group experience and added filtering capabilities. Users can now explore user groups on the Power Platform Front Door landing page with capability to view all products in Power Platform. Explore Power Platform Communities Front Door today. Visit Power Platform Community Front door to easily navigate to the different product communities, view a roll up of user groups, events and forums.
We are so excited to see you for the Microsoft Power Platform Conference in Las Vegas October 3-5 2023! But first, let's take a look back at some fun moments and the best community in tech from MPPC 2022 in Orlando, Florida. Featuring guest speakers such as Charles Lamanna, Heather Cook, Julie Strauss, Nirav Shah, Ryan Cunningham, Sangya Singh, Stephen Siciliano, Hugo Bernier and many more. Register today: https://www.powerplatformconf.com/
User | Count |
---|---|
95 | |
35 | |
27 | |
25 | |
21 |
User | Count |
---|---|
122 | |
56 | |
42 | |
41 | |
41 |