Hello friends. I created a basic reminder flow on a library that has 50,000 items. Understanding that the flow can only process 5000 items, i am using a filter query to only process records who's termination date (the column i'm interested in) is equal to today's date.
concat(concat('Termination_x0020_Reminder_x0020_Date',' ge ', '''',outputs('Today_+_x_days')),'''',' and ', concat('Termination_x0020_Reminder_x0020_Date',' lt ','''', outputs('x_Days_+_1'),''''))
This query should only return a handful of items. When running the flow, i get no results, and in the output section of get items, i see a 200 status code and this message in the body
{
"@odata.nextLink": "https://flow-apim-msmanaged-na-centralus-01.azure-apim.net/apim/sharepointonline/shared-sharepointon...",
"value": []
}
{
"Message": "Missing Authorization header for a privileged call on connection.",
"Source": "product policy"
}
Hi!
You added the following as Filter Query input, right?
Perhaps the problem is that Filter Query expects ODATA expressions, with a different syntax.
Please check this great post to find explanation of the syntax and commands applying to Sharepoint Get items (also apply to Get file -properties only-)
https://sharepains.com/2018/11/12/sharepoint-get-items-odata-filter-query/
Not with my laptop, so unable to test the ODATA expression
Hope this helps
hey @efialttes no, this was the default query added when you create a reminder workflow off a date column in a modern library. I did not touch this.
Hi again
Please also note Flow can process more than 5,000 items. If you are working with Sharepoint Lists, you can activate pagination, if working with libraries you can implement a Do Until approach.
Details here:
https://alextofan.com/2019/08/22/how-to-get-more-than-5000-item-from-sharepoint-online-in-flow/
Thanx!
As you can see, this is a basic OOB flow reminder workflow. The only thing i did was changed the reminder to 0 days after the flow was created, but this can be left @ 1. I have an identical flow running on a library with 1 document and its working fine.
Im not sure i agree with this - the filter query should address this. While there are 50,000 items, for the test purposes, the filter query should only return 1 item and i didnt get the list threshold error message.
OMG!
You are totally right! I mean, it is a valid ODATA expression!
So the problem seems to be changing the REminder into 0 days, or... flow design not valid for libraries with more than 5,000 files. Did you already try with Reminder 1 day in this same huge library, just for testing purposes?
THanx!
Yes, I tried with reminder set to 0 and 1 - both fail. Again, for confirmation, 1 have 2 libraries. One with 1 document and this flow works perfectly. The other with 50,000 items and i don't get the threshold error, but i get the other error code even with filter put in place. The natural guess is that it has something to do with the large size library - but cant seem to figure out why this error appears and more importantly what it means.
Hi again
Sounds really bad, I mean this is the only reference to this same error I just found in the Power Automate community
Hope this helps
Hi did you solve this problem? I have similar problem only with document library... Strange thing is, that if I try to filter only first folder it works perfectly, but when I filter other then first folder (so I do not get 5000 items) it does not work. And there is no info about this problem at all 😕
I tried to contact support, but guys from Nigeria did not understand me so it ends up in no sulotion 😕 very anoying...
First folder is working
2nd folders - does not work
Exactly the same probem this week, on a flow that's been running fine for 6+ months. Struggling to find anything much about the issue. Anyone know what the issue might be?
Same error here, using Azure Logic App instead of flow.
When using "Get Files (properties only)" from SPO document library, default (not limiting to any folder) or limiting to just the "Shared Documents" folder works. Limiting to any subfolder under "Shared Documents" produces the "Missing Authorization" error.
@frankh @Kirill-PRG Ok moments after I made my previous post, I think I figured out the bug (if you haven't yet):
The "Include Nested Items" option must be set to "No" when "Limit Entries to Folder" is enabled on non-root level folders. When set to Yes (default) the error occurs.
I assume this means to use "Limit Entries to Folder" one must give up subfolders/files nested under that folder for now.
Hope this helps.
Hi @startover909 , thank you for your post. Actualy I solved this problem with work around. So I made 3 flows insted of 1. Problem is to work with huge document libraries (more then 5000 items in total sub folder and files and folders). So I think if anybody want to work with that big libraries, it is better to make workaround.
For example I needed to send email with all new files from particular folder to particular user. So I made 3 flow like this:
1. First I made list for the User in sharepoint.
2. I made flow "When files is added to folder" - make an item in list.
3. Filter all new items from list and send new one to the user (once a day)
4. After one week I delete all items from list (because when it will be bigger then 5000 items, same proble will happen again). So flow once a week for each item - DELETE 🙂
@frankh I guess your flow stoped working after few months, reason is that your library is bigger and bigger, so I recomend to make workaround 😉
This weekly series is our way of helping the amazing members of our community--both new members and seasoned veterans--learn and grow in how to best engage in the community! Each Tuesday, we will feature new areas of content that will help you best understand the community--from ranking and badges to profile avatars, from Super Users to blogging in the community. Our hope is that this information will help each of our community members grow in their experience with Power Platform, with the community, and with each other! Have you ever wondered how your fellow community members earn the different ranks available? What is the difference between an Advocate and a Helper, a Solution Sage and a Community Champion? In today's #TuesdayTip, we share the secrets and tips to help YOU keep your ranking growing--and why it's so important to our communities. What are community ranks? - Power Platform Community (microsoft.com) Get the details in this Knowledge Base article that shows you what ranks are, how they are achieved, and what they mean to you as you engage with other community members on a regular basis. Once you start your journey in the community, ranking up, you'll find the benefits. So get busy with those kudos, solutions, and more! We can't wait to see how you rank!That's it for this week. Tune in for more Tuesday Tips next Tuesday and join the community as we continue to get "Back to Basics."
After all the planning and preparing, the annual Microsoft Power Platform Conference is finally here! We are excited to see so many of our community in Las Vegas this week. To help make sure you don't miss any of the workshops, sessions, and events we have planned, make sure to check out this handy Community One-Sheet, and download the pdf today! Make sure to stop by the Community Lounge to meet @hugobernier, @EricArcher, @heaher_italent, and @AshleyFelts from our team!
Join us for the first-ever the Biz Apps Community User Group meeting live from the Power Platform Conference! This one hour user group meeting is all about discovering the value and benefits of User Groups! Discover how you can find a group in your local area or about specific topics where you can learn new skills and meet like-minded people as a user group member. Hear from User Group leaders about why they do what they do and what resources they receive to help them succeed as community ambassadors. If you have never attended a User Group meeting before, this will be a great introduction! We hope you are inspired to find a group that meets your unique interests! October 5th at 2:15 pm Pacific time If you're attending #MPPC23 in Las Vegas, join us in person! Find out more here: https://powerplatformconf.com/#!/session/Biz%20Apps%20Community%20User%20Group%20Meeting%20-%20Live%20from%20MPPC/6172 Not at MPPC23? Attend vvirtually by registering here: https://aka.ms/MPPCusergroupmeeting2023 If you can't attend this meeting live, don't worry! We will record this meeting and share it with the Community at powerusers.microsoft.com
We are excited to kick off our new #TuesdayTIps series, "Back to Basics." This weekly series is our way of helping the amazing members of our community--both new members and seasoned veterans--learn and grow in how to best engage in the community! Each Tuesday, we will feature new areas of content that will help you best understand the community--from ranking and badges to profile avatars, from Super Users to blogging in the community. Our hope is that this information will help each of our community members grow in their experience with Power Platform, with the community, and with each other! This Week's Tips: Account Support: Changing Passwords, Changing Email Addresses or Usernames, "Need Admin Approval," Etc.Wondering how to get support for your community account? Check out the details on these common questions and more. Just follow the link below for articles that explain it all.Community Account Support - Power Platform Community (microsoft.com) All About GDPR: How It Affects Closing Your Community Account (And Why You Should Think Twice Before You Do)GDPR, the General Data Protection Regulation (GDPR), took effect May 25th 2018. A European privacy law, GDPR imposes new rules on companies and other organizations offering goods and services to people in the European Union (EU), or that collect and analyze data tied to EU residents. GDPR applies no matter where you are located, and it affects what happens when you decide to close your account. Read the details here:All About GDPR - Power Platform Community (microsoft.com) Getting to Know You: Setting Up Your Community Profile, Customizing Your Profile, and More.Your community profile helps other members of the community get to know you as you begin to engage and interact. Your profile is a mirror of your activity in the community. Find out how to set it up, change your avatar, adjust your time zone, and more. Click on the link below to find out how:Community Profile, Time Zone, Picture (Avatar) & D... - Power Platform Community (microsoft.com) That's it for this week. Tune in for more Tuesday Tips next Tuesday and join the community as we get "Back to Basics."
Are you attending the Microsoft Power Platform Conference 2023 in Las Vegas? If so, we invite you to join us for the MPPC's Got Power Talent Show! Our talent show is more than a show—it's a grand celebration of connection, inspiration, and shared journeys. Through stories, skills, and collective experiences, we come together to uplift, inspire, and revel in the magic of our community's diverse talents. This year, our talent event promises to be an unforgettable experience, echoing louder and brighter than anything you've seen before. We're casting a wider net with three captivating categories: Demo Technical Solutions: Show us your Power Platform innovations, be it apps, flows, chatbots, websites or dashboards... Storytelling: Share tales of your journey with Power Platform. Hidden Talents: Unveil your creative side—be it dancing, singing, rapping, poetry, or comedy. Let your talent shine! Got That Special Spark? A Story That Demands to Be Heard? Your moment is now! Sign up to Showcase Your Brilliance: https://aka.ms/MPPCGotPowerSignUp Deadline for submissions: Thursday, Sept 28th How It Works: Submit this form to sign up: https://aka.ms/MPPCGotPowerSignUp We'll contact you if you're selected. Get ready to be onstage! The Spotlight is Yours: Each participant has 3-5 minutes to shine, with insightful commentary from our panel of judges. We’re not just giving you a stage; we’re handing you the platform to make your mark. Be the Story We Tell: Your talents and narratives will not just entertain but inspire, serving as the bedrock for our community’s future stories and successes. Celebration, Surprises, and Connections: As the curtain falls, the excitement continues! Await surprise awards and seize the chance to mingle with industry experts, Microsoft Power Platform leaders, and community luminaries. It's not just a show; it's an opportunity to forge connections and celebrate shared successes. Event Details: Date and Time: Wed Oct 4th, 6:30-9:00PM Location: MPPC23 at the MGM Grand, Las Vegas, NV, USA
The Reading Dynamics 365 and Power Platform User Group is a community-driven initiative that started in September 2022. It has quickly earned recognition for its enthusiastic leadership and resilience in the face of challenges. With a focus on promoting learning and networking among professionals in the Dynamics 365 and Power Platform ecosystem, the group has grown steadily and gained a reputation for its commitment to its members! The group, which had its inaugural event in January 2023 at the Microsoft UK Headquarters in Reading, has since organized three successful gatherings, including a recent social lunch. They maintain a regular schedule of four events per year, each attended by an average of 20-25 enthusiastic participants who enjoy engaging talks and, of course, pizza. The Reading User Group's presence is primarily spread through LinkedIn and Meetup, with the support of the wider community. This thriving community is managed by a dedicated team consisting of Fraser Dear, Tim Leung, and Andrew Bibby, who serves as the main point of contact for the UK Dynamics 365 and Power Platform User Groups. Andrew Bibby, an active figure in the Dynamics 365 and Power Platform community, nominated this group due to his admiration for the Reading UK User Group's efforts. He emphasized their remarkable enthusiasm and success in running the group, noting that they navigated challenges such as finding venues with resilience and smiles on their faces. Despite being a relatively new group with 20-30 members, they have managed to achieve high attendance at their meetings. The group's journey began when Fraser Dear moved to the Reading area and realized the absence of a user group catering to professionals in the Dynamics 365 and Power Platform space. He reached out to Andrew, who provided valuable guidance and support, allowing the Reading User Group to officially join the UK Dynamics 365 and Power Platform User Groups community. One of the group's notable achievements was overcoming the challenge of finding a suitable venue. Initially, their "home" was the Microsoft UK HQ in Reading. However, due to office closures, they had to seek a new location with limited time. Fortunately, a connection with Stephanie Stacey from Microsoft led them to Reading College and its Institute of Technology. The college generously offered them event space and support, forging a mutually beneficial partnership where the group promotes the Institute and encourages its members to support the next generation of IT professionals. With the dedication of its leadership team, the Reading Dynamics 365 and Power Platform User Group is poised to continue growing and thriving! Their story exemplifies the power of community-driven initiatives and the positive impact they can have on professional development and networking in the tech industry. As they move forward with their upcoming events and collaborations with Reading College, the group is likely to remain a valuable resource for professionals in the Reading area and beyond.
User | Count |
---|---|
68 | |
35 | |
34 | |
34 | |
32 |
User | Count |
---|---|
79 | |
72 | |
68 | |
51 | |
51 |