cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Ekelund
Frequent Visitor

PowerApp when having a sharepoint list with over 10000 records

I have a powerapp for a sharepoint online app (iGlobe CRM) that works perfectly when I have under approximately 4000 records (still very slow). However many of our customer have over 5000 customers, some over 10.000. This gives a problem in Power Apps. I have set up different filters on the company screen and on the contact screen, fx by selecting only records where the current user is account manager. Again it is working but is slow.

 

Example of the contact screen

Capture2.PNG      Capture1.PNG

 

My problem however is when I have to use lookup. Fx on the contact detial screen I am making a lookup to get the company address, zip, city and country. This is where I am getting an error because of list with to much data. 

 

LookUp('CRM Company'; IGlobeCRM_Company_Name=ThisItem.IGlobeCRM_Contact_Company.Value).IGlobeCRM_Company_City

 

I also tried this 


LookUp(Filter('CRM Company', User().Email=IGlobeCRM_AccountManager.Email), IGlobeCRM_Company_Name=ThisItem.IGlobeCRM_Contact_Company.Value).IGlobeCRM_Company_City

 

Both gives an error if I am working with a lot of data. 

 

Question

1. Should I limit the amount of data I am working on when I start the app. Can I do that if so how? and how do I make lookup and use this in the app

2. Can I make a filter of the data and make a look on on that?

3. Or any other way of handling app that are connected to application with much of data? 

 

It is a bit complex I will happely take a call with some one that can assist me. 

 

5 REPLIES 5
RusselThomas
Community Champion
Community Champion

Hi Ekelund,

 

It does seem a little complex, and doing separate lookups for each row of data in a gallery does tend to be slow as PowerApps has to run a separate query for every single row of data in there, in the context of that row.  If it's running a main query to get the data from source, then multiple queries per row of data returned, from another source - well, you get the picture, otherwise you wouldn't have posted this 🙂

 

The other thing is, what kind of errors are you getting?  Are they delegation warnings or list view threshold errors?

 

Without knowing this, there are perhaps a few things I can suggest you try, although I can't say if any of them will solve your current issue;

 

First - if you haven't already, perhaps make sure all your lists have an index - preferably on a column you typically use to Filter/LookUp.  You can do this by going to the List settings in SharePoint and selecting "Indexed Columns" and then "Create a New Index" and select the column you want to index.  

 

Second - assuming you might be getting delegation warnings, try to avoid complex objects for functions in your filter/lookup conditions - by this I mean pretty much anything in your conditions that you are referencing as a property of an object or are applying a function to - like User().Email or ThisItem.Something.Value or even functions applied to values. 

This sometimes presents delegation issues as SharePoint can't do anything with the object or function it can't understand (that isn't "delegable"), so powerapps will fetch the first 500 rows regardless of condition, then resolve the condition object/function, then apply the filter/lookup condition on those 500 rows.

 

 

Lastly, try use collections where possible to prepare results you might be expecting - Your app looks fantastic, I assume you must be familiar with collections, but if not it might be worth looking into - for example, your filter of accounts based on the user could be done up front and stored in a collection (assuming of course the results are less than 500 rows :)) - it might be slow while creating the initial collection, but subsequent galleries using the collection would be much faster, and you may find you can collect stuff on one screen that you will use on a later screen, making the user experience a little better.

 

All in all it depends a lot on what the user story is and how you get them to the data they need as fast as possible - while we as creators of the app can prove we have the data by presenting a gallery with thousands of rows, does the user need them or use them, or can we present them with the data they're looking for faster and easier (for us and them)?

 

That's about all I can think of for now, let me know if anything here doesn't make sense and apologies up front if it doesn't solve your problem, but perhaps you can post the errors and we can try see exactly what's happening?

 

Hope this helps anyway 🙂

 

 

RT

v-xida-msft
Community Support
Community Support

Hi @Ekelund,

 

Could you please share more details about the error message (associated with too much data) that you mentioned within your app?

 

For your first question, your should check if the formula that you provided could be delegabled within your app.

 

If your formula could be delegabled within your app, you don't need to limit the amount of data your are working, because the processing of data would be delegabled to the SharePoint list data source. In addition, the amount of data would take effect on the execution speed of your formula (executes slowly).

 

But if your formula could not be delegabled within your app, you must limit the amount of data your are wokring, because all the data must be brought to the device first and then process locally. By default, you could only process 500 records locally within your app. Currently, you could consider take a try to change the Non-delegable limits and change it into the maximum value -- 2000.

 

More details about the Delegation in PowerApps, please check the following article:

Delegation in PowerApps

 

More details about changing the Non-delegable limits in PowerApps, please check the followng article:

https://docs.microsoft.com/en-us/powerapps/maker/canvas-apps/delegation-overview#changing-the-limit

 

For your second question, could you please share more details about the error meesage with the formula that you provided? 

 

For your third question, please check and see if the following blog would help in your scenario:

https://blog.coeo.com/davidmorrison/2017/06/21/powerapps-500-record-limit-delegation-and-how-to-work...

 

 

Best regards,

Kris

 

 

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Ekelund
Frequent Visitor

Thank you both.

This is the error I am getting. The screenshot is in Danish Smiley Very Happy

 2018-07-04_12-31-11.png

This is a translation

"The requested operation is invalid. Server response: The attempted operation was not allowed because it exceeded the list view limit set by the administrator. ClientRequestId: e1645f4d-027a-4526-bd69-66aed21ef4b6 ServiceRequestId: 5470779e-10ee-6000-1a4e-35d3e9aa6a6b"

This error I am getting at a customer that have about 10.000 customer record. 

 

Btw I did change  Non-delegable limits and change it into the maximum value -- 2000.

 

If you want to take a look I have a demo tenant where the app is running. Just notice that this versiion don't have that much data. So it is working but slow.... I am sure you would have many suggestuions for improvments.  

 

The app is running on a demo tenant.

 

jab@iglobedemo.com
pass@word1

 

The app is connected to this app - https://iglobedemo-7f47668eda3b9d.sharepoint.com/sites/iGlobeCRMApp/IGlobeCRM 

  

Don't worry this is a demo teant. No live data. 

 

 

Btw the idea of filter accounts based on the user (fx by account mananger) could be done up front and stored in a collection (assuming of course the results are less than 2000 rows ) - is great. I need to connect to 4 lists and the can all be filtered by account manager. Question is how 🙂

 

Thanks

Anyone? can someone please provide with input. 

 

Thanks

Just in case anyone else ends up looking here, I believe the solution is to set the columns that you're filtering by as index columns as described in this thread. This seemed to work for me: https://powerusers.microsoft.com/t5/Building-Power-Apps/Help-with-Large-Sharepoint-List/td-p/66007 

Helpful resources

Announcements

Celebrating the May Super User of the Month: Laurens Martens

  @LaurensM  is an exceptional contributor to the Power Platform Community. Super Users like Laurens inspire others through their example, encouragement, and active participation. We are excited to celebrated Laurens as our Super User of the Month for May 2024.   Consistent Engagement:  He consistently engages with the community by answering forum questions, sharing insights, and providing solutions. Laurens dedication helps other users find answers and overcome challenges.   Community Expertise: As a Super User, Laurens plays a crucial role in maintaining a knowledge sharing environment. Always ensuring a positive experience for everyone.   Leadership: He shares valuable insights on community growth, engagement, and future trends. Their contributions help shape the Power Platform Community.   Congratulations, Laurens Martens, for your outstanding work! Keep inspiring others and making a difference in the community!   Keep up the fantastic work!        

Check out the Copilot Studio Cookbook today!

We are excited to announce our new Copilot Cookbook Gallery in the Copilot Studio Community. We can't wait for you to share your expertise and your experience!    Join us for an amazing opportunity where you'll be one of the first to contribute to the Copilot Cookbook—your ultimate guide to mastering Microsoft Copilot. Whether you're seeking inspiration or grappling with a challenge while crafting apps, you probably already know that Copilot Cookbook is your reliable assistant, offering a wealth of tips and tricks at your fingertips--and we want you to add your expertise. What can you "cook" up?   Click this link to get started: https://aka.ms/CS_Copilot_Cookbook_Gallery   Don't miss out on this exclusive opportunity to be one of the first in the Community to share your app creation journey with Copilot. We'll be announcing a Cookbook Challenge very soon and want to make sure you one of the first "cooks" in the kitchen.   Don't miss your moment--start submitting in the Copilot Cookbook Gallery today!     Thank you,  Engagement Team

Announcing Power Apps Copilot Cookbook Gallery

We are excited to share that the all-new Copilot Cookbook Gallery for Power Apps is now available in the Power Apps Community, full of tips and tricks on how to best use Microsoft Copilot as you develop and create in Power Apps. The new Copilot Cookbook is your go-to resource when you need inspiration--or when you're stuck--and aren't sure how to best partner with Copilot while creating apps.   Whether you're looking for the best prompts or just want to know about responsible AI use, visit Copilot Cookbook for regular updates you can rely on--while also serving up some of your greatest tips and tricks for the Community. Check Out the new Copilot Cookbook for Power Apps today: Copilot Cookbook - Power Platform Community.  We can't wait to see what you "cook" up!      

Tuesday Tip | How to Report Spam in Our Community

It's time for another TUESDAY TIPS, your weekly connection with the most insightful tips and tricks that empower both newcomers and veterans in the Power Platform Community! Every Tuesday, we bring you a curated selection of the finest advice, distilled from the resources and tools in the Community. Whether you’re a seasoned member or just getting started, Tuesday Tips are the perfect compass guiding you across the dynamic landscape of the Power Platform Community.   As our community family expands each week, we revisit our essential tools, tips, and tricks to ensure you’re well-versed in the community’s pulse. Keep an eye on the News & Announcements for your weekly Tuesday Tips—you never know what you may learn!   Today's Tip: How to Report Spam in Our Community We strive to maintain a professional and helpful community, and part of that effort involves keeping our platform free of spam. If you encounter a post that you believe is spam, please follow these steps to report it: Locate the Post: Find the post in question within the community.Kebab Menu: Click on the "Kebab" menu | 3 Dots, on the top right of the post.Report Inappropriate Content: Select "Report Inappropriate Content" from the menu.Submit Report: Fill out any necessary details on the form and submit your report.   Our community team will review the report and take appropriate action to ensure our community remains a valuable resource for everyone.   Thank you for helping us keep the community clean and useful!

Community Roundup: A Look Back at Our Last 10 Tuesday Tips

As we continue to grow and learn together, it's important to reflect on the valuable insights we've shared. For today's #TuesdayTip, we're excited to take a moment to look back at the last 10 tips we've shared in case you missed any or want to revisit them. Thanks for your incredible support for this series--we're so glad it was able to help so many of you navigate your community experience!   Getting Started in the Community An overview of everything you need to know about navigating the community on one page!  Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Community Ranks and YOU Have you ever wondered how your fellow community members ascend the ranks within our community? We explain everything about ranks and how to achieve points so you can climb up in the rankings! Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Powering Up Your Community Profile Your Community User Profile is how the Community knows you--so it's essential that it works the way you need it to! From changing your username to updating contact information, this Knowledge Base Article is your best resource for powering up your profile. Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Community Blogs--A Great Place to Start There's so much you'll discover in the Community Blogs, and we hope you'll check them out today!  Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Unlocking Community Achievements and Earning Badges Across the Communities, you'll see badges on users profile that recognize and reward their engagement and contributions. Check out some details on Community badges--and find out more in the detailed link at the end of the article! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Blogging in the Community Interested in blogging? Everything you need to know on writing blogs in our four communities! Get started blogging across the Power Platform communities today! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Subscriptions & Notifications We don't want you to miss a thing in the community! Read all about how to subscribe to sections of our forums and how to setup your notifications! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Getting Started with Private Messages & Macros Do you want to enhance your communication in the Community and streamline your interactions? One of the best ways to do this is to ensure you are using Private Messaging--and the ever-handy macros that are available to you as a Community member! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Community User Groups Learn everything about being part of, starting, or leading a User Group in the Power Platform Community. Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Update Your Community Profile Today! Keep your community profile up to date which is essential for staying connected and engaged with the community. Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Thank you for being an integral part of our journey.   Here's to many more Tuesday Tips as we pave the way for a brighter, more connected future! As always, watch the News & Announcements for the next set of tips, coming soon!

Hear what's next for the Power Up Program

Hear from Principal Program Manager, Dimpi Gandhi, to discover the latest enhancements to the Microsoft #PowerUpProgram, including a new accelerated video-based curriculum crafted with the expertise of Microsoft MVPs, Rory Neary and Charlie Phipps-Bennett. If you’d like to hear what’s coming next, click the link below to sign up today! https://aka.ms/PowerUp  

Top Solution Authors
Top Kudoed Authors
Users online (5,200)