cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
RyanBarton
Helper I
Helper I

Query based on record ID - Delegation Workaround

There is a need to query based on record ID if you're creating a relational data model.

 

However, if you have thousands of records in a given table, your results are going to be incomplete due to the delegation limit. 

 

Is anyone interested in being able to query any number of records based on record ID to get around the delegation limit of 2000? I have a workaround. Its ridiculous, but it works. 

 

It will be a long post. Let me know if you're interested and ill write up the workaround using a simple example.

 

Microsoft,

 

Please allow us to have the option to turn this limitation off.

1 ACCEPTED SOLUTION

Accepted Solutions

@RyanBarton 

Please take a look at the referenced posting.  The poster there had done this test on the delegation of < > and others and found that they DO delegate on ShaerPoint despite the documentation. 

ALTHOUGH - after re-reading, I seem to get the indiciation that the poster did not, in the end, find that these were delegable...not sure.  @timl you mentioned that the other operators on SharePoint numerics such as ID would delegate?  Did I misunderstand that?

 

At any rate @RyanBarton ...  I should have mentioned this in the very beginning...YES, very interested to hear your solution.  If you think it is more relevant to the other thread, maybe you would post it there instead.  We've got some pretty big messages postings in that one as well.

I'm ALWAYS interested in ways people are finding to overcome the limits.

Thanks for sharing.

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
NOTE: My normal response times will be Mon to Fri from 1 PM to 10 PM UTC (and lots of other times too!)
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

View solution in original post

19 REPLIES 19
RandyHayes
Super User
Super User

@RyanBarton 

What kinds of issues are you facing with delegation in regard to ID?  That is typically one of THE fields that is delegable and safe to use.

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
NOTE: My normal response times will be Mon to Fri from 1 PM to 10 PM UTC (and lots of other times too!)
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

So lets say you set your delegation limit to 10 records. Your SharePoint List contains 20,000 records.

 

Then use Filter(SPListName, ID > 0), which will pertain to all 20,000 records.

 

This will return the entire SharePoint List?

@RyanBarton 

No, but it will return the first 10 it finds greater than 0.

At the same time, if you set your Formula to Filter(SPListName, ID > 10000) it will return the first 10 it finds greater than 10,000.

ID check can be delegated (as can numeric columns)

We had a recent conversation about methods to pull in complete datasources to avoid delegation issues on non-delegable columns.

In my travels, I had taken the information about delegation on SharePoint sources that only the = operator was delegable on SharePoint.  This was direct from the Connector Documentation which STILL states that the = operator is the only delegable operator for ID.  I was told in message 13 that the other operators are delegable on numerics and the documentation has a mistake.  I have not put this to the test yet though.

 

So...your original post here mentioned a query based on record ID for a relational data model.  In many cases, you are going to be getting the related record by its ID - in which case looking for ID=13,200 would return that record as it is delegable.  However, a non-delegable operation would only return any match within your record limit settings. 

ex. Filter(SPsource, DateColumn=DateValue("3/6/2019")) would only return as many records as it could find within your limit you set - if you needed the full filter on that column, you would have to pull down the entire list into a collection and perform the filter on that.

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
NOTE: My normal response times will be Mon to Fri from 1 PM to 10 PM UTC (and lots of other times too!)
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

Oh, and that delegation warning on the > is apparently a mistake that can be ignored according to my cited other posting messages.

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
NOTE: My normal response times will be Mon to Fri from 1 PM to 10 PM UTC (and lots of other times too!)
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

"At the same time, if you set your Formula to Filter(SPListName, ID > 10000) it will return the first 10 it finds greater than 10,000."

 

I wish this was true.

 

Setting your delegation limit to 10 means only the first 10 records in the list will be evaluated. Assuming that our list IDs are 1-20,000 and are in order, Filter(SPListName, ID > 10000) would actually return an empty collection, as only records 1-10 are evaluated in this statement.

Am I missing something here? I get the delegation warning on both "ID" and ">"

Well... we are not comparing apples to apples here.

In SharePoint only the "=" operators works. SQL handles the ">" operator.

 

Thanks for taking the time to chat!

@RyanBarton 

Like I say, I have not vetted that information given to me by @timl yet, but the reference article seems to indicate that vetting

But, I at least know you could get ID = 12000 if looking for it and the limit was 10

And again, going back to the original statement - looking for a relational record.  Wouldn't you be doing that by an ID value?  That *should* be doable.

 

But I believe we're confusing two different aspects here perhaps - delegation and record limits.  These are two different things.  They often go together because delegation becomes an issue after you exceed your record limit.  But, they, by themselves are not the same issue.

 

So - record limit set to 10.  Filter(... ID>0) will only bring 10 records (thats your limit).  Filter(... ID>10000) will bring 10 records, but it didn't "stop looking" after it hit record 10.  Instead the query was delegated to the DataSource and it did the search and returned the limit.

 

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
NOTE: My normal response times will be Mon to Fri from 1 PM to 10 PM UTC (and lots of other times too!)
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

@RyanBarton 

Please take a look at the referenced posting.  The poster there had done this test on the delegation of < > and others and found that they DO delegate on ShaerPoint despite the documentation. 

ALTHOUGH - after re-reading, I seem to get the indiciation that the poster did not, in the end, find that these were delegable...not sure.  @timl you mentioned that the other operators on SharePoint numerics such as ID would delegate?  Did I misunderstand that?

 

At any rate @RyanBarton ...  I should have mentioned this in the very beginning...YES, very interested to hear your solution.  If you think it is more relevant to the other thread, maybe you would post it there instead.  We've got some pretty big messages postings in that one as well.

I'm ALWAYS interested in ways people are finding to overcome the limits.

Thanks for sharing.

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
NOTE: My normal response times will be Mon to Fri from 1 PM to 10 PM UTC (and lots of other times too!)
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

Helpful resources

Announcements

Celebrating the May Super User of the Month: Laurens Martens

  @LaurensM  is an exceptional contributor to the Power Platform Community. Super Users like Laurens inspire others through their example, encouragement, and active participation. We are excited to celebrated Laurens as our Super User of the Month for May 2024.   Consistent Engagement:  He consistently engages with the community by answering forum questions, sharing insights, and providing solutions. Laurens dedication helps other users find answers and overcome challenges.   Community Expertise: As a Super User, Laurens plays a crucial role in maintaining a knowledge sharing environment. Always ensuring a positive experience for everyone.   Leadership: He shares valuable insights on community growth, engagement, and future trends. Their contributions help shape the Power Platform Community.   Congratulations, Laurens Martens, for your outstanding work! Keep inspiring others and making a difference in the community!   Keep up the fantastic work!        

Check out the Copilot Studio Cookbook today!

We are excited to announce our new Copilot Cookbook Gallery in the Copilot Studio Community. We can't wait for you to share your expertise and your experience!    Join us for an amazing opportunity where you'll be one of the first to contribute to the Copilot Cookbook—your ultimate guide to mastering Microsoft Copilot. Whether you're seeking inspiration or grappling with a challenge while crafting apps, you probably already know that Copilot Cookbook is your reliable assistant, offering a wealth of tips and tricks at your fingertips--and we want you to add your expertise. What can you "cook" up?   Click this link to get started: https://aka.ms/CS_Copilot_Cookbook_Gallery   Don't miss out on this exclusive opportunity to be one of the first in the Community to share your app creation journey with Copilot. We'll be announcing a Cookbook Challenge very soon and want to make sure you one of the first "cooks" in the kitchen.   Don't miss your moment--start submitting in the Copilot Cookbook Gallery today!     Thank you,  Engagement Team

Announcing Power Apps Copilot Cookbook Gallery

We are excited to share that the all-new Copilot Cookbook Gallery for Power Apps is now available in the Power Apps Community, full of tips and tricks on how to best use Microsoft Copilot as you develop and create in Power Apps. The new Copilot Cookbook is your go-to resource when you need inspiration--or when you're stuck--and aren't sure how to best partner with Copilot while creating apps.   Whether you're looking for the best prompts or just want to know about responsible AI use, visit Copilot Cookbook for regular updates you can rely on--while also serving up some of your greatest tips and tricks for the Community. Check Out the new Copilot Cookbook for Power Apps today: Copilot Cookbook - Power Platform Community.  We can't wait to see what you "cook" up!      

Tuesday Tip | How to Report Spam in Our Community

It's time for another TUESDAY TIPS, your weekly connection with the most insightful tips and tricks that empower both newcomers and veterans in the Power Platform Community! Every Tuesday, we bring you a curated selection of the finest advice, distilled from the resources and tools in the Community. Whether you’re a seasoned member or just getting started, Tuesday Tips are the perfect compass guiding you across the dynamic landscape of the Power Platform Community.   As our community family expands each week, we revisit our essential tools, tips, and tricks to ensure you’re well-versed in the community’s pulse. Keep an eye on the News & Announcements for your weekly Tuesday Tips—you never know what you may learn!   Today's Tip: How to Report Spam in Our Community We strive to maintain a professional and helpful community, and part of that effort involves keeping our platform free of spam. If you encounter a post that you believe is spam, please follow these steps to report it: Locate the Post: Find the post in question within the community.Kebab Menu: Click on the "Kebab" menu | 3 Dots, on the top right of the post.Report Inappropriate Content: Select "Report Inappropriate Content" from the menu.Submit Report: Fill out any necessary details on the form and submit your report.   Our community team will review the report and take appropriate action to ensure our community remains a valuable resource for everyone.   Thank you for helping us keep the community clean and useful!

Community Roundup: A Look Back at Our Last 10 Tuesday Tips

As we continue to grow and learn together, it's important to reflect on the valuable insights we've shared. For today's #TuesdayTip, we're excited to take a moment to look back at the last 10 tips we've shared in case you missed any or want to revisit them. Thanks for your incredible support for this series--we're so glad it was able to help so many of you navigate your community experience!   Getting Started in the Community An overview of everything you need to know about navigating the community on one page!  Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Community Ranks and YOU Have you ever wondered how your fellow community members ascend the ranks within our community? We explain everything about ranks and how to achieve points so you can climb up in the rankings! Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Powering Up Your Community Profile Your Community User Profile is how the Community knows you--so it's essential that it works the way you need it to! From changing your username to updating contact information, this Knowledge Base Article is your best resource for powering up your profile. Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Community Blogs--A Great Place to Start There's so much you'll discover in the Community Blogs, and we hope you'll check them out today!  Community Links: ○ Power Apps ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Unlocking Community Achievements and Earning Badges Across the Communities, you'll see badges on users profile that recognize and reward their engagement and contributions. Check out some details on Community badges--and find out more in the detailed link at the end of the article! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio    Blogging in the Community Interested in blogging? Everything you need to know on writing blogs in our four communities! Get started blogging across the Power Platform communities today! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Subscriptions & Notifications We don't want you to miss a thing in the community! Read all about how to subscribe to sections of our forums and how to setup your notifications! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Getting Started with Private Messages & Macros Do you want to enhance your communication in the Community and streamline your interactions? One of the best ways to do this is to ensure you are using Private Messaging--and the ever-handy macros that are available to you as a Community member! Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Community User Groups Learn everything about being part of, starting, or leading a User Group in the Power Platform Community. Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Update Your Community Profile Today! Keep your community profile up to date which is essential for staying connected and engaged with the community. Community Links: ○ Power Apps  ○ Power Automate  ○ Power Pages  ○ Copilot Studio   Thank you for being an integral part of our journey.   Here's to many more Tuesday Tips as we pave the way for a brighter, more connected future! As always, watch the News & Announcements for the next set of tips, coming soon!

Hear what's next for the Power Up Program

Hear from Principal Program Manager, Dimpi Gandhi, to discover the latest enhancements to the Microsoft #PowerUpProgram, including a new accelerated video-based curriculum crafted with the expertise of Microsoft MVPs, Rory Neary and Charlie Phipps-Bennett. If you’d like to hear what’s coming next, click the link below to sign up today! https://aka.ms/PowerUp  

Top Solution Authors
Top Kudoed Authors
Users online (2,713)