cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
paulhaagsefa
Advocate I
Advocate I

Nested Lookup Delegation Warnings (Dataverse)

Can someone explain to me the Dataverse delegation behavior I'm seeing here?

 

paulhaagsefa_3-1670513239432.png

 

I am preparing to do an update of multiple records without knowing the primary keys, so I need to perform a lookup for each record by the effective composite key (Plant, Sample Location, Sample Date, and Sample Hour) and I can't for the life of me figure out why I sometimes am and sometimes am not getting a delegation problem trying to use attributes of the update collection.

 

As an additional note: I get the exact same behavior in other looping mechanisms (e.g., AddColumns instead of ForAll).

 

Issue 1: Sample Location (Id)

 

When I tried to filter with:

 

Record.'Sample Location'.'Sample Location' = Update.SampleLocation.'Sample Location'

 

it failed to delegate. For some reason, using AddColumns to flatten the ID directly onto the Update object fixes this problem, despite the fact that the data type isn't changing and I can't really think of anything else that is materially different.

 

Issue 2: Sample Date

 

I can't seem to get around this problem. For some reason, it refuses to delegate a date filter for a property of the Update itself. You can see that if I take one of the values and put it in the context (as "test"), it will delegate that just fine, so it's not a data type issue. Furthermore, you can see that it will delegate other Update attributes, like TestHour (which is a whole number).

 

I can sort of get around this problem by pre-filtering the existing samples using everything but date. This is better, but is still pulling more data locally than should be necessary and will eventually stop working if the number of samples matching on everything but date ever exceeds the data row limit.

 

paulhaagsefa_0-1670515033386.png

 

11 REPLIES 11
poweractivate
Super User
Super User

@paulhaagsefa 

 

You are not always given the yellow triangle warning. The issue might be continuing with or without a warning. Sometimes a warning is not given at all. For example, simply using ClearCollect by itself gives no warning. However, you should note that the function itself is subject to the data row limit even with no warning.

 

Try these steps

1. Click Settings

2. Scroll down a bit and check the Data row limit . Change it to 1 temporarily.

poweractivate_0-1670516768020.png

 

 

Now try your queries. If you get only one result and expect two or more, you know the data row limit is applying.

Note that there are also other kinds of limits as well depending on the kinds of controls or methods used. For example, note that a Collection populated by using a single call to ClearCollect is subject to the data row limit despite all inner statements being delegable, because ClearCollect by itself is subject to the data row limit. To test it more effectively and try to isolate the cause to delegation, use the Items property of a Gallery, since there may be other limits when using something else.

 

Try the above and see if you are getting intermittent results between one result and the expected number of results, or are always getting just one result.

I think you're getting hung up on my workaround. The real question is: why isn't using the Update SampleLocation.'Sample Location' or SampleDate delegable? I can't think of  good reason why they shouldn't be, since they are fully materialized locally before entering the ForAll function.

@paulhaagsefa 

 

Does enabling this feature help? Settings -> Upcoming Features - > Record scope one-to-many and many-to-many relationships (if it does not help, turn it back off)

poweractivate_0-1670519260570.png

 


@paulhaagsefa wrote:

: why isn't using the Update SampleLocation.'Sample Location' or SampleDate delegable? 


Did you check with the steps I gave? Note that even if you remove all yellow triangle warnings from the editor, there may still be a data row limit issue or something is still non-delegable. Is it really intermittently working where it is always delegable when the warning is not shown. and not delegable when the warning isn't shown? Or is it the case that even when it doesn't show yellow triangle warning it's still also non-delegable?

 

Although I have not seen this happen, also check to see and be sure if the yellow triangle warning is given, but there is no observable issue in there being less returned results than expected.

 

Note that the absence of the yellow triangle does not guarantee that the data row limit is not applying in some way and the best way to be sure is to lower that data row limit to 1 and test from there. Note that the yellow triangle warning does not always show up and there are cases where it never shows up (intended behavior) yet the data row limit is still applying and/or there is still something non-delegable in there, even with no warning. It's up to you to lower that data row limit to 1 and test with sufficiently large enough samples to make sure some sort of limit is not being triggered in the way you wrote the formula or used the controls. If you want to really be sure, lower the data row limit to 1, and even test with samples of greater than 2000 records to be sure. 

 

Thanks for that suggestion, but it doesn't seem to make a difference for either problem. Especially for the date thing, it should be irrelevant as that has no dependency on a relationship on either side of the equation.

@paulhaagsefa Do you observe a difference in the number of records returned when you try it when use the date and when you don't? I mean when you use the Date are the number of returned results equal to the data row limit when there should be more results, and when you don't use the date the number of returned results are greater than to the data row limit as expected? Is this always corresponding to the presence or absence of the yellow triangle warning i.e. are there always less results than expected when the yellow triangle is present, and are there always the expected number of results when it is absent? (the way to be sure is to lower that limit to 1. Then it returns only 1 result when there is a problem).

 

One issue could be that even when the yellow triangle has disappeared, it "hasn't" really.  If you are getting only one result returned after lowering the data row limit to 1 in all possible versions of your formula with or without the yellow triangle warning, then all versions of the formula you provided, even the workarounds, are affected by the data row limit and either contain one or more non-delegable components or are otherwise triggering the data row limit. I wanted to know this first before I could help you further. 

Let's focus on the date one, since that is the one I don't seem to be able to get around and should be more cut-and-dry anyway. If I try to use the SampleDate property of the Update record, the editor always shows a delegation warning and when I test the app it is always not delegated (you can see it requesting all rows in the monitor). When I replace it with a date value literal or something saved in the context, then the delegation warning goes away and it does delegate / filter appropriately.

 

I guess the title of this question was a little misleading. I don't mean that I am getting different results for the same code, I mean I am getting different results for different code, when it feels like I should be getting the same result (e.g. what is the difference between using a singular date value from the context vs. what should be a singular value from the current record in an iterator?).

@paulhaagsefa It can get complicated because Coalesce, AddColumns, ForAll, possibly a number of other things, and for that matter the outer ClearCollect itself you have are all subject to the data row limit. In this scenario it may therefore make a difference if you are using a literal as opposed to a property because usage of the property may involve the additional traversal of a structure in a non-delegable way. Does another property than a Date work or does it still also produce the delegation issue?

Yes, SampleHour delegates, as does the flattened SampleLocationId.

Helpful resources

Announcements

Tuesday Tips: Getting Started in the Community

TUESDAY TIPS is back!   This weekly series of posts is our way of sharing helpful things we've learned or shared that have helped members of the Community. Whether you're just getting started or you're a seasoned pro, Tuesday Tips will help you know where to go, what to look for, and navigate your way through the ever-growing--and ever-changing--world of the Power Platform Community! The original run of Tuesday Tips was a highlight of last year, and these all-new Tips will hopefully prove to be just as informative as helpful. We will cover some basics about the Community, a few "insider tips" to make your experience even better, and sharing best practices gleaned from our most active community members and Super Users. Make sure to watch the News & Announcements each week for the latest and greatest Tuesday Tips!   THIS WEEK: I'm Brand New! What Do I Do? The number of new community members we have each week is pretty amazing, and we are so glad to welcome all of you to the Community! You may be wondering. "What do I do? Where do I get started? Will anyone be willing to help me? What I have a question? Help!"   Let's start with this: Welcome to the low-code revolution, and more importantly, welcome to the Power Platform Community! This is a great place to start. Whether you're busy with Power Apps, getting familiar with Power Automate, engaging Copilot Studio, or building in Power Pages, there are a few key places you should check out as you begin your journey: FORUMS: The forums are THE place to ask questions, look at questions asked by other Community members—and see answers and solutions from our Super Users and other helpful people in the Community. Power Apps ForumsPower Automate ForumsCopilot Studio ForumsPower Pages Forums   NEWS & ANNOUNCEMENTS: Our News & Announcements section highlights the newest and greatest updates in the Community, news from the product team, and so much more. It’s updated a few times each week and will also help you find ways to connect with what’s going on in the ever-growing world of Power Platform. Power Apps News & AnnouncementsPower Automate News & AnnouncementsCopilot Studio News & AnnouncementsPower Pages News & Announcements   GALLERIES: The Galleries section of the Community features tons of tips and tricks, features and benefits, and more—through videos created by our Super Users, product teams, and other helpful members of the Community. Power Apps GalleriesPower Automate Galleries Copilot Studio GalleriesPower Pages Galleries BLOGS: The community blogs section is full of handy step-by-step tips from members of the Community—and some of them include detailed answers to some of the questions most frequently asked questions, as well as how they solved a problem they faced. Power Apps Community BlogPower Automate Community BlogCopilot Studio Community BlogPower Pages Community Blog POWER UP PROGRAM: If you’d like to really take a huge step forward in your journey, we recommend checking out the Power Up Program, a Microsoft-sponsored initiative that trains new Power Platform users and has been a huge success since it launched a little over a year ago. There’s a waiting list, so definitely apply soon if you’re interested! Find out more here: Microsoft Power Up Program for career switchers.   There's so much more you'll discover in your Power Platform experience, and this Community is here for YOU! We are glad you've discovered us and can't wait to see where you grow! If you're new to the Community and just getting started, make sure to give this post a kudo and introduce yourself so we can welcome you!

Super User of the Month | Drew Poggemann

As part of a new monthly feature in the Community, we are excited to share that Drew Poggemann is our featured Super User for the month of February 2024. If you've been in the Community for a while, we're sure Drew's name is familiar to you, as he is one of our most active contributors--he's been a Super User for five consecutive seasons!   Since authoring his first reply 5 years ago to his 514th solution authored, Drew has helped countless Community members with his insights and expertise. In addition to being a Super User, Drew is also a User Group leader and a Microsoft MVP. His contributions to our Super User sessions and to the new SUIT program are always welcome--as well as his sense of humor and fun-loving way of sharing what he knows with others.   When Drew is not solving problems and authoring solutions, he's busy overseeing the Solution Architecture team at HBS, specializing in application architecture and business solution strategy--something he's been doing for over 30 years. We are grateful for Drew and the amazing way he has used his talent and skills to help so many others in the Community. If you are part of the SUIT program, you got to hear some great tips from Drew at the first SUIT session--and we know he still has much more to share!You can find him in the Community and on LinkedIn. Thank you for all you do, Drew!

Announcing Power Apps Copilot Cookbook Gallery

We are excited to share that the all-new Copilot Cookbook Gallery for Power Apps is now available in the Power Apps Community, full of tips and tricks on how to best use Microsoft Copilot as you develop and create in Power Apps. The new Copilot Cookbook is your go-to resource when you need inspiration--or when you're stuck--and aren't sure how to best partner with Copilot while creating apps.   Whether you're looking for the best prompts or just want to know about responsible AI use, visit Copilot Cookbook for regular updates you can rely on--while also serving up some of your greatest tips and tricks for the Community. Our team will be reviewing posts using the new "Copilot Studio" label to ensure we highlight and amplify the most relevant and recent content, so you're assured of high-quality content every time you visit. If you share a post that gets featured in the curated gallery, you'll get a PM in the Community to let you know!The curated gallery is ready for you to experience now, so visit the new Copilot Cookbook for Power Apps today: Copilot Cookbook - Power Platform Community. We can't wait to see what you "cook" up!      

Celebrating a New Season of Super Users with Charles Lamanna, CVP Microsoft Business Applications

February 8 was the kickoff to the 2024 Season One Super User program for Power Platform Communities, and we are thrilled to welcome back so many returning Super Users--as well as so many brand new Super Users who started their journey last fall. Our Community Super Users are the true heroes, answering questions, providing solutions, filtering spam, and so much more. The impact they make on the Communities each day is significant, and we wanted to do something special to welcome them at our first kickoff meeting of the year.   Charles Lamanna, Microsoft CVP of Business Applications, has stressed frequently how valuable our Community is to the growth and potential of Power Platform, and we are honored to share this message from him to our 2024 Season One Super Users--as well as anyone who might be interested in joining this elite group of Community members.     If you want to know more about Super Users, check out these posts for more information today:    Power Apps: What is A Super User? - Power Platform CommunityPower Automate: What is A Super User? - Power Platform Community Copilot Studio: What is A Super User? - Power Platform Community Power Pages: What is A Super User? - Power Platform Community

February 2024 User Group Update: Welcoming New Groups and Highlighting Upcoming Events

It's a new month and a brand-new year, which means another opportunity to celebrate our amazing User Groups!Each month, we highlight the new User Groups that have joined the community. It's been a busy season for new groups, because we are thrilled to welcome 15 New User Groups! Take a look at the list below, shared by the different community categories. If your group is listed here, give this post a kudo so we can celebrate with you!   We love our User Groups and the difference they make in the lives of our Community! Thank you to all the new User Groups, new User Group leaders--we look forward to hearing about your successes and the impact you will leave!   In addition to our monthly New User Group spotlight, it's a great time to share some of the latest events happening in our User Group community! Take a look at the list below to find one that fits your schedule and need! There's a great combination of in-person and virtual events to choose from. It's a great time of year to connect and engage with User Groups both locally and online. Please Welcome Our NEW User Groups   Power Platform: Heathcare Power Platform User Group Power Platform Connect Hub Power Platform Usergroup Denmark Mexico Norte- Power Platform User Group Pune Power User Group Sudbury Power Platform User GroupMicrosoft User Group GhanaMPPBLR - Microsoft Power Platform Bengaluru User Group Power Apps:   Myrtle Beach Power Platform User GroupAnanseTechWB PowerApps Copilot Studio: Pathfinders Power Platform Community Dynamics365: Cairo, Egypt MSD 365 Business Central/NAV/F&O User GruopMS Dynamics 365 Business Central LatamCincinnati OH D365 F&O User Group February User Group Events February 2024 Cleveland Power Platform User GroupPortallunsj - Februar 2024Indiana D365/AX February User Group MeetingQ1 2024 KC Power Platform and Dynamics 365 CRM Users Group 

Super Users 2024 Season One is Here!

   We are excited to announce the first season of our 2024 Super Users is here! Our kickoff to the new year welcomes many returning Super Users and several new faces, and it's always exciting to see the impact these incredible individuals will have on the Community in 2024! We are so grateful for the daily difference they make in the Community already and know they will keep staying engaged and excited for all that will happen this year.   How to Spot a Super User in the Community:Have you ever written a post or asked for help in the Community and had it answered by a user with the Super User icon next to their name? It means you have found the actual, real-life superheroes of the Power Platform Community! Super Users are our heroes because of the way they consistently make a difference in the Community. Our amazing Super Users help keep the Community a safe place by flagging spam and letting the Community Managers know about issues. They also make the Community a great place to find answers, because they are often the first to offer solutions and get clarity on questions. Finally, Super Users share valuable insights on ways to keep the Community growing, engaging, and looking ahead!We are honored to reveal the new badges for this season of Super Users! Congratulations to all the new and returning Super Users!     To better answer the question "What is a Super User?" please check out this article: Power Apps: What is A Super User? - Power Platform CommunityPower Automate: What is A Super User? - Power Platform Community Copilot Studio: What is A Super User? - Power Platform Community Power Pages: What is A Super User? - Power Platform Community

Top Solution Authors
Top Kudoed Authors
Users online (4,809)