"First table rows" returns half of the data

[yevreeva]

I have a flow, where I get data from a Power BI, and then I use "Select" to get exact fields I need. Everything works with one exceptions....The "First Table rows" return only half of data exactly! I checked several previous outputs from "Run query against a dataset" vs. the inputs for "Select" action, and the amount of rows is always half less. Did anyone come across this issue? I've been googling for the past several hours and it seem the "First Table rows" should return ALL values but it simply doesn't.....Thoughts, anyone?

Example: 

• "Run query against a dataset" output has 129428 rows (6 columns)
• "Select" Inputs (and thus the Outputs") - has 64714 rows (6 columns)
•  

If I use "body" object in Parse JSON or Compose I get the expected number of rows.

[wskinnermctc · Accepted solution]

Are you hitting the connector limits?

https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/execute-queries#limitations 

Maximum of 100,000 rows or 1,000,000 values per query (whichever is hit first). For example if you query for 5 columns, you can get back max 100,000 rows. If you query for 20 columns, you can get back max 50,000 rows (1 million divided by 20).
Maximum of 15MB of data per query. Once 15MB is exceeded, the current row will be completed but no additional rows will be written.

[yevreeva]

Hello, 

I reviewed the limits, and no, I do not think I am hitting the limit (though I am not sure how I would confirm the 15Mb limit as I do not see the size of data in the output). I have 6 columns, so the total values are 776,568 (129428 rows...perhaps I should correct above to say rows instead of values), so still under 1MM limit.

I also think, if there was a cut off than I would get the same number of rows each time, instead of the data being split in half.

[wskinnermctc]

That says "If you have 5 columns you can get back max 100,000 rows"

You said "You have 6 columns and have 129,428 rows"

129,428 > 100,000

[yevreeva]

Thanks for pointing this out. Shouldn't I at least consistently get 100,000 rows then but instead I am getting exact half of the rows I got from PowerBi? 😄

I would like to add, than I also added Parce JSON as well as Compose functions using "Body" from "Run query against a dataset" and I get the expected number of values. Again, there's some sort of weird division of data within the "First Table rows" function...

 

[wskinnermctc]

I really don't know why the row count isn't 100,000 exactly. I've pulled more than 5000 rows from SharePoint and it has a 5000 row limit. So that's the opposite question.

You're probably right it has more to do with the First table rows.

Try it with a data set of like 20 rows. See if it gives you 10.

[yevreeva]

I found following error message in the middle of the output from the Run query against a dataset: 

"error":{"code":"DaxByteCountNotSupported","message":"More than 15728640 bytes have been encountered. Only 15728640 bytes are allowed."}}],"firstTableRows":

So I did hit the 15Mb limit...it's just sad the message wasn't displayed at the top of the results and was berried inside of the output. Not sure how to resolve it yet.....Thanks for your help.