cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
yayak
Level: Power Up

[ASK] Best datasource for large data

Hi All

 

I'm new at Powerapps, already build an app with large data. already trying to use excel and sharepoint as datasource but there is unable to read records more than 2000 rows.

So, i need advise best solution if my records/data is about 10.000-14.000 records. what best datasource should i used?

its static data but large records enough.

Thanks in advance

 

Regards

Yayak

6 REPLIES 6
Highlighted
Super User
Super User

Re: [ASK] Best datasource for large data

Hi @yayak ,

If it is static data, use the static data connector from Excel. It is limited to 15000 rows but is completely delegatable and loads fast. See my post in the Community blog on zip codes. You can merge them in collections for sources greater than 15000 rows. Otherwise, for datasources you can modify, I suggest CDS or Sql server.

yayak
Level: Power Up

Re: [ASK] Best datasource for large data

Hi @Drrickryp 

 

Thanks for your reply

Yes its static data, but i used this in gallery with filter or lookup.

if i used this data without filter or look up function, the all data will generated well

But if i used filter or lookup it ca,t to exceed 2000 rows. and using filer/lookup is mandatory to filter the content

 

Regards

Yayak

Super User
Super User

Re: [ASK] Best datasource for large data

@yayak ,

I have done this many times in my apps. If you import the data using the Excel static data source, you can import up to 15000 items and sort, filter, and search will work on it. Screenshot_4.png

yayak
Level: Power Up

Re: [ASK] Best datasource for large data

Hi @Drrickryp 

 

its still no luck with your solution above, even its stuck at 500 rows

Let me to explain more my details.

1. Combobox

    It (Table1) contain columns : Number - ID_Table1 - Decription

    Total data is 148 rows

    Its work fine on combobox with no filter on items

2. Gallery

    It (Table2) contain columns : Number - ID - Description - ID_Table1

    Where Column ID_Table1 is a key to connect between 2 tables (Table1 & Table2)

    Its "Items" value is "Filter(Table1, ID_Table1 in ComboBox.SelectedItems.ID)"

    Total data is 10.000 rows +

 

I have try to used upload excel on onedrive and used sharepoint list, but still no luck to load data on Gallery with those filter condition, stuck at 500 or 2000 if Data row limit for non-delegable queries increased from 500 to 2000

 

What should i try again with this condition (Load large data at Gallery with filter)?

should i use oracle or azure sql as a datasource?

 

Regards

Yayak

 

yayak
Level: Power Up

Re: [ASK] Best datasource for large data

Hi @Drrickryp 

 

Now it can be load until 1500 rows, was only can load 500 rows. I'm not doing anything but how it can be increased from 500 to 1500.

it still confusing me

 

Regards

Yayak

 

Super User
Super User

Re: [ASK] Best datasource for large data

Hi @yayak 

Can you confirm that you used the 'Add static data to your app' option that @Drrickryp suggested? When you select View > Data Sources > New Connection, it's usually the first item that appears in the list.

 

image.png

There are 2 ways to add Excel data to an app. If you choose the 'Add static data to your app' option, you shouldn't see these delegation problems.

Here's a link on how to batch import more than 15k records.

https://powerusers.microsoft.com/t5/General-Discussion/Bring-an-excel-with-40k-rows/m-p/253265#M7425...