On-Prem Gateway Testing Performance and Joining Tables

[sasrsc1966]

So everything I've done so far with PA is using SP Lists. Nice and simple and easy.

But now I'm wanting to test using a SQL Server connection through an on-prem gateway.

I can connect and pull in thousands of rows.

But I want to join 2 of these data sources to create a single gallery view. Normally I'd do a Lookup and not think twice. 
But it seems that for each row (and I have thousands it therefore makes a separate call). Obviously not good performance wise.
I'm asking the DBA to create some SQL views for me that combines the tables and I'm wanting to test that.

My other thought was to create collections for each massive table and join the collections thinking that performance wise that would be quicker, but as I understand it there's a 2000 row limit even for collections. 
Maybe I'm misunderstanding collections or the best practice for joining tables. 
When you have 100,000 rows of data what would you do to address joining tables together?

[v-xiaochen-msft · Accepted solution]

Hi @sasrsc1966 ,

As far as I know, there are three ways:

1\ Use the delegable formula to query the sql data source

2\ Create sql view

3\ Canvas calls flow and uses flow to get the data in sql, and finally returns the data to canvas

For the third method, it can return up to 100,000 data.

Best Regards,

Wearsky