I would like to read Databricks delta table to show the data on the screen using PowerApps gallery and insert new records to the same table also. What is the best method to achieve an efficient connection and perform above?
I believe, at this moment there is no standard connector available from Power Platform to connect with Azure Databricks (may be possible with a custom connector but not tried). See below post for more details.
Thank you for your message. I checked the materials you shared. Cdata offers nice solutions but paid - unfortunately this is a limitation for me.
Custom connector is an interesting idea also. As far as I know such connector should be based on REST API. I am struggling a bit with this right now and I have some worries. My need is to make a connection with many, large Databricks delta tables. Passing such heavy data in json payloads through the http requests calls sounds like a nightmare - in terms of performance and rows of scripts that I'll have to prepare to handle those requests.
That's why I asked about an efficient connection. 🙂 Let's have this discussion opened. Maybe anyone will come up with a better solution.