Announcements
Hello,
I would like to read Databricks delta table to show the data on the screen using PowerApps gallery and insert new records to the same table also. What is the best method to achieve an efficient connection and perform above?
Cheers
Hi @janwoj,
I believe, at this moment there is no standard connector available from Power Platform to connect with Azure Databricks (may be possible with a custom connector but not tried). See below post for more details.https://powerusers.microsoft.com/t5/Building-Power-Apps/Integrate-Power-Apps-with-Azure-Databricks/td-p/1359849Hope this helps.
Hello bapala,
Thank you for your message. I checked the materials you shared. Cdata offers nice solutions but paid - unfortunately this is a limitation for me.
Custom connector is an interesting idea also. As far as I know such connector should be based on REST API. I am struggling a bit with this right now and I have some worries. My need is to make a connection with many, large Databricks delta tables. Passing such heavy data in json payloads through the http requests calls sounds like a nightmare - in terms of performance and rows of scripts that I'll have to prepare to handle those requests.
That's why I asked about an efficient connection. 🙂 Let's have this discussion opened. Maybe anyone will come up with a better solution.
I have a similar requirement and I'm trying to figure this out.
From what I understood so far the two elements to connect are:
Customer Connector in Power Apps: https://learn.microsoft.com/en-us/connectors/custom-connectors/
SQL Statement Execution API in Databricks: https://www.databricks.com/blog/2023/03/07/databricks-sql-statement-execution-api-announcing-public-preview.html
But also struggling to set them up correctly. Will update if I succeed later.
Hi Manuel did you get it ? i am trying and having the same idea
Hi Matoe!
Actually yes. Instead of Power Apps Custom Connector I used Power Automate with an HTTP step. From here you can call the Databricks SQL Statement API:
In the Compose Step you build the SQL Statement which can be a SELECT to read or an UPDATE / INSERT to modify data in the databricks table.
Required a lot of trial and error to figure out how to convert the data from table format to JSON format. But finally it works!
@manuelgp Could you please share the steps.. I am trying this from long time. Thanks in advance
Hi! Steps of what exactly? By now I don't remember much, it was many months ago.
But the gist is what I described in my post:
-Create a Power App
-Include a Power Automate flow with an HTTP call to the SQL Statement API: https://www.databricks.com/blog/2023/03/07/databricks-sql-statement-execution-api-announcing-public-...
which would do a SELECT from a table in databricks.
-Pass the result to Power Apps to display the result in some object.
-Create a UI in the app that would allow you to change / create new records
-Pass the result to another Power Automate flow with an HTTP call to the SQL Statement API with would do an UPDATE/INSERT of the modified data.
For me the challenging part were the conversions between JSON and Tables.
Hope this helps
Under review
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.
Jump in, show your community spirit, and win prizes!
Expanding mentorship, skilling, and AI innovation
These are the community rock stars!
Stay up to date on forum activity by subscribing.
Valantis 474
WarrenBelz 375 Most Valuable Professional
