Can database stored in SharePoint could be connected to ODBC or Hadoop?

Like (0) Share

Report

Posted on 17 Mar 2025 05:18:32 by AR-03030545-0

Hi all,

My Power Apps use SharePoint list as the data source however, we are facing data limitations issue (it reached about 2000 rows already).

I was thinking if the application or SharePoint list itself could export these data to ODBC or Hadoop for better database management and storage.

Thank you and have a great day ahead.

Categories:

Dataflows

Connecting to Data

All responses (4)

Answers (0)

Suggested answer

MSR@08012015 576 on 17 Mar 2025 at 07:22:47

Like (0)

Report
Can database stored in SharePoint could be connected to ODBC or Hadoop?

Hi,

Considering the business use case hadoop is not required, HDFS can be play a vital role in large datasets.

Understanding the Regarding Azure Sql -

Automatically in the sense (Using Power Automate /Flows) when item created copy the item to SQL.

Manually from the sharepoint list export the data excel and sql create a table as per the sharepoint / business requirement and bulk insert the rows from export.

For Dataverse, does that mean I need to change the entire application's data source?

Yes to some extent, (For e.g. If you used sharepoint groups for restricting the permission here you need to use the security role) mostly it will be minimal but if you are fine with SQL its fine.

Lastly, from what you're saying, I can't do anything with the limitations. Correct me if I am wrong.

Every product will have some limitations, in powerapps maximum records which you can retrieve / call is 2000. however it doesn't mean that powerapp support only 2000 records. You can perform operations using (StartsWith, Ends With, Filter) to get the records and increment load the data using pagination approach.

I hope this helps, if you any queries revert me. We can check.

Please click Accept as solution if my post helped you solve your issue. This will help others find it more readily. It also closes the item
Suggested answer

mmbr1606 11,203 Super User 2025 Season 1 on 17 Mar 2025 at 07:03:08

Like (0)

Report

Can database stored in SharePoint could be connected to ODBC or Hadoop?

hey

you can still work with listst over 2000 items without a problem

maybe this helps:

Power Apps Search and Filter Functions on Large SharePoint Lists

if it does please mark as verified answer

cheers
AR-03030545-0 5 on 17 Mar 2025 at 06:30:13

Like (0)

Report
Can database stored in SharePoint could be connected to ODBC or Hadoop?

Hi @MSR@08012015,

Hadoop

Are u really doing any real time data streaming why you opting for hadoop?

To answer your question, yes. This app is an ordering system. It has ordering interface and kitchen interface or dashboard to update the order status. All orders are stored inside the SPL. Changes in order status will be reflected and sync at the dashboard as well.

Azure SQL

Export the SP list to Excel and Import to SQL.

Using Power Automate also read SP List and create rows in SQL.

Premium License

In simpler terms, I can use Power Automate to

1. automatically export SPL to Excel and

2. automatically import from Excel to SQL.

Am I right?

For Dataverse, does that mean I need to change the entire application's data source?

Lastly, from what you're saying, I can't do anything with the limitations. Correct me if I am wrong.

Thank you so much for your reply, I appreciate it.
MSR@08012015 576 on 17 Mar 2025 at 05:50:25

Like (1)

Report
Can database stored in SharePoint could be connected to ODBC or Hadoop?

Hi,

Before migration of data why you are planning to export, Irrespective of moving to any Data source the powerapps (2000) threshold wont be changing.

I can give you the best options for Power-Apps.

Azure SQL

Export the SP list to Excel and Import to SQL.

Using Power Automate also read SP List and create rows in SQL.

Premium License

Dataverse

Relation data + Security features.

Premium License

You can also move the data using flow.

ODBC

https://marketplace.visualstudio.com/items?itemName=CDATASOFTWARE.SharePointODBCDriver - Using this nuget package read the data from sharepoint and develop C# utility to copy the data.

https://www.layer2solutions.com/data-integration/sharepoint-on-prem-data-integration/odbc-sharepoint-integration

Hadoop

Are u really doing any real time data streaming why you opting for hadoop?

Please click Accept as solution if my post helped you solve your issue. This will help others find it more readily. It also closes the item