web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Sync SQL table into CDS
Power Automate
Unanswered

Sync SQL table into CDS

(0) ShareShare
ReportReport
Posted on by 4

Hi:

 

I was playing with powerapps by creating a simple inventory lookup to a SQL table accessed via the gateway service. The query was always slow, despite a 100Mb connection onsite, so I tested the same app using the CDS and it was much faster.

 

So, I want to sync the SQL table with a CDS entity a few times a day to keep it updated. I tried to use a flow process that read all rows from the SQL table and added rows to the CDS service - but it always stops at 500 rows (it appears the powerapps 500 row limit is the same in Flow.)

 

Has anyone got a way around this? Or maybe there's another way to do it.

Categories:
I have the same question (0)
  • abm abm Profile Picture
    32,865 Most Valuable Professional on at

    Hi @lionofnowhere,

     

    I think you are right. There is a limitation here. I need to do more testing around here and let you know.

     

    Thanks

  • abm abm Profile Picture
    32,865 Most Valuable Professional on at

    Hi @lionofnowhere,

     

    Created 1000 records in a SQL table and try to create the records in CDS. 512 records are created. So the options are try to use the recurrence flow to trigger and configure to run every few minutes or hours. Once the record is created in CDS update the SQL record (SQL Field - 'Updated' Type - boolean) to true. Filter the SQL records using ODATA against Updated boolean flag. I haven't tested the ODATA filter in SQL yet. If you want me to test let me know.

     

    Thanks 

  • lionofnowhere Profile Picture
    4 on at

    @abm Thanks, that's a good idea, I'll give it a try.

     

     

  • abm abm Profile Picture
    32,865 Most Valuable Professional on at

    Hi @lionofnowhere,

     

    Let me know the outcome about ODATA. Thanks for your reply.

  • lionofnowhere Profile Picture
    4 on at

    I'm trying to think of a way to avoid querying the gateway every few minutes.

     

    I thought I could have a counter in CDS that was incremented for each instance of the flow that started (it would need ot be reset to 0 before a full sync). The counter would be used to retrieve the right set of 500 records, using the offset parameter, for the instance of flow running; when no more records were available I could set a flag in CDS that could be read by new isntances of the flow to tell the flow to terminate because all records were already synced (both the flag and counter would be reset once a day to start the sync.)

     

    However, there does not seem to be a way to increment a field in CDS. I tried reading a field and incrementing it, but flow attempts to convert the code to an integer.

     

    I think I'm hitting the limits of flow here. What appears quite a simple task is becoming very complicated.

     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Automate

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 523 Super User 2025 Season 2

#2
Tomac Profile Picture

Tomac 406 Moderator

#3
abm abm Profile Picture

abm abm 245 Most Valuable Professional

Last 30 days Overall leaderboard