Skip to main content

Notifications

Community site session details

Community site session details

Session Id : KK/NFkXSY7WhiBGnghFZNs
Power Apps - Microsoft Dataverse
Unanswered

CDS is a data base?

Like (0) ShareShare
ReportReport
Posted on 14 Aug 2019 17:23:35 by 4

Hello,

 

I've been trying to know and understand CDS.
As far as I understand, it's supposed to be a unique place for company data.

At first, I found only data that is from "Records" (dimensions / parameters - such as Employee Data, Cost Centers, Customers)
OK...

but what about the other data? Transactional Data? data that usually pass 1 million rows, easy.

Like accounting records, for example.
I tried to load a 1.7M accounting base and received the following error:
Failed to load in Common Data Service. Details: Number of rows (1,702,462) exceed the limit (500,000).

 

So, in an application, will I have to use CDS and Azure SQL Server (for example)?

 

Please, I'm trying to understand this for days.
I've already searched on several sites and have not found the answer.

 

Thanks a lot!

  • LucasFerronato Profile Picture
    4 on 11 Sep 2019 at 12:54:50
    Re: CDS is a data base?

    Hello, 

     

    maybe you are right! I was able to load in blocks more than 500 thousand lines.

    but I came across other problems ... VERY SLOW, it took about 3-4 hours to load 500k records. Are there any limitations from a performance standpoint?

    (I used Azure import, connected azure to Power Query inside CDS and asked to import ...)

  • kheiman Profile Picture
    29 on 19 Aug 2019 at 16:55:18
    Re: CDS is a data base?

    I think the 500,000 limit you are hitting is the limit of a single project execution. I found a reference here https://docs.microsoft.com/en-us/power-platform/admin/data-integrator saying: 

     

    • To optimize performance and not overload the apps, we currently limit project executions to 500k rows per execution per project.

    Have you tried pushing the data through in 'chunks' of 500k each time?

     

    CDS for Apps (database/platform/framework) should not limit # of rows in an entity.

     

     

  • LucasFerronato Profile Picture
    4 on 19 Aug 2019 at 13:48:05
    Re: CDS is a data base?

    Hi Mona,

     

    Tks for your reply.

     

    Well, i mean somethink like Data Warehouse 

    sometimes use integrations to store data, such as Sales data.
    But I can also be used as intermediate storage. For example, my company uses an ERP, and monthly I need to extract financial data to do the calculations, analysis, reports, etc. (monthly update).
    but in both cases, the data will exceed 500 thousand records ...

    so, this is the question, CDS is a database, like SQL Server, for exemple.

  • v-monli-msft Profile Picture
    on 19 Aug 2019 at 08:06:09
    Re: CDS is a data base?

    Hi @LucasFerronato ,

     

    Did you mean that you want to integrate data into Common Data Service? If so, please check on below documentation for more detailed information.

     

    If there is any misunderstanding, please feel free to tell.

     

    Regards,

    Mona

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing the Engage with the Community forum!

This forum is your space to connect, share, and grow!

🌸 Community Spring Festival 2025 Challenge Winners! 🌸

Congratulations to all our community participants!

Warren Belz – Community Spotlight

We are honored to recognize Warren Belz as our May 2025 Community…

Leaderboard > Power Apps - Microsoft Dataverse

#1
mmbr1606 Profile Picture

mmbr1606 22 Super User 2025 Season 1

#2
stampcoin Profile Picture

stampcoin 17

#3
ankit_singhal Profile Picture

ankit_singhal 11 Super User 2025 Season 1

Overall leaderboard

Featured topics