Some data not appearing in CDS when fed from Dataflow

(0) Share

Report

Posted on by troyhoskison

Hi,

I have an issue where Not all the data is being created in the Entity when I do a data import from a data flow.

The Dataflow is working fine, it says, for example, it has 100 records to add. When the data flow runs it says it has been successful and performed 100 upserts. However, when I look at the entity data it isn't all there some of it is. So If I run the query again but this time filtering on one of the items that are missing, it will add the records.

My gut feel is that the database is overwriting itself. i.e. record 14 is being updated later by record 45.

I have a primary key setup and the query produces a unique value for it. I have checked the there are no duplicates in the source data and that the destination data also doesn't have the same values.

I have even set up another index on two other fields that are unique.

Any thoughts?

Is there anyway to re-setup the primary key?

Troy

Categories:

Dataflows

All responses (4)

Answers (0)

troyhoskison 59 on at

Like (0)

Report

Re: Some data not appearing in CDS when fed from Dataflow

Hi,

I tried that. it didn't work.

Troy
EricRegnier 8,714 Most Valuable Professional on at

Like (0)

Report

Re: Some data not appearing in CDS when fed from Dataflow

Hi @troyhoskison, did you get this resolve? To re-setup the alternate keys on the tables/entities, you can simply delete and recreate them.
troyhoskison 59 on at

Like (0)

Report

Re: Some data not appearing in CDS when fed from Dataflow

I had to recreate the table again, no matter how I set up the indexes the import still failed
Joel CustomerEffective 3,224 on at

Like (0)

Report

Re: Some data not appearing in CDS when fed from Dataflow

How are you doing your match logic? if your data has multiple records that match the key, it will update records rather than creating new ones.