Skip to main content
Community site session details

Community site session details

Session Id : J+dahGKM2H3GocfSLK9xAO
Power Apps - Microsoft Dataverse
Unanswered

Dataverse Tables Data Migration using Azure Data Factory (Many-to-Many)

Like (0) ShareShare
ReportReport
Posted on 25 Apr 2022 22:39:49 by 57

Hi Team,

 

I am trying to migrate data from SQL server to Dataverse. Currently, I am migrating data for a many-to-many relationship using Azure Data Factory. I have followed the below steps:

1. Using ADF, imported Table1 - Employee

2. Using ADF, imported Table 2 - Training

3. Using ADF, imported Intermediate table (Employee_Training)

Note: I have created the required intersect table data (GUIDs) in Azure SQL - EmployeeID, TrainingID

 

In step 3, my ADF has failed because I am not able to provide the Alternative Key in the Sink configuration. Please note Employee & Training tables relationship is System many-to-many relationship and not the manual many-to-many relationship, so I don't have access to the table to create an Alternative Key. 

Sandeep009_0-1650926280148.png

 

 

ErrorCode=DynamicsMissingKeyColumns,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=,Source=,''Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Input DataSet must contain keycolumn(s) in Upsert/Update scenario. Missing key column(s): pp_training_employeeid

 

Any workaround? Please advise.

 

Thank you!

Categories:
  • skolarvs Profile Picture
    57 on 27 Apr 2022 at 15:27:29
    Re: Dataverse Tables Data Migration using Azure Data Factory (Many-to-Many)

    I have also found one forum saying that the Dataverse many-to-many relationship is NOT supported by Azure Data Factory (ADF). Does anyone aware of this limitation with ADF when it comes to Dataverse many-to-many relationships? 

  • skolarvs Profile Picture
    57 on 27 Apr 2022 at 15:20:57
    Re: Dataverse Tables Data Migration using Azure Data Factory (Many-to-Many)

    Hi @bipinshan 

    Thanks for your response. 

    Unfortunately, there is only one option for Dataverse Sink step Write Behavior - Upsert. There is no Insert option. Thanks you!

  • Bipin D365 Profile Picture
    971 on 27 Apr 2022 at 14:40:49
    Re: Dataverse Tables Data Migration using Azure Data Factory (Many-to-Many)

    HI @Sandeep009 ,

     

    Can you please change Write behaviour to Insert from Upsert so that key column(s): pp_training_employeeid GUID will be auto generated by the system?

     

    If you are not able to change the Write Behaviour then try adding another column in your source and randomly generate GUID for that column and map it to pp_training_employeeid in ADF.

     

    Thanks,

    Bipin

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing our 2025 Season 2 Super Users!

A new season of Super Users has arrived, and we are so grateful for…

Paul Stork – Community Spotlight

We are honored to recognize Paul Stork as our July 2025 Community…

Congratulations to the June Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Apps

#1
WarrenBelz Profile Picture

WarrenBelz 637 Most Valuable Professional

#2
stampcoin Profile Picture

stampcoin 570 Super User 2025 Season 2

#3
Power Apps 1919 Profile Picture

Power Apps 1919 473

Featured topics

Loading complete