Unanswered

data integration merge queries issue

(0) Share

Report

Posted on by iDev

Data integration is very good way achieveing the integration but its not working 100%. When we go to advance query and try to use merge queries or append queries and save the query it fails. It fails with an error

[PQOnlineException] failed to update M query for d2cb09a0-4219-11ec-8121-8b7b749b1c2e-TestObjectActivity-TestObjectActivity1. - PQOnline failure - The powerquery job failed with error: Challenge ChallengeType:Resource, ChallengeDataSource:{"Kind":"CommonDataService","NormalizedPath":"tocc-test.crm4.dynamics.com","Path":"tocc-test.crm4.dynamics.com"}
Session ID: fb6c13b5-9fe8-48c0-bbf6-110abfa87fc9
Root Activity ID: 3e6e7102-0e31-44b1-bcd5-70c44790e5fe

@dazhang Could you assist with this. Thanks in advance

Categories:

Entities

Microsoft Dataverse

Dataflows

All responses (5)

Answers (0)

chuyang Microsoft Employee on at

Like (0)

Report

Re: data integration merge queries issue

The error you're seeing is because cross-source table joins is not supported in advanced query and filter for Data Integration in Power Platform Admin Center.
dazhang on at

Like (0)

Report

Re: data integration merge queries issue

Hey @idev, catching up on this after vacation. Now I see you are using Data Integration in the Admin Portal and not Dataflows, so please ignore my comment about Standard V1/V2 dataflows.

We are following up, but we may need to ask for a fresh repro since we only store traces for 29 days.
iDev 14 on at

Like (0)

Report
Re: data integration merge queries issue

Answers to the questions:
What data sources are you merging with? Data source is Dataverse
After you make the changes in the Advanced Query editor and come back to the Query Editor, do you see successful query results in the data preview? Yes
It looks like you are using Standard V1 dataflows, have you tried using a Standard V2 dataflow? I do not understand, I am using dataverse tables and there are only standard and custom tables.

This is what I am doing...
I go to Data Integration then advanced query,
I am able to add the tables successfully

When i perform a join and click save, i get the error
Charles Seguin 401 on at

Like (0)

Report

Re: data integration merge queries issue

Hello @dazhang !

In my experience, the performance of V1 dataflows is more consistent than the newer V2 dataflows.

Usually, I try to use V2 dataflows, but have a V1 dataflow as a backup. This week, following a backend update (at least, on the Europe server), one of my V2 dataflows started failing at every try (despite having been running successfully every day for several weeks). Yet, my quasi-identical V1 dataflow, using the same data source, is running fine. Sometimes, the opposite happens : V1 fails whereas V2 suceeds.

As I have posted in other threads, dataflows are awesome... but Microsoft needs to improve performance stability and consistency. Also, I have my doubts about the quality of the testing performed before dataflow engine updates are pushed into production...

Keep 'em flowin!

Charles
dazhang on at

Like (0)

Report
Re: data integration merge queries issue

Hi @idev, some questions:

What data sources are you merging with?

After you make the changes in the Advanced Query editor and come back to the Query Editor, do you see successful query results in the data preview?

It looks like you are using Standard V1 dataflows, have you tried using a Standard V2 dataflow?