Answered

Added column to Dataverse table not being returned in Cloud Flow

(1) Share

Report

Posted on by TE-16052318-0

Greetings,

I added 2 columns to a table in Dataverse. I went to adjust a couple of cloud flows that get records from that table and no matter what I do, I can't get them to be returned with the rest of the object.

A few things to note:

. When using dynamic content in subsequent actions within the flows, those 2 columns pop up as options, however they always compile to null because those 2 columns aren't actually being returned by the Get Row By ID or List Rows actions

. In the Get Row By ID and List Rows actions, I can specifically add those columns to the Select field, and the action succeeds (meaning it recognizes that those are fields on the table), but it still won't return the fields. To clarify, it's not that it's returning the fields but they're null, I mean it's not returning those fields at all within the JSON

. I've published the table (multiple times)

. I've published all customizations in the solution

. I've deleted and recreated the actions that query that table

. I've made an entire new copy of one of the flows

it's also notable that in the responses for those actions, it even explicitily has the header:

"Cache-Control": "no-cache",

Let me know if I'm missing something here, because this has never been a problem in the past, or at least 1 of the above things I would do would force some sort of background refresh to get the actions to return the correct fields. But this time nothing is working.

Open to any ideas here.

Categories:

Building flows

I have the same question (0)

All responses (7)

Answers (1)

Pstork1 68,717 Most Valuable Professional on at

Like (0)

Report

This is usually related to the fact that the schema of the table gets cached in the connection when the connection is created. It tends to clear up after about 24 hours, but the only way I've found to get rid of it quicker is to delete the actual connection and create a new one.

----------------------------------------------------------------------------------
If this Post helped you, please click "Does this answer your question" and give it a like to help others in the community find the answer too!

Paul Papanek Stork, MVP
Blog: https://www.dontpapanic.com/blog

Was this reply helpful? Yes No
TE-16052318-0 24 on at

Like (0)

Report

I really appreciate you, @Pstork1.

I can wait 24 hours, I've got other pieces to work on.

As of now ~7 hours since I made the change, it still hasn't updated.

I'll try to test again tonight. Otherwise tomorrow I'll delete the connector (which will mess up ~30 other flows), remake it, and try again.

Was this reply helpful? Yes No
TE-16052318-0 24 on at

Like (0)

Report

It's been 25 hours now since I added those columns.

At ~24h mark, I rechecked and the columns are still not showing up in the flows (however still appear as dynamic content in subsequent actions), so nothing had changed.

I now have done the following:

. created a new connection

. repointed the Connection Reference in question to the new connection

. waited 20m since it gives the disclaimer that it may take several minutes for the connection change to propagate to all CR's.

Since the above didn't work, I:

. repointed the CR to another connection (apparently created by another team, however being a connection using the same service account that connects to Dataverse)

. waited another 20m, same result

I have not deleted the old connection as other teams have CR's that depend on it. I can potentially do it, however it seems risky.

Any other ideas? And I really appreciate the help.

Was this reply helpful? Yes No
Pstork1 68,717 Most Valuable Professional on at

Like (0)

Report

Since the columns show in dynamic content later what happens if you use the connection but specifically list the columns you want in the Select Columns field?

----------------------------------------------------------------------------------
If this Post helped you, please click "Does this answer your question" and give it a like to help others in the community find the answer too!

Paul Papanek Stork, MVP
Blog: https://www.dontpapanic.com/blog

Was this reply helpful? Yes No
TE-16052318-0 24 on at

Like (0)

Report

Ack, yeah, tried that.

". In the Get Row By ID and List Rows actions, I can specifically add those columns to the Select field, and the action succeeds (meaning it recognizes that those are fields on the table), but it still won't return the fields. To clarify, it's not that it's returning the fields but they're null, I mean it's not returning those fields at all within the JSON"

I still get the object back, but it doesn't actually contain the field in the Select.

EDIT: it appears my screenshots never got approved (or disapproved). Returning to this thread 6 days later, my last message still had a banner of:

"Your file is currently under scan for potential threats. Please wait while we review it for any viruses or malicious content"

So I deleted the screenshots, and it looks like now my message went through.

Was this reply helpful? Yes No
TE-16052318-0 24 on at

Like (0)

Report

In the last 6 days, I have tried:

. Recreating flows again

. Recreating connections again

. Recreating connection references again

. Adding new columns to other tables

. Testing flows that use those tables to see if they show new columns (failed)

. Creating new flows that use those tables to see if they show new columns (failed)

These are all flows and tables that I mostly created (~90%). It is a complex client's subscription. I do wonder if they have done something to effect this, however the flows don't error if I query for the field added, and they also show it as dynamic content in subsequent actions. I am using a logged in service account which created the tables, created the columns, created the flows, and the client also uses. So I have no reason to believe it's a permissions issue on any level.

Any ideas are welcome.

Was this reply helpful? Yes No
Verified answer

Pstork1 68,717 Most Valuable Professional on at

Like (0)

Report

Just to clarify. If a value for a field is null then Get Items won't return that field in the results. This saves space because the null field would take up space in the output because it would include the key name. Are you sure the field you are trying to return actually has a value in it? If it doesn't you will get the behavior you mention. Not in the results, but dynamic content shows the field.

----------------------------------------------------------------------------------
If this Post helped you, please click "Does this answer your question" and give it a like to help others in the community find the answer too!

Paul Papanek Stork, MVP
Blog: https://www.dontpapanic.com/blog

Was this reply helpful? Yes No