Dataflow Incremental Refresh leads to "Error: The field 'lops_lastupdated' of the record wasn't found."

[Kikoger]

Hi all,

we set up a pretty elaborate Dataflow with 4 sources that merge into each other. All 4 sources have lastUpdated columns that are formatted as datetimes and also go into a column in the destination tables without any issues.

When doing a full refresh, everything works just fine, but enabling incremental refresh causes the following error:

"[...] Error: The field 'lops_lastupdated' of the record wasn't found. [...]"

The field is definitely there, as it is also mapped to a column in the target table and that is working fine. Besides, I can select the column when setting up the incremental refresh params, so the system detects it.

I also checked for blank values in the source, but there are none.

Any ideas? Anyone experienced a similar issue in the past?

Thank you 🙂 

[AhmedSalih]

Hello, @Kikoger, the Column1.lastUpdated, is it a DateTime format? Does it include values for all records?

 

If my reply helped you, please give a 👍 , & if it solved your issue, please 👍 & Accept it as the Solution to help other community members find it more.

I am primarily available on weekdays from 6-10 PM CT and 5-10 PM CT on weekends.

Visit my Blog: www.powerplatformplace.com

[Kikoger]

Hi Ahmed - yes to both 👍