Dataflow Refresh Failure - 'The required keys for table were not yet created.'

[NuttyPistons]

I created a simple dataflow from an Azure SQL database. I set the recurring refresh to occur every two minutes and this pushes to a new table in Dataverse.

For the first two runs, the refresh failed after about five minutes. On the third, it succeeded after about five minutes. The following 12 refreshes were all successful, taking approximately 45 seconds to refresh (which is more in line with my expectations, given the small amount of data in the query). After that run of successes, it started once again failing after running for five minutes. Since the run of 12 consecutive successes, I've had 20 straight failures and no more successes.

It's always the same error message: 
'Refresh failed because the required keys for cr950_job table were not yet created. If this is the first time you are seeing this error, please try refreshing dataflow again.'

Nothing has changed in the query, nor has anything changed in the Azure SQL database I'm pointing at, since I created the flow (SQL DB refreshes daily).

I'm looking for any clues or troubleshooting ideas to determine why it started failing and how I can prevent that going forward.

Thanks in advance!

[Prakash4691 · Accepted solution]

Hi @NuttyPistons ,

As per the screenshots, alternate keys has been created for two columns.

Can you try with one column. Duplicate record has been handled using alternate key.

If alternate key created for table/entity upsert request will be handled inside CDS/Microsoft Dataverse.

Regards,

Prakash

[Prakash4691]

Hi @NuttyPistons ,

Please do check any alternate key has been created for table inside CDS/Microsoft Dataverse.

Included screenshot FYR.

alternate key