cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
PytByt
Level: Powered On

Run Data Integration Project keep getting duplicates data

Hi all..

 

I'm new with this data integration, so i made a test project to make sure it works perfectly. But i keep getting duplication data every time i hit Run Project. I'm using D365 to CDS connection to sync the service number.

 

This is the connection i use:
mapping1.pngI want to sync the Service Number

 

I keep getting the same data (duplicates data) everytime the project run.

mapping2.png

The same data is always getting pulled by the system every time i hit the Run Project Button.

 

It seems somehow the system not checking if i already have the service number or not, because the Upsert always shows the same number (not update, just inserting the same data over again).
mapping3.pngI always get duplicate data with the same 246 data total

 

What i do wrong?
What should i do to stop the duplicates?

Please help.

Br.

pytbyt

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Community Support Team
Community Support Team

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

The "Alternate Key" in CDS Entity is used to identify the duplicate records. More details about creating an "Alternate Key" in CDS, please check the following article:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

Please also check the following article for more details about working with Alternate Key in CDS Entity:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/define-alternate-keys-entit...

 

More details about creatig a duplicate rule in CDS Entity, please check the following video:

https://www.youtube.com/watch?v=hFZNRmtti5g

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
4 REPLIES 4
Community Support Team
Community Support Team

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

Have you taken a try to define an alternate key or duplicate detection rules for your CDS Entity?

 

The user @Dudditz has faced similar issue with you, please check the response within the following thread:

https://powerusers.microsoft.com/t5/Common-Data-Service-for-Apps/Integration-Job-A-Record-Already-ex...

 

Please also check and see if the following article would help in your scenario:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

 

You could also consider enable the "Duplicate Detection" option for your CDS Entity as below:1.JPG

then create a duplicate rule for your Entity based on the following article:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/detect-duplicate-data-with-...

 

Please consider take a try with above solution, then check if the issue is solved.

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
PytByt
Level: Powered On

Re: Run Data Integration Project keep getting duplicates data

Hi @v-xida-msft 

Its nice to see your reply.

I will read the articles and see if i get it right, also i will try to enable the "Duplicate Detection" option on my CDS Entity.

 

BR.

pytbyt

PytByt
Level: Powered On

Re: Run Data Integration Project keep getting duplicates data

Hi @v-xida-msft 

Could you please give a brief description explaination of how alternate key works with my case? and how i create the alternate key  and duplicate rule in CDS?

Also, i confirm that  the "Duplicate Detection" option for my CDS Entity is already enabled by default. So, this option is not my exit.

Thanks, 

pytbyt

 

 

Highlighted
Community Support Team
Community Support Team

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

The "Alternate Key" in CDS Entity is used to identify the duplicate records. More details about creating an "Alternate Key" in CDS, please check the following article:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

Please also check the following article for more details about working with Alternate Key in CDS Entity:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/define-alternate-keys-entit...

 

More details about creatig a duplicate rule in CDS Entity, please check the following video:

https://www.youtube.com/watch?v=hFZNRmtti5g

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
firstImage

PowerApps Monthly Community Call!

Join us next Wednesday for our Demo Extravaganza, October 16, 2019 8am PDT.

firstImage

Microsoft Business Applications Virtual Launch Event

Join us for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

firstImage

Watch Sessions On Demand!

Continue your learning in our online communities.

Power Platform 2019 release wave 2 plan

Power Platform 2019 release wave 2 plan

Features releasing from October 2019 through March 2020

FirstImage

Power Platform World Tour

Coming to a city near you

thirdimage

PowerApps Community User Group Member Badge

Fill out a quick form to claim your user group badge now!

FourthImage

Join PowerApps User Group!!

Connect, share, and learn with your peers year-round

SecondImage

Power Platform Summit North America

Register by September 5 to save $200

Users Online
Currently online: 352 members 4,390 guests
Please welcome our newest community members: