cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
PytByt
Level 8

Run Data Integration Project keep getting duplicates data

Hi all..

 

I'm new with this data integration, so i made a test project to make sure it works perfectly. But i keep getting duplication data every time i hit Run Project. I'm using D365 to CDS connection to sync the service number.

 

This is the connection i use:
mapping1.pngI want to sync the Service Number

 

I keep getting the same data (duplicates data) everytime the project run.

mapping2.png

The same data is always getting pulled by the system every time i hit the Run Project Button.

 

It seems somehow the system not checking if i already have the service number or not, because the Upsert always shows the same number (not update, just inserting the same data over again).
mapping3.pngI always get duplicate data with the same 246 data total

 

What i do wrong?
What should i do to stop the duplicates?

Please help.

Br.

pytbyt

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Community Support Team
Community Support Team

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

The "Alternate Key" in CDS Entity is used to identify the duplicate records. More details about creating an "Alternate Key" in CDS, please check the following article:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

Please also check the following article for more details about working with Alternate Key in CDS Entity:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/define-alternate-keys-entit...

 

More details about creatig a duplicate rule in CDS Entity, please check the following video:

https://www.youtube.com/watch?v=hFZNRmtti5g

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

4 REPLIES 4
Community Support Team
Community Support Team

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

Have you taken a try to define an alternate key or duplicate detection rules for your CDS Entity?

 

The user @Dudditz has faced similar issue with you, please check the response within the following thread:

https://powerusers.microsoft.com/t5/Common-Data-Service-for-Apps/Integration-Job-A-Record-Already-ex...

 

Please also check and see if the following article would help in your scenario:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

 

You could also consider enable the "Duplicate Detection" option for your CDS Entity as below:1.JPG

then create a duplicate rule for your Entity based on the following article:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/detect-duplicate-data-with-...

 

Please consider take a try with above solution, then check if the issue is solved.

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
PytByt
Level 8

Re: Run Data Integration Project keep getting duplicates data

Hi @v-xida-msft 

Its nice to see your reply.

I will read the articles and see if i get it right, also i will try to enable the "Duplicate Detection" option on my CDS Entity.

 

BR.

pytbyt

PytByt
Level 8

Re: Run Data Integration Project keep getting duplicates data

Hi @v-xida-msft 

Could you please give a brief description explaination of how alternate key works with my case? and how i create the alternate key  and duplicate rule in CDS?

Also, i confirm that  the "Duplicate Detection" option for my CDS Entity is already enabled by default. So, this option is not my exit.

Thanks, 

pytbyt

 

 

Community Support Team
Community Support Team

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

The "Alternate Key" in CDS Entity is used to identify the duplicate records. More details about creating an "Alternate Key" in CDS, please check the following article:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

Please also check the following article for more details about working with Alternate Key in CDS Entity:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/define-alternate-keys-entit...

 

More details about creatig a duplicate rule in CDS Entity, please check the following video:

https://www.youtube.com/watch?v=hFZNRmtti5g

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

Helpful resources

Announcements
thirdimage

Power Automate Community User Group Member Badge

Fill out a quick form to claim your user group badge now!

sixthImage

Power Platform World Tour

Find out where you can attend!

Power Platform 2019 release wave 2 plan

Power Platform 2019 release wave 2 plan

Features releasing from October 2019 through March 2020

fifthimage

Microsoft Learn

Learn how to build the business apps that you need.

Top Kudoed Authors (Last 30 Days)
Users online (5,551)