cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Post Prodigy
Post Prodigy

Run Data Integration Project keep getting duplicates data

Hi all..

 

I'm new with this data integration, so i made a test project to make sure it works perfectly. But i keep getting duplication data every time i hit Run Project. I'm using D365 to CDS connection to sync the service number.

 

This is the connection i use:
I want to sync the Service NumberI want to sync the Service Number

 

I keep getting the same data (duplicates data) everytime the project run.

mapping2.png

The same data is always getting pulled by the system every time i hit the Run Project Button.

 

It seems somehow the system not checking if i already have the service number or not, because the Upsert always shows the same number (not update, just inserting the same data over again).
I always get duplicate data with the same 246 data totalI always get duplicate data with the same 246 data total

 

What i do wrong?
What should i do to stop the duplicates?

Please help.

Br.

pytbyt

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Community Support
Community Support

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

The "Alternate Key" in CDS Entity is used to identify the duplicate records. More details about creating an "Alternate Key" in CDS, please check the following article:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

Please also check the following article for more details about working with Alternate Key in CDS Entity:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/define-alternate-keys-entit...

 

More details about creatig a duplicate rule in CDS Entity, please check the following video:

https://www.youtube.com/watch?v=hFZNRmtti5g

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

4 REPLIES 4
Highlighted
Community Support
Community Support

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

Have you taken a try to define an alternate key or duplicate detection rules for your CDS Entity?

 

The user @Dudditz has faced similar issue with you, please check the response within the following thread:

https://powerusers.microsoft.com/t5/Common-Data-Service-for-Apps/Integration-Job-A-Record-Already-ex...

 

Please also check and see if the following article would help in your scenario:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

 

You could also consider enable the "Duplicate Detection" option for your CDS Entity as below:1.JPG

then create a duplicate rule for your Entity based on the following article:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/detect-duplicate-data-with-...

 

Please consider take a try with above solution, then check if the issue is solved.

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Highlighted
Post Prodigy
Post Prodigy

Re: Run Data Integration Project keep getting duplicates data

Hi @v-xida-msft 

Its nice to see your reply.

I will read the articles and see if i get it right, also i will try to enable the "Duplicate Detection" option on my CDS Entity.

 

BR.

pytbyt

Highlighted
Post Prodigy
Post Prodigy

Re: Run Data Integration Project keep getting duplicates data

Hi @v-xida-msft 

Could you please give a brief description explaination of how alternate key works with my case? and how i create the alternate key  and duplicate rule in CDS?

Also, i confirm that  the "Duplicate Detection" option for my CDS Entity is already enabled by default. So, this option is not my exit.

Thanks, 

pytbyt

 

 

Highlighted
Community Support
Community Support

Re: Run Data Integration Project keep getting duplicates data

Hi @PytByt ,

The "Alternate Key" in CDS Entity is used to identify the duplicate records. More details about creating an "Alternate Key" in CDS, please check the following article:

https://community.dynamics.com/crm/b/microsoftdynamicscrmsolutions/posts/define-alternate-keys-for-a...

Please also check the following article for more details about working with Alternate Key in CDS Entity:

https://docs.microsoft.com/en-us/powerapps/developer/common-data-service/define-alternate-keys-entit...

 

More details about creatig a duplicate rule in CDS Entity, please check the following video:

https://www.youtube.com/watch?v=hFZNRmtti5g

 

Best regards,

Community Support Team _ Kris Dai
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

Helpful resources

Announcements
August 2020 Community Challenge: Can You Solve These?

August 2020 Community Challenge: Can You Solve These?

We're excited to announce our first cross-community 'Can You Solve These?' challenge!

secondImage

Return to Workplace

Reopen responsibly, monitor intelligently, and protect continuously with solutions for a safer work environment.

secondImage

Super Users Coming in August

We are excited for the next Super User season.

secondImage

Community User Group Member Badges

FIll out a quick form to claim your community user group member badge today!

secondImage

Power Platform 2020 release wave 2 plan

Features releasing from October 2020 through March 2021

Users online (7,495)