cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Migrating on-prem data into CDS

We're considering migrating our operations into CDS/Power Platform and I thought I'd outline our use case and get some advice:

We have an on-prem database which we use for managing a fleet of assets, around 200k of them. We have clients which pay to use these assets. Our data consists of of these assets, as well as historical data about who's using/used them, how much they paid, inspection schedules, maintenance/violation/remediation records, etc. Basic asset management stuff.

As part of a modernization push at our company, we're in the process of migrating as much of our dealings as possible into Azure. We would like to use model driven apps as the new management applications for these assets. Our biggest barrier (which we've found so far) is just getting the data into the Common Data Service for the apps to use.

So my question is this: what utilities, either from Microsoft or third-parties, can you recommend which can facilitate an initial load of this data into the Common Data Service, and what utilities can you recommend to integrate (both-ways preferably, but at least from prem to CDS) with the processes and systems which will remain on-prem? Low/no code solutions are preferred but cheap is definitely the prime directive here.

1 ACCEPTED SOLUTION

Accepted Solutions

so there are several options. If you have a simple data model, you can import the data in manually using the "get data" feature in CDS or the legacy import utility. 

 

https://docs.microsoft.com/en-us/dynamics365/customerengagement/on-premises/basics/import-accounts-l...

 

you could also use a Dataflow to load data using Power Query https://blog.pragmaticworks.com/loading-cds-with-power-apps-dataflows

 

If the data structure has lots of tables and relationships, I recommend using SSIS or azure data factory with the Kingswaysoft connector for CDS (kingswaysoft.com). It's easy to use and very powerful, as you can build a DTS that includes multiple steps and it handles lookups and option sets very gracefully. Also gives you a lot more control over things like threads and batch size, so you can move lots of data relatively quickly.

View solution in original post

1 REPLY 1

so there are several options. If you have a simple data model, you can import the data in manually using the "get data" feature in CDS or the legacy import utility. 

 

https://docs.microsoft.com/en-us/dynamics365/customerengagement/on-premises/basics/import-accounts-l...

 

you could also use a Dataflow to load data using Power Query https://blog.pragmaticworks.com/loading-cds-with-power-apps-dataflows

 

If the data structure has lots of tables and relationships, I recommend using SSIS or azure data factory with the Kingswaysoft connector for CDS (kingswaysoft.com). It's easy to use and very powerful, as you can build a DTS that includes multiple steps and it handles lookups and option sets very gracefully. Also gives you a lot more control over things like threads and batch size, so you can move lots of data relatively quickly.

Helpful resources

Announcements
Microsoft 365 Conference – December 6-8, 2022

Microsoft 365 Conference – December 6-8, 2022

Join us in Las Vegas to experience community, incredible learning opportunities, and connections that will help grow skills, know-how, and more.

Difinity Conference 2022

Difinity Conference 2022

Register today for two amazing days of learning, featuring intensive learning sessions across multiple tracks, led by engaging and dynamic experts.

European SharePoint Conference

European SharePoint Conference

The European SharePoint Conference returns live and in-person November 28-December 1 with 4 Microsoft Keynotes, 9 Tutorials, and 120 Sessions.

Power Apps Ideas

Check out the New Ideas Site

We are excited to announce a new way to share your ideas for Power Apps!

Users online (4,402)