cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Emmett
Frequent Visitor

Migrating on-prem data into CDS

We're considering migrating our operations into CDS/Power Platform and I thought I'd outline our use case and get some advice:

We have an on-prem database which we use for managing a fleet of assets, around 200k of them. We have clients which pay to use these assets. Our data consists of of these assets, as well as historical data about who's using/used them, how much they paid, inspection schedules, maintenance/violation/remediation records, etc. Basic asset management stuff.

As part of a modernization push at our company, we're in the process of migrating as much of our dealings as possible into Azure. We would like to use model driven apps as the new management applications for these assets. Our biggest barrier (which we've found so far) is just getting the data into the Common Data Service for the apps to use.

So my question is this: what utilities, either from Microsoft or third-parties, can you recommend which can facilitate an initial load of this data into the Common Data Service, and what utilities can you recommend to integrate (both-ways preferably, but at least from prem to CDS) with the processes and systems which will remain on-prem? Low/no code solutions are preferred but cheap is definitely the prime directive here.

1 ACCEPTED SOLUTION

Accepted Solutions
jlindstrom
Super User
Super User

so there are several options. If you have a simple data model, you can import the data in manually using the "get data" feature in CDS or the legacy import utility. 

 

https://docs.microsoft.com/en-us/dynamics365/customerengagement/on-premises/basics/import-accounts-l...

 

you could also use a Dataflow to load data using Power Query https://blog.pragmaticworks.com/loading-cds-with-power-apps-dataflows

 

If the data structure has lots of tables and relationships, I recommend using SSIS or azure data factory with the Kingswaysoft connector for CDS (kingswaysoft.com). It's easy to use and very powerful, as you can build a DTS that includes multiple steps and it handles lookups and option sets very gracefully. Also gives you a lot more control over things like threads and batch size, so you can move lots of data relatively quickly.

View solution in original post

1 REPLY 1
jlindstrom
Super User
Super User

so there are several options. If you have a simple data model, you can import the data in manually using the "get data" feature in CDS or the legacy import utility. 

 

https://docs.microsoft.com/en-us/dynamics365/customerengagement/on-premises/basics/import-accounts-l...

 

you could also use a Dataflow to load data using Power Query https://blog.pragmaticworks.com/loading-cds-with-power-apps-dataflows

 

If the data structure has lots of tables and relationships, I recommend using SSIS or azure data factory with the Kingswaysoft connector for CDS (kingswaysoft.com). It's easy to use and very powerful, as you can build a DTS that includes multiple steps and it handles lookups and option sets very gracefully. Also gives you a lot more control over things like threads and batch size, so you can move lots of data relatively quickly.

View solution in original post

Helpful resources

Announcements
PA User Group

Welcome to the User Group Public Preview

Check out new user group experience and if you are a leader please create your group

Power Apps Community Call

Monthly Power Apps Community Call

Did you miss the call?? Check out the Power Apps Community Call here!

secondImage

Experience what’s next for Power Apps

See the latest Power Apps innovations, updates, and demos from the Microsoft Business Applications Launch Event.

Power Platform ISV STudio

Power Platform ISV Studio

ISV Studio is the go-to Power Platform destination for ISV’s to monitor & manage applications post-AppSource publish.

Users online (19,193)