cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
MattB-MSFT
Employee
Employee

Announcing the .net Core SDK for Common Data Service (CDS) - External Client Development

This Post has been superseded by net-SDK-for-Dataverse-Dataverse-ServiceClient 

 

 

Folks, 

As many of you know, we have a existing .net full framework SDK that we provide for folks to develop client applications that communicate with CDS.  This SDK has existed for a long period and arose from the Dynamics 365 aspects of our platform. 

We have continued to support this SDK over the last many years over many versions of our platform.   

 

We have been working to update this SDK package to better address the needs of the current platform and the technologies that many of our partners who develop client applications to integrate with the Power Platform use.   We are now ready to share this with the larger community for testing and feedback. 

 

Today we have posted the alpha version of the Microsoft.Powerplatform.Cds.Client on nuget.  along with a few additional packages that we are using to split out the Dynamics Sales / Service and Marketing centric messages and helpers from the core CDS platform SDK

 

This version of the SDK libs supports the following and has the following notices: 

  1. .net full framework 4.6.2, 4.7.2, 4.8 and .net core 3.0, 3.1 
  2. We are supporting only Client Secret / Cert flows for .net core.  On .net framework additionally we support OAuth User flows
  3. We are shipping the initial drop using ADAL.net for the Auth Lib.   We MAY change to use MSAL shortly 
    1. MSAL would enabled us to support User Interactive flows on .net core. 
  4. The Namespaces of areas WILL change.  We do not know what they will change too just yet but they will change before we “release” this.
  5. The Assembly Names Will likely change at least once more. 
  6. The Message types that are part of the client have been reduced to CDS Core server messages only.  Things like “QualifyLeadRequest” have been removed to their own Nuget package ( Microsoft.Dynamics.Sdk.Messages ) 
  7. We will likely ship more extension packages that will contain the “CRM” messages,  though over time, we will likely split the namespaces of those messages up based on service line,  think Field Service or Sales or Customer Service, etc..
  8. Plugin Development using this Client is NOT supported at this time. 

We have pushed the first version up to nuget,  its tagged as preview and I encourage you to read the release notes we provide with the nuget packages. As with most of our Nuget packages that are intended as tools or for developer consumption, we extensively comment in release notes. 

 

Samples and such will be updated overtime on the PowerApps Samples GitHub Site as we move forward with the evolution of this capability.   That said, any of the existing CrmServiceClient samples can be used as a base to start.

 

From a scenario point of view,  we are particularity interested in any issues or challenges when using these library in either Asp.net Core or Functions scenarios. 

 

Links for the packages:

https://www.nuget.org/packages/Microsoft.Powerplatform.Cds.Client

https://www.nuget.org/packages/Microsoft.Powerplatform.Cds.Client.Dynamics

https://www.nuget.org/packages/Microsoft.Dynamics.Sdk.Messages

 

for 99% of your applications working against Dynamics, you should only need Microsoft.Powerplatform.Cds.Client and Microsoft.Dynamics.Sdk.Messages.

if your working against CDS Only,  you should only need Microsoft.Powerplatform.Cds.Client.  If you do not experience that, or find missing messages in the CDS only scenarios, please let us know. 

 

Note: Please be aware that during the Alpha \ Beta phases, these nuget packages are not supported via official channels

Support is aware of them, however you will likely be directed back to the community forums for support during the Alpha \ Beta phases.  A number of our dev's and PM's do monitor this channel and can respond to questions and feedback. 

 

As we progress this process it is our intent to deprecate then retire the older Microsoft.Xrm.Tooling.* Packages and replace them with updates built on this new set of Nuget Packages. 

 

Thanks All, and we look forward to your feedback on this.

 

Update:  We have setup a github issues site to track issues for this effort: 

Update#2:  We have now begun posting the code for the CdsServiceClient on this git Hub repro for reference. 

Please find the site here: https://github.com/microsoft/PowerPlatform-CdsServiceClient 

 

MattB-MSFT.  

 

47 REPLIES 47
fberasategui
Frequent Visitor


@MattB-MSFT wrote:

 

Plugin Development using this Client is NOT supported at this time. 

Is this expected to be supported in the future?

 

Also, why are the new packages not .NET Standard-based? 

Shouldn't that enable them to be used for plugin development, as well as client scenarios? Meaning they would still continue to be executed on .NET Framework inside CDS, but also on .NET Core outside the platform.

 

ILMerge-ability is desired as well. I understand Microsoft does not support this, but in practice it is being used on production in a LOT of projects. I'm not sure if this would be affected 

 

On a side note: can we please switch to Github for these discussions? I understand there is a low/no-code side of the platform intended for people who might feel comfortable with this forum, but for us code breathers it really isn't. This is the third time I type this stuff here because my post was rejected due to some weird HTML stuff, and then I got these errors after trying to login.

 

And btw, are you ever planning to open source the SDKs? my reverse-engineered version of the plugin debugger integrated right into Visual Studio yearns to become legal so it can be shared with the wider community.

Thanks for your feedback,  and In answer to your questions:
( bit of a book here 😉 )
 
Why not .NET standard:
.NET Standard 2 is missing several methods from .NET framework 4.8 that our SDK requires. The .NET standard team is aware of this and is planning to address it in the future.  When they have support for it, we will provide a target for .NET standard.
 
Plugin/Sandbox in general:
There are a number of enhancements and changes in flight with the Plugin system currently.  Support for tech stack's other .NET Framework are being consider, but require substantial investment to bring to market and thus take time.   .NET Core is one of the tech stack's being looked at.
 
We are logically separating External Client development from Plugin development, and we wanted to bring the .NET core based clients tech to market as soon as we could make it viable.  Additionally, We are in working on splitting up the Namespaces, message names, and in some cases renamespacing sections of our platform away from the combined "crm" model to more closely match how we are building, servicing, and operating the system.  ( thus the Alpha tag on the current release train ). 
 
With regard to ILMerge: 
This comes up a lot and I will try to explain the reasoning here.
The reason ILMerge is used is one of the key reasons for several enhancements in our Plugin system currently in desgin.  ILMerge is unsupported, its unserviced and is technically unowned inside Microsoft.  It was a Microsoft research project that was never taken forward and those updates that have been done have been done by teams using it internally.  That it works as well as it does today is a nod to the programmers of the .net framework and the author of the ILMerge tool.   "We" cannot officially support it for use with our platform as the PowerPlatform team cannot take on the responsibility for bug fixing ILMerge itself, which would be the byproduct of PowerPlatform's Official support of it.  That said, we do not actively block the use of it in our platform because we know that its require for some scenarios currently.
 
With regard to OSS and GitHub:
It’s a fair ask,  the reason we didn’t do it at this time was that to take this discussion to GitHub would require us to have a Repro on GitHub with the source posted, we could do an empty repro that would not really do much more then this board.  To get to the code posted state requires us to setup an large amount of process and infrastructure to comply with our commitments around our SDL policies that we do not have time to do at this time.   That said we DO want to do it at some point in the future.  it really a matter of getting the aforementioned process and overhead support in place to make posting to git hub more useful than just having a non-compiling copy of the code post there that folks can comment on.
 
With regard to your comment about reversing the PRT and using part of it in another project:
I get the use cases for this, however to put this in our prospective: 
We OSS'ed our login code , several tools and the prt in CRM v5 and v6.  Because that code exists, we spend a lot of time on support cases where the primary reason is that someone took the v5 or v6 code and integrated it a custom tool set or project and sold or used that in a deployment, due to the changes we have made of the last 6 years or so the code stopped working and we are asked to solve it for them.  This is why we invested so heavily into Nuget Modules over the last 7 years or so to allow folks to just take an update to a nuget package to stay current, and we worked very hard to maintain backward compatibility in the client interface code ( CrmServiceClient and such ).  
Specifically with regard to the debugger of the PRT,  this is actually something we are discussing turning into its own Nuget package vs shipping with PRT as we do today.   Please send me a direct message with your use case, I would like to understand what your working on there and why you have made some decisions.  It could be we can share how to use the debugger.exe that is part of PRT natively with you and avoid you have to have forked the code.
 
Hope that helps clear up some of our decisions here.
MattB-MSF

 

Matt:

 

First of all thanks a lot for hearing me. I will try to address your thoughts with as much detail and as clearly as possible. This will probably get long too 😉

 

The Message types that are part of the client have been reduced to CDS Core server messages only.  Things like “QualifyLeadRequest” have been removed to their own Nuget package ( Microsoft.Dynamics.Sdk.Messages 

 

This is excellent. IMO a much wider separation needs to be drawn between the CDS platform and the Dynamics 365 product. I mean both in the documentation and in a practical sense such as this package separation. Keep doing more of this please.

As an example: I've been working for more than 4 years now in both existing and greenfield projects where the usage of Common Data Model entities (Opportunity, Lead, etc) and vanilla "Dynamics 365" functionality is practically ZERO and instead we have a lot of custom business functionality supported by custom industry-specific or client-specific data models and business processes. 

 

TL;DR: we're using CDS as a business application platform and don't care very much about CRM functionality and default entities. Keeping these aspects as separate as possible is a plus for us.

 

From a scenario point of view,  we are particularity interested in any issues or challenges when using these library in either Asp.net Core or Functions scenarios. 

 

I'll report back as soon as I get a proof of concept up and running on Azure Functions V3 on .NET Core using the new CDS Nugets. At this time we're stuck on Azure functions V1 precisely due to the need to target .NET Framework and use Microsoft.Xrm.Sdk.dll

 

There are a number of enhancements and changes in flight with the Plugin system currently

 

It would be awesome if you could communicate the general technical roadmap and would be willing to discuss it with the community. This is a philosophical matter, and might be a big change, but a lot (most?) of the Microsoft dev stack has converted in recent years to a workflow where the will make their roadmap public and are willing to discuss it with the larger community (think how the C# language team went from the Anders/Mads era of "benevolent dictatorship" to the current Github-all-the-things approach). As a developer who invested a decade exclusively in the MS stack, this is tremendously valuable.

 

Support for tech stack's other .NET Framework are being consider

 

I imagine this has to do with getting plugins out-of-process in the form of Azure Functions or something similar? If so, keep in mind it is important to maintain existing functionality (synchronous, single transaction, friendly business error messages for the end user, and so on)

 

To be fair though, this might make sense for greenfield projects, but there's no way existing projects with heavy business logic will migrate to a non-C# tech stack. For instance it makes no sense for me to write a CDS plugin in javascript, but that's mainly because I hate js and dynamic languages in general.

 

NET Core is one of the tech stack's being looked at

 

.NET Core, on the other hand, makes a lot of sense as a target platform for both client and in-process (plugins) CDS code, because it enables us to design application architectures where Model classes and Business Logic is shared among these, and I no longer care about whether my business logic executes in a plugin, or inside an azure function, as long as I have a valid IOrganizationService instance to work with.

 

For instance: I have this abstraction which makes it pretty much transparent for application code whether it's running in an Azure Function or inside a regular plugin.

 

We are logically separating External Client development from Plugin development

 

Please consider that it is very important to maintain the current compatibility level. I don't want to have to differentiate plugin code for business logic from other business logic that executes elsewhere. The entity model is the same, the IOrganizationService interface is the same, and whatever abstractions I write on it are the same. As an aside, the LINQ provider is of critical importance too and it is critical that it will continue to work in all currently supported scenarios.

 

I will PM you a solution diagram to illustrate our current preferred architecture for CDS based applications.

 

With regard to ILMerge

 

I understand and agree with everything you've said about this subject. If the platform enables me a different, supported way to reference my own assemblies/Nuget packages inside plugins I will gladly get rid of ILMerge too ;). When we have 30+ plugins in a single VS Solution each build/rebuild becomes slow because it has to ILMerge 3 or 4 assemblies into each one of the 30+ plugins 😞

 

Again, thanks for taking the time to read my post, I greatly appreciate that.
I will email you about the debugger and with additional details of the designs and tools I've come up with during these years working on XRM/CDS.

 

btw, you guys rock so much. Keep going.

 

 

 

 

Regarding Plugins:

we do not have much to say specific feature wise on this right now aside from "there is a good deal of work going on". When we get closer to knowing what lands and when, we will start talking about it publicly 🙂

 

Regarding non .net plugins types…

You would be surprised the number of requests we get to support non .net languages 😊 Non-net plugins will necessarily have a different method of interaction.

 

With regard to compatibility with the .net framework in the alpha, The current alpha is fully compatible with all the features of the full framework system, including Linq,

 

MattB-msft

Amazing news that we finally have .net core support!!

Will we see async/await being added for organizationrequests? Azure Functions, for instance, are billed by cpu time, memory usage etc... Would be great to not have to take cpu time while waiting for the response.
Toftager
New Member

Great stuff, have many customers asking for .Core compatibility, so looking forward to this becoming a non beta. Will start looking into this right away. 

 

What is the outlook of this running on a on-premise installation? Specifically one running AD Auth. I believe this would work with claims, but could not get it working with AD auth. 

@Toftager  From memory (it's a while since I've done it) Certificates work better than shared secrets in the AD world.

Have you followed all the steps in https://docs.microsoft.com/en-us/dynamics365/customerengagement/on-premises/deploy/configure-the-dyn...  as it's possible you may be missing a step out.

---
If this post has answered your question please consider it for "Accept as Solution" or if it has been helpful give it a "Thumbs Up".

Plugins are based on WCF Message Pipeline, are CDS re-engineering away from WCF on the server side in order to be reborn into the Cloud?

AhmadAnwar
Frequent Visitor

Any love for F#?
Currently, the plugin system doesn't recognize FSharp.Core.

It would be great to register plugin written in F#.

Helpful resources

Announcements

Exclusive LIVE Community Event: Power Apps Copilot Coffee Chat with Copilot Studio Product Team

  It's time for the SECOND Power Apps Copilot Coffee Chat featuring the Copilot Studio product team, which will be held LIVE on April 3, 2024 at 9:30 AM Pacific Daylight Time (PDT).     This is an incredible opportunity to connect with members of the Copilot Studio product team and ask them anything about Copilot Studio. We'll share our special guests with you shortly--but we want to encourage to mark your calendars now because you will not want to miss the conversation.   This live event will give you the unique opportunity to learn more about Copilot Studio plans, where we’ll focus, and get insight into upcoming features. We’re looking forward to hearing from the community, so bring your questions!   TO GET ACCESS TO THIS EXCLUSIVE AMA: Kudo this post to reserve your spot! Reserve your spot now by kudoing this post.  Reservations will be prioritized on when your kudo for the post comes through, so don't wait! Click that "kudo button" today.   Invitations will be sent on April 2nd.Users posting Kudos after April 2nd. at 9AM PDT may not receive an invitation but will be able to view the session online after conclusion of the event. Give your "kudo" today and mark your calendars for April 3rd, 2024 at 9:30 AM PDT and join us for an engaging and informative session!

Tuesday Tip: Unlocking Community Achievements and Earning Badges

TUESDAY TIPS are our way of communicating helpful things we've learned or shared that have helped members of the Community. Whether you're just getting started or you're a seasoned pro, Tuesday Tips will help you know where to go, what to look for, and navigate your way through the ever-growing--and ever-changing--world of the Power Platform Community! We cover basics about the Community, provide a few "insider tips" to make your experience even better, and share best practices gleaned from our most active community members and Super Users.   With so many new Community members joining us each week, we'll also review a few of our "best practices" so you know just "how" the Community works, so make sure to watch the News & Announcements each week for the latest and greatest Tuesday Tips!     THIS WEEK'S TIP: Unlocking Achievements and Earning BadgesAcross the Communities, you'll see badges on users profile that recognize and reward their engagement and contributions. These badges each signify a different achievement--and all of those achievements are available to any Community member! If you're a seasoned pro or just getting started, you too can earn badges for the great work you do. Check out some details on Community badges below--and find out more in the detailed link at the end of the article!       A Diverse Range of Badges to Collect The badges you can earn in the Community cover a wide array of activities, including: Kudos Received: Acknowledges the number of times a user’s post has been appreciated with a “Kudo.”Kudos Given: Highlights the user’s generosity in recognizing others’ contributions.Topics Created: Tracks the number of discussions initiated by a user.Solutions Provided: Celebrates the instances where a user’s response is marked as the correct solution.Reply: Counts the number of times a user has engaged with community discussions.Blog Contributor: Honors those who contribute valuable content and are invited to write for the community blog.       A Community Evolving Together Badges are not only a great way to recognize outstanding contributions of our amazing Community members--they are also a way to continue fostering a collaborative and supportive environment. As you continue to share your knowledge and assist each other these badges serve as a visual representation of your valuable contributions.   Find out more about badges in these Community Support pages in each Community: All About Community Badges - Power Apps CommunityAll About Community Badges - Power Automate CommunityAll About Community Badges - Copilot Studio CommunityAll About Community Badges - Power Pages Community

Tuesday Tips: Powering Up Your Community Profile

TUESDAY TIPS are our way of communicating helpful things we've learned or shared that have helped members of the Community. Whether you're just getting started or you're a seasoned pro, Tuesday Tips will help you know where to go, what to look for, and navigate your way through the ever-growing--and ever-changing--world of the Power Platform Community! We cover basics about the Community, provide a few "insider tips" to make your experience even better, and share best practices gleaned from our most active community members and Super Users.   With so many new Community members joining us each week, we'll also review a few of our "best practices" so you know just "how" the Community works, so make sure to watch the News & Announcements each week for the latest and greatest Tuesday Tips!   This Week's Tip: Power Up Your Profile!  🚀 It's where every Community member gets their start, and it's essential that you keep it updated! Your Community User Profile is how you're able to get messages, post solutions, ask questions--and as you rank up, it's where your badges will appear and how you'll be known when you start blogging in the Community Blog. Your Community User Profile is how the Community knows you--so it's essential that it works the way you need it to! From changing your username to updating contact information, this Knowledge Base Article is your best resource for powering up your profile.     Password Puzzles? No Problem! Find out how to sync your Azure AD password with your community account, ensuring a seamless sign-in. No separate passwords to remember! Job Jumps & Email Swaps Changed jobs? Got a new email? Fear not! You'll find out how to link your shiny new email to your existing community account, keeping your contributions and connections intact. Username Uncertainties Unraveled Picking the perfect username is crucial--and sometimes the original choice you signed up with doesn't fit as well as you may have thought. There's a quick way to request an update here--but remember, your username is your community identity, so choose wisely. "Need Admin Approval" Warning Window? If you see this error message while using the community, don't worry. A simple process will help you get where you need to go. If you still need assistance, find out how to contact your Community Support team. Whatever you're looking for, when it comes to your profile, the Community Account Support Knowledge Base article is your treasure trove of tips as you navigate the nuances of your Community Profile. It’s the ultimate resource for keeping your digital identity in tip-top shape while engaging with the Power Platform Community. So, dive in and power up your profile today!  💪🚀   Community Account Support | Power Apps Community Account Support | Power AutomateCommunity Account Support | Copilot Studio  Community Account Support | Power Pages

Super User of the Month | Chris Piasecki

In our 2nd installment of this new ongoing feature in the Community, we're thrilled to announce that Chris Piasecki is our Super User of the Month for March 2024. If you've been in the Community for a while, we're sure you've seen a comment or marked one of Chris' helpful tips as a solution--he's been a Super User for SEVEN consecutive seasons!       Since authoring his first reply in April 2020 to his most recent achievement organizing the Canadian Power Platform Summit this month, Chris has helped countless Community members with his insights and expertise. In addition to being a Super User, Chris is also a User Group leader, Microsoft MVP, and a featured speaker at the Microsoft Power Platform Conference. His contributions to the new SUIT program, along with his joyous personality and willingness to jump in and help so many members has made Chris a fixture in the Power Platform Community.   When Chris isn't authoring solutions or organizing events, he's actively leading Piasecki Consulting, specializing in solution architecture, integration, DevOps, and more--helping clients discover how to strategize and implement Microsoft's technology platforms. We are grateful for Chris' insightful help in the Community and look forward to even more amazing milestones as he continues to assist so many with his great tips, solutions--always with a smile and a great sense of humor.You can find Chris in the Community and on LinkedIn. Thanks for being such a SUPER user, Chris! 💪🌠

Tuesday Tips: Community Ranks and YOU

TUESDAY TIPS are our way of communicating helpful things we've learned or shared that have helped members of the Community. Whether you're just getting started or you're a seasoned pro, Tuesday Tips will help you know where to go, what to look for, and navigate your way through the ever-growing--and ever-changing--world of the Power Platform Community! We cover basics about the Community, provide a few "insider tips" to make your experience even better, and share best practices gleaned from our most active community members and Super Users.   With so many new Community members joining us each week, we'll also review a few of our "best practices" so you know just "how" the Community works, so make sure to watch the News & Announcements each week for the latest and greatest Tuesday Tips!This Week: Community Ranks--Moving from "Member" to "Community Champion"   Have you ever wondered how your fellow community members ascend the ranks within our community? What sets apart an Advocate from a Helper, or a Solution Sage from a Community Champion? In today’s #TuesdayTip, we’re unveiling the secrets and sharing tips to help YOU elevate your ranking—and why it matters to our vibrant communities. Community ranks serve as a window into a member’s role and activity. They celebrate your accomplishments and reveal whether someone has been actively contributing and assisting others. For instance, a Super User is someone who has been exceptionally helpful and engaged. Some ranks even come with special permissions, especially those related to community management. As you actively participate—whether by creating new topics, providing solutions, or earning kudos—your rank can climb. Each time you achieve a new rank, you’ll receive an email notification. Look out for the icon and rank name displayed next to your username—it’s a badge of honor! Fun fact: Your Community Engagement Team keeps an eye on these ranks, recognizing the most passionate and active community members. So shine brightly with valuable content, and you might just earn well-deserved recognition! Where can you see someone’s rank? When viewing a post, you’ll find a member’s rank to the left of their name.Click on a username to explore their profile, where their rank is prominently displayed. What about the ranks themselves? New members start as New Members, progressing to Regular Visitors, and then Frequent Visitors.Beyond that, we have a categorized system: Kudo Ranks: Earned through kudos (teal icons).Post Ranks: Based on your posts (purple icons).Solution Ranks: Reflecting your solutions (green icons).Combo Ranks: These orange icons combine kudos, solutions, and posts. The top ranks have unique names, making your journey even more exciting! So dive in, collect those kudos, share solutions, and let’s see how high you can rank! 🌟 🚀   Check out the Using the Community boards in each of the communities for more helpful information!  Power Apps, Power Automate, Copilot Studio & Power Pages

Find Out What Makes Super Users So Super

We know many of you visit the Power Platform Communities to ask questions and receive answers. But do you know that many of our best answers and solutions come from Community members who are super active, helping anyone who needs a little help getting unstuck with Business Applications products? We call these dedicated Community members Super Users because they are the real heroes in the Community, willing to jump in whenever they can to help! Maybe you've encountered them yourself and they've solved some of your biggest questions. Have you ever wondered, "Why?"We interviewed several of our Super Users to understand what drives them to help in the Community--and discover the difference it has made in their lives as well! Take a look in our gallery today: What Motivates a Super User? - Power Platform Community (microsoft.com)

Top Solution Authors
Users online (4,823)