Detail Step-By-Step - Power Platform ALM with Azure DevOps

[suparna-banerje]

Introduction

• Azure DevOps Repositories can be used as Source Control for Power Platform Solutions
• CI/CD can be implemented using Azure DevOps Pipelines
• We can use Microsoft Power Platform Build Tools to automate common build and deployment tasks related to apps built on Microsoft Power Platform . There are 2 versions of Build tools – older based on PowerShell and latest version based on Power Platform CLI

Power Platform ALM with Azure DevOps Process Flow

To implement CI/CD process with Azure DevOps Pipelines, we can store the Power Platform solution in the source control. There are two main Paths –

1. Export the unmanaged solution and place it as unpacked in the source control system. The build process imports the packed solution as unmanaged into a temporary build environment , then export the solution as managed and store it as a build artifact in your source control system.
2. Export the solution as unmanaged and also export the solution as managed, and place both in the source control system.

Fig 1

In this article, we will show the steps to achieve the Option above 2 above, and Fig 1 depicts the process.

 

1.Setup source and Target environment

Create source and target environments. Both should have Dataverse database enabled. Create an unmanaged Solution in the source environment

2.Set up Azure DevOps

1. Create Azure Dev Ops Organization
2. Create the Project within it
3. Create the Repository to hold the source code
4. Install Microsoft Power Platform Build Tools into your Azure DevOps organization from Azure Marketpl...
5. Request parallelism if using Azure DevOps pipelines for first time using the link https://aka.ms/azpipelines-parallelism-request.
6. Within the Project, navigate to Project Settings> Repositories>Security Tab. Under user Permissions, make sure that for Project Collection Service Accounts under Azure DevOps Groups and <ProjectName> Build Service <OrgName> under users Contribute Permission is set to allow

3a. Create Azure DevOps Pipelines with Application ID and Client Secret

Create Azure AD App Registration

1. Go to https://portal.azure.com
2. Search for App Registration, click New Registration
3. Provide the name, keep other fields with default value and click Register
4. Once the App is created, go to API Permissions, click Add a Permission>Select Dynamics CRM>Add Permission >Grant Admin Consent for <tenant>
5. Go to Overview>Client credentials>New Secret. Copy the value into a notepad as this will be needed later and you won’t be able to get it once navigate away from this page.
6.  Come back to overview, and copy the Application (client) ID and Directory (tenant) ID in the same notepad. You will need these 3 values while creating service connection

Add the service principal as App user into Power Platform source and destination environment.

1. Go to Power Platform Admin Center>Environments
2. Select your Source Environment
3. From right navigation, Users >See All>App users list
4. Click New App user>search for the App created in Previous step>Add it and provide System Customizer or System Administrator role.
5. Repeat all the steps above for the destination environment

Create Service Connection with Application ID and Client Secret

1. Go to your Azure DevOps Project, click Project Settings.
2. Under Pipelines, click Service Connections >New Service Connection>Select Power Platform
3. Select Authentication method as Application ID and client secret
4. Go to make.powerapps.com> Select your Source environment >Go to Settings>Session details>copy the Instance url and paste it under Server Url
5. Paste Tenant Id, Application Id and Client Secret as saved earlier
6. Save the Service Connection with the name “Dev Service Principal”
7. Follow the steps ii to vi above , this time get the destination environment url, create the service connection and save as “Prod Service Principal”

Create Pipeline – Export from Source

i.  From the left navigation within the Project, click on Pipelines >New Pipeline>Use the Classic Editor

ii.  Select the Source as Azure Repos Git, select your Project, Repository and Branch and click continue

iii.  Under select template, start with Empty job

iv.  Click Agent Job 1 and make sure Allow Scripts to access OAuth token is checked

v.  Add the task Power Platform Tool Installer with task version 2

vi.  Add the task Power Platform Export Solution. We are adding the task to export the solution as unmanaged here

For Service Connection, Select Service Principal> Select Dev Service Principal from Dropdown

Provide your Solution Name (not the display name)

Solution output file name $(Build.ArtifactStagingDirectory)\<SolutionName>.zip

Uncheck export as Managed Solutin

vii.  Copy the above task . This time we are exporting managed solution. Keep all settings same, only check the box Export as Managed solution and the Solution Output file name to $(Build.ArtifactStagingDirectory)\<SolutionName>_managed.zip

viii.  Add the task Power Platform Unpack Solution

Solution Input File -$(Build.ArtifactStagingDirectory)\<SolutionName>.zip

Target Folder to Unpack Solution - $(Build.SourcesDirectory)\<SolutionName>

Type of Solution – Both

ix.  Add a task Command Line script, and paste the below script

echo commit all changes

git config user.email “<email>”

git config user.name "<user name>"

git checkout -B main

git add --all

git commit -m "code commit"

git push --set-upstream origin main

x.  Save and queue the Pipeline and wait it to be finished

xi.  Check the repository for the unpacked source code

Create Deployment Settings File

1. Open Visual Studio Code
2. Install PAC CLI
3. Run the below command to export the solution in your local machine

pac solution export --name <solutionname> --path .\ --managed false

     iv.  Run below command to create Deployment Settings file

pac solution create-settings --solution-zip .\<SolutionName>.zip --settings-file <SolutionName>.json

    v.  Update values in the Deployment Settings file for the target environment

    vi.  In the Repository, create a Folder named Settings, create a file <SolutionName>.json within it, copy the text from the Deployment Settings File

Create Build Pipeline

1.             Create a new Pipeline with Classic Editor>Empty Job
2.             Add the task Power Platform Tool Installer
3.             Add a task Power Platform Pack Solution

Source Folder of Solution to Pack -Select Folder by clicking 3 dots

Solution Output File -<SolutionName>.zip

Type of Solution -Both

  iv.     Add a task -Copy Files

Source Folder -Settings

Contents -**

Target Folder - $(Build.ArtifactStagingDirectory)

  v.   Add a task Publish Artifact

Path to publish - $(Build.ArtifactStagingDirectory)

Artifact Name – drop

  vi.   Save and Queue the Build Pipeline

Create Release Pipeline

1.             From Left navigation, click Releases >New Release Pipeline >Start with Empty Job
2.             Add the Artifact created in the Build pipeline

Select your project and build pipeline

Source alias -drop

1.             Under Stages>Stage 1>Click Job
2.             Add the task Power Platform Tool installer
3.             Add the task Power Platform Import Solution

      iv.   Service Connection – Select the service connection you created for Prod.

       v.   Solution Input File – Select clicking 3 dots, select the managed zip file for Prod

      vi.   Check Use Deployment Settings File and select the Deployment settings file by clicking 3 dots.

      vii.  For Prod, under Advanced, check Import Managed Solution

       viii.  Save the pipeline and create a Release

       ix.  Check the Solution has been deployed properly to Production

3b. Create Azure DevOps Pipelines with Managed Identity

1. Create VMScaleSet and assign Managed Identity
2. Create Self hosted Agent pool and point to the VMscale set
3. Add the managed identity as App user into Power Platform source and destination environment.
4. Create Service Connection with managed identity.
5. Create Build Pipelines- Export from Source and Build Solution. Create Release Pipeline – Deploy to Destination . Use previously created self-hosted agent pool.

Please follow this Blog for detail steps .

[sxm0275]

Hi Suparna,

Great article. We are trying to set up DevOps process for the power platform in our Agency. We are using our on-prem Azure DevOps server. I was able to export the solution from our dev power apps environment and create a build. But when trying to deploy the build artifact to the test environment I am getting the error below.

Error: RetrievePrivilegeForUser: The user with id {GUID} has not been assigned any roles. They need a role with the prvReadAsyncOperation privilege.

We do not see any user with the id {GUID} in our AAD. Not sure how to resolve this issue. Any help or suggestion will be appreciated. 

Thank you,

Subodh

[angaravlgs]

I could export the solution to target environment, but not able to play the app. It's happening only when I'm exporting solution through Pipelines and working well when exporting manually. Please look into this issue.

[suparna-banerje]

@sxm0275  Did you add the Service Principal as an App user to the destination environment with at least System Customizer role? Please go to portal.azure.com>App Registrations and and search for the Service Principal you created for this pipeline, and check that it's Application(Client) ID is matching the Guid that is shown in the error.

[suparna-banerje]

@angaravlgs When you export the App using pipelines with a Service Principal, the Service Principal (App user) becomes the owner of the App, any other user will get access denied as it's not shared with them. You need to login as an Admin and share the App with any user, including the Admin . When you are importing manually, the App owner is the user who is importing, so he/she can access the App.

[sxm0275]

@suparna-banerje The service principle was missing sys admin/customizer role in destination. Adding the roles got it working. Thank you. 

[Kavya1]

Hi @suparna-banerje 

Your method worked and pipeline went through without any errors. However, in target environment, I could see the connection established from deployment settings file. I had to manually edit the app and configure the connection. Is there anything I am missing?

[onewabash]

This is giving us issues between the unmanaged and managed environment. I am able to package, export, import and deploy but it is not behaving the same way in both environments which is beyond frustrating when trying to move your application through the ALM and out to production.

Also, the Dataflows are not easily migrated and the connections between services that are dev/test/prod are not easily switched. It makes for further headaches when it should be seamless.

[suparna-banerje]

@onewabash Can you please provide more details on what is behaving differently in 2 environments and any other specific issue you are facing?

[suparna-banerje]

@Kavya1 Are you having this issue for all connections or for some connections also? If for some, can you please let me know which connections are having this problem?

[Kavya1]

@suparna-banerje I tried for SQL connection and got to know there is no option to create an environment variable for SQL database. 

[onewabash]

@suparna-banerje It seems that the issue is around the Navigate variables that are being created between screens. The lead product engineer shows in the development environment, but not in test. It is being looked up using a nested gallery (a gallery within a gallery item). So it looks up the order information in a gallery and then brings in the lead product engineer information in a nested gallery within that gallery. Going to try and make it a global variable with the Set command and see if that fixes the issue.

[oml]

Thanks a lot for the post, @suparna-banerje .

However, I have a question: How do I handle plugin assemblies when packing my solution?

When I unpack the .dll files will be exported as ".dll.data.xml" which will not work when using the "Pack Solution" task.

I understand I must somehow "map" the .dll file using this option in the Pack Solution task. But how is this done? Do I need to pack both the solution and the plugin component separately and use the "Add Solution Component" afterward for the plugin part?

Currently my "Pack Solution" task is failing because it is trying to find the .dll file for my plugin, but the repository only contains the ".dll.data.xml" exported from the "Unpack Solution" task.

So my question is, how do I map this .dll file correctly so my "Pack Solution" task works? 🙂

Unfortunately, the documentation I have found isn't really helping me understand this step.

 

Cheers