cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Rjcarpen
Frequent Visitor

Parsing and re-structuring data table

I have a SQL sourced dataset with the following format that needs to be parced, re-structured, and have duplicates removed.  I don't have access to change the SQL server, and I would prefer to keep this in PowerApps instead of setting up a flow.

 

Problem: "Heat No": output is being stored as a column of tables instead of a column of values.  This is also getting pretty messy and I keep wondering if there is a more elegent way (such as ForAll?) to do this transformation.


Incoming Format:

DescriptionPlannerJob
** HEAT NUMBER 1235 **A3 
** HEAT NUMBER 1236 ** CCP **B5 
** HEAT NUMBER 1237 **B7 
** HEAT NUMBER 1237 **B9 

 

Target Format:

Heat NumberPlanner
1235A
1236B
1237B

 

Current Code:

//Copy SQL to buffer
ClearCollect(DataImport_JobListBuffer,'[MFGHEAT].[WIPDATA]');  //Tried to filter this directly without success.  Seems you need to buffer data in

//Filter buffer
ClearCollect(DataImport_HeatList,Filter(DataImport_JobListBuffer,'A$Organization_Code'="NWT",ITEM_PLANNER_CODE<>"NWT3"));

//Parse out heat number
ClearCollect(DataImport_HeatList2,Substitute(DataImport_HeatList.Description,"**HEAT NUMBER",""));
ClearCollect(DataImport_HeatList2,Substitute(DataImport_HeatList2.Description,"**CPP**",""));
ClearCollect(DataImport_HeatList2,Substitute(DataImport_HeatList2.Description,"**CRP**",""));
ClearCollect(DataImport_HeatList2,Substitute(DataImport_HeatList2.Description,"**",""));

//Add columns back in
ClearCollect(DataImport_HeatList3,AddColumns(DataImport_HeatList,"Heat No",DataImport_HeatList2.Description));

//Remove duplicates
//ClearCollect(DataImport_HeatList4,Distinct(DataImport_HeatList3,Heat No));
1 ACCEPTED SOLUTION

Accepted Solutions
hnguy71
Helper V
Helper V

I did a quick test on my side and here's what I came up with:

 

ClearCollect(
    DataImport_JobListBuffer,
    '[MFGHEAT].[WIPDATA]'
);
Distinct(
    ClearCollect(
        _DataImport_HeatList,
        AddColumns(
            Filter(
                DataImport_JobListBuffer,
                'A$Organization_Code' = "NWT",
                ITEM_PLANNER_CODE <> "NWT3"
            ),
            "Heat Number",
            Concat(
                Filter(
                    Split(
                        Description,
                        ""
                    ),
                    IsMatch(
                        Result,
                        "^[0-9]*"
                    )
                ),
                Result
            )
        )
    ),
    'Heat Number'
)


which gave me this:
remove letters and special.png

View solution in original post

4 REPLIES 4
hnguy71
Helper V
Helper V

I did a quick test on my side and here's what I came up with:

 

ClearCollect(
    DataImport_JobListBuffer,
    '[MFGHEAT].[WIPDATA]'
);
Distinct(
    ClearCollect(
        _DataImport_HeatList,
        AddColumns(
            Filter(
                DataImport_JobListBuffer,
                'A$Organization_Code' = "NWT",
                ITEM_PLANNER_CODE <> "NWT3"
            ),
            "Heat Number",
            Concat(
                Filter(
                    Split(
                        Description,
                        ""
                    ),
                    IsMatch(
                        Result,
                        "^[0-9]*"
                    )
                ),
                Result
            )
        )
    ),
    'Heat Number'
)


which gave me this:
remove letters and special.png

View solution in original post

RandyHayes
Super User
Super User

@Rjcarpen 

In addition to @hnguy71 's suggestion, you can also look at applying GroupBy to achieve these same results.

 

I'm not entirely sure from your sample data if the Planner is unique as well. In other words - if there was a ** HEAT NUMBER 1237 ** with Planner A possibility or not.

So, if the above is not true, then you can consider this formula for your testing (I assume you want this in a collection for some reason, so I will construct with one):

ClearCollect(HeatList, 
   DropColumns(
      GroupBy(
            AddColumns(
                Filter('[MFGHEAT].[WIPDATA]', 
                         'A$Organization_Code' = "NWT" &&
                         ITEM_PLANNER_CODE <> "NWT3"
                        ),
                "HeatNumber",  Match(Description, MultipleDigits).FullMatch
                ),
       "HeatNumber",
       "Planner",
       "Records"
       ),
   "Records"
   )
)

Based on your supplied data, this produces a collection called HeatList with three records -

HeatNumber    Planner

    1235                 A

    1236                 B

    1237                 B

 

I hope that is clear and helpful for you.

 

_____________________________________________________________________________________
Digging it? - Click on the Thumbs Up below. Solved your problem? - Click on Accept as Solution below. Others seeking the same answers will be happy you did.
Check out my PowerApps Videos too! And, follow me on Twitter @RandyHayes

Really want to show your appreciation? Buy Me A Cup Of Coffee!

Thanks @RandyHayes , this worked well too and is a pretty elegent solution.  I am going to have to find a way to manipulate my downstream app to move in this direction.

Rjcarpen
Frequent Visitor

Thanks @hnguy71 , this worked well and gets me going!

Helpful resources

Announcements
UG GA Amplification 768x460.png

Launching new user group features

Learn how to create your own user groups today!

Community Connections 768x460.jpg

Community & How To Videos

Check out the new Power Platform Community Connections gallery!

M365 768x460.jpg

Microsoft 365 Collaboration Conference | December 7–9, 2021

Join us, in-person, December 7–9 in Las Vegas, for the largest gathering of the Microsoft community in the world.

Top Solution Authors
Top Kudoed Authors
Users online (1,240)