Filter Query by date field

[nvpc]

I need to filter date data being imported from excel using the "Filter Query" see below:

the 1st circled is the query, I need to filter data that is 18 month and newer from todays date; 

 'Assigned Date' eq dateDifference(utcNow(),18)

the 2nd circled is that the 'DateTime Format' has to be Serial Format as I have too many working flows where I'm having to convert using the following formula:

if(empty('Assigned Date'),

null,

addSeconds('1899-12-30',int(formatNumber(mul(float('Initial Assigned Date'),86400),'0','en-us')),'MM-dd-yyyy')

)

[Nived_Nambiar]

i could not understand what is ur question here?

Could you explain it properly?

[nvpc]

Hi Nived,

The question: I need to filter data being imported; I want to use the "Filter Query" and pass ODATA filter query. The field I need to use is 'Assigned Date', I need 12 months of data from today's date. if today is 3/14/2023 then I would need data from 3/14/2022 to 3/14/2023. ex. 'Assigned Date' >= 3/14/2022.

Thanks in advance.

nv

[grantjenkins]

With List rows present in a table you can't use fieldnames that have spaces within the Filter Query. So, you would need to return all rows, then use a Filter array to filter out the data you want.

I would still suggest setting the DateTime Format to ISO 8601 to return dates in ISO format rather than Serial. If Dates are blank, then you need to cater for this regardless of format.

See full flow below. I'll go into each of the actions.

List rows present in a table using ISO 8601.

Filter array would use the following expression to return items that are less than 18 months old and exclude any items where the date is empty.

@And(
    not(equals(item()?['Assigned Date'], '')),
    greaterOrEquals(item()?['Assigned Date'], addToTime(utcNow(), -18, 'Month'))
)

----------------------------------------------------------------------
If I've answered your question, please mark the post as Solved.
If you like my response, please consider giving it a Thumbs Up.

[nvpc]

Thank you Grant,

That worked! I will use this in the future. However; as I mentioned before I have too many flows to convert to ISO 8601 and had experienced issues converting dates that is the reason I used the code below on my date fields and it works fine.

if(empty('Initial Assigned Date'),
null,
addSeconds('1899-12-30',int(formatNumber(mul(float('Assigned Date'),86400),'0','en-us')),'MM-dd-yyyy')
)

[nvpc]

I have gotten closer by using Filter array:

Again, I have to use 'Serial Number' for DateTime Format, so the date fields are coming in as serial number format for example "Initial Assigned Date": "44818.7389351852". the first parameter is expecting an ISO date format, see circled area below.

if I hard coded it works fine, example:

add(div(sub(ticks('2021-09-30T00:00:00Z'),ticks('1900-01-01T00:00:00Z')),864000000000),1),

I need to convert this serial number: "44818.7389351852" into this format 'yyyy-MM-ddThh:mm:ssZ'

I've tried using the the following but get invalid "Float" error.

addSeconds('1899-12-30', int(formatNumber(mul(float('Initial Assigned Date'), 864000000000), '0', 'en-us')), 'yyyy-MM-ddThh:mm:ssZ'))

I also tried using the following but get, template language function 'mul' expects its first parameter to be an integer or a decimal number. 

int(formatNumber(mul('Initial Assigned Date', 86400), '0', 'en-us')), 'yyyy-MM-ddThh:mm:ssZ'))

[grantjenkins]

Can you try the following:

addSeconds('1899-12-30', int(formatNumber(mul(float(item()?['Initial Assigned Date']), 864000000000), '0', 'en-us')), 'yyyy-MM-ddThh:mm:ssZ'))

[nvpc]

Getting the following error:

The execution of template action 'Filter_array' failed: The evaluation of 'query' action 'where' expression '@greaterOrEquals(addSeconds('1899-12-30', int(formatNumber(mul(float(item()?['Initial Assigned Date']), 864000000000), '0', 'en-us')), 'yyyy-MM-ddThh:mm:ssZ'), add(div(sub(ticks(addToTime(utcNow(), -18, 'Month')), ticks('1900-01-01T00:00:00Z')), 864000000000), 1))' failed: 'Value to add was out of range.
Parameter name: value'.

[nvpc]

I have successfully managed to run the flow hard coding the serial number see below;

@greaterOrEquals(int(formatNumber(float(split('44818.0000000', '"')[0]), '0', 'en-us')), add(div(sub(ticks(addToTime(utcNow(), -18, 'Month')), ticks('1900-01-01T00:00:00Z')), 864000000000), 1))

But when i try using the item()?['Initial Assigned Date'] I get an error, see below;

The execution of template action 'Filter_array' failed: The evaluation of 'query' action 'where' expression '@greaterOrEquals(int(formatNumber(float(split(item()?['Initial Assigned Date'], '"')[0]), '0', 'en-us')), add(div(sub(ticks(addToTime(utcNow(), -18, 'Month')), ticks('1900-01-01T00:00:00Z')), 864000000000), 1))' failed: 'The template language function 'float' was invoked with a parameter that is not valid. The value cannot be converted to the target type.'.

[Pstork1]

If you are going to use the value from the List Rows in a Table in a Filter Array with your formula you need to have the advanced setting in the action set to Serial, not ISO 8601.  You are trying to filter using an ISO 8601 string value as a Serial date.  That's why you are getting an error on the query.

[nvpc]

Thank you for your response! I do not have datetime format set to ISO 8601, grantjenkins had suggested using that setting but as I explained at the beginning of the post that I have too many flows using Serial Number setting already. So, I do have datetime format set to Serial Number.

[Pstork1]

Then I would use a Compose to start from the inside and work out to see exactly what values you are working with.  I would start with this to make sure it can be cast to a floating point number

split(item()?['Initial Assigned Date'], '"')[0])

[nvpc]

Thanks for your reply, I did try the code above that you provided but I believe it has an extra [0]) so I tried without it. 

split(item()?['Initial Assigned Date'], '"')

but got the following error:

The execution of template action 'Filter_array' failed: The evaluation of 'query' action 'where' expression '@greaterOrEquals(split(item()?['Initial Assigned Date'], '"'), split(item()?['Initial Assigned Date'], '"'))' failed: 'The template language function 'greaterOrEquals' expects all of its parameters to be either integer or decimal numbers. Found invalid parameter types: 'Array'.'.

As per your suggestion starting from the inside; when I run the code I can see the raw input as coming across as "44818.7389351852" see below;

so if the code you provided removes the "" then it leaves it as 44818.738935 now to convert this to an integer or a float but this the code to do this is not working, see below

int(formatNumber(float(split(item()?['Initial Assigned Date'], '"')[0]), '0', 'en-us'))

however; if I hard coded see below, it works.

int(formatNumber(float(split('44818.7389351852', '"')[0]), '0', 'en-us'))

[Pstork1]

The [0] isn't extra.  That is what gives you the first entry in the array instead of the array.  What appears to be missing is the field name that contains the value you want to format.