topic Re: Need to remove prefix from json array. in Getting Data In

Need to remove prefix from json array.

vin02ptl — Fri, 15 May 2020 10:10:04 GMT

Need to remove prefix from json array. I want to remove everything before {"id"

{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#auditLogs/directoryAudits","value":[{"id"

Re: Need to remove prefix from json array.

gcusello — Fri, 15 May 2020 10:16:12 GMT

Hi @vin02ptl,
please, could you share an example of your logs?
Anyway, I solved this problem with this regex:

| rex "[^\{]*(?<all>.*)"

Ciao.
Giuseppe

Re: Need to remove prefix from json array.

vin02ptl — Fri, 15 May 2020 10:25:13 GMT

how to write in props.conf

{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#auditLogs/directoryAudits","value":[]}
{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#auditLogs/directoryAudits","value":[]}
{"@odata.context":"https://graph.microsoft.com/v1.0/$metadata#auditLogs/directoryAudits","value":[{"id":"B2Cxx","category":"xxx","correlationId":xxx,"activityDateTime":"xxx"....},{"id":"B2Cxx","category":"xxx","correlationId":xxx,"activityDateTime":"xxx"....},{"id":"B2Cxx","category":"xxx","correlationId":xxx,"activityDateTime":"xxx"....}]}

Re: Need to remove prefix from json array.

vin02ptl — Fri, 15 May 2020 11:18:09 GMT

@gcusello please have a look and advice

Re: Need to remove prefix from json array.

gcusello — Fri, 15 May 2020 12:33:54 GMT

Hi @vin02ptl,
Thy this regex

\"id\":\"(?<id>[^\"]+)\",\"category\":\"(?<category>[^\"]+)\",\"correlationId\":(?<correlationId>[^\"]+),\"activityDateTime\":\"(?<activityDateTime>[^\"]+)

that you can test at https://regex101.com/r/StogWZ/1

Ciao.
Giuseppe

Re: Need to remove prefix from json array.

vin02ptl — Fri, 15 May 2020 12:54:28 GMT

i just want to remove header part during indexing remaining parsing field regex i can write....

Re: Need to remove prefix from json array.

to4kawa — Sun, 17 May 2020 00:07:42 GMT

props.conf

[odata]
CHARSET=UTF-8
DATETIME_CONFIG = CURRENT
INDEXED_EXTRACTION = none
KV_MODE = json
LINE_BREAKER = (.*:\[){\"id|}(,)|(\]})
NO_BINARY_CHECK = true
SHOULD_LINEMERGE = false
disabled = false

please modify DATETIME_CONFIG

If you don't present your log properly(you should use code sample), you can't expect a response.