hi,
these are my sample log file-:
< Jul 15 23:48:33 Phase 0 running (1132 seconds)
CPU Time Status Skew Vertex
0.046 [ : 1] 0% Audit.XYX
0.135 [ : 1] 0% Audit.PQR
7.955 [ :12] 0% LMNOP
Data Bytes Records Status Flow
712 4 [ : : 1] 0% Audit.Flow1
712 4 [ : : 1] 0% Audit.Flow2
0 0 [ : : 12] 0% Flow_1
0 0 [ : : 12] 0% Flow_10
41,417,795 264,261 [ : : 12] 1% Flow_11
41,417,795 264,261 [ : : 12] 1% Flow_11
1,746,882,294 3,158,255 [ : : 12] 0% Flow_12
Jul 15 23:48:33 Phase 0 running (1132 seconds)
CPU Time Status Skew Vertex
0.046 [ : 1] 0% Audit.XYX
0.135 [ : 1] 0% Audit.PQR
7.955 [ :12] 0% LMNOP
Data Bytes Records Status Flow
712 4 [ : : 1] 0% Audit.Flow1
712 4 [ : : 1] 0% Audit.Flow2
0 0 [ : : 12] 0% Flow_1
0 0 [ : : 12] 0% Flow_10
41,417,795 264,261 [ : : 12] 1% Flow_11
41,417,795 264,261 [ : : 12] 1% Flow_11
1,746,882,294 3,158,255 [ : : 12] 0% Flow_12
Jul 15 23:48:33 Phase 0 ended (1132 seconds)
CPU Time Status Skew Vertex
0.046 [ : 1] 0% Audit.XYX
0.135 [ : 1] 0% Audit.PQR
7.955 [ :12] 0% LMNOP
Data Bytes Records Status Flow
712 4 [ : : 1] 0% Audit.Flow1
712 4 [ : : 1] 0% Audit.Flow2
0 0 [ : : 12] 0% Flow_1
0 0 [ : : 12] 0% Flow_10
41,417,795 264,261 [ : : 12] 1% Flow_11
41,417,795 264,261 [ : : 12] 1% Flow_11
1,746,882,294 3,158,255 [ : : 12] 0% Flow_12
Jul 15 23:48:33 Phase 1 running (1132 seconds)
CPU Time Status Skew Vertex
0.046 [ : 1] 0% Audit.XYX
0.135 [ : 1] 0% Audit.PQR
7.955 [ :12] 0% LMNOP
Data Bytes Records Status Flow
712 4 [ : : 1] 0% Audit.Flow1
712 4 [ : : 1] 0% Audit.Flow2
0 0 [ : : 12] 0% Flow_1
0 0 [ : : 12] 0% Flow_10
41,417,795 264,261 [ : : 12] 1% Flow_11
41,417,795 264,261 [ : : 12] 1% Flow_11
1,746,882,294 3,158,255 [ : : 12] 0% Flow_12
consisting of phase (0,1) running,started and ended.
i want to calculate max cpu time took by a particular vertex when the phase ended and max data bytes consumed by flow.
so i have created regex for the field extraction,the log files that we have is from unix environment.
DOS expression for required data set :
.* Phase \d ended.\r\n(.\r\n)*-{80}\r\n-{80}
Unix expression for required data set :
.* Phase \d ended.\n(.\n)*-{80}\n-{80}
but this is not working as expected.Splunk does not extract the given pattern as a record.
record that we are interested in is described int regex above.
the result looks like
Jul 15 23:48:33 Phase 0 ended (1132 seconds)
CPU Time Status Skew Vertex
0.046 [ : 1] 0% Audit.XYX
0.135 [ : 1] 0% Audit.PQR
7.955 [ :12] 0% LMNOP
Data Bytes Records Status Flow
712 4 [ : : 1] 0% Audit.Flow1
712 4 [ : : 1] 0% Audit.Flow2
0 0 [ : : 12] 0% Flow_1
0 0 [ : : 12] 0% Flow_10
41,417,795 264,261 [ : : 12] 1% Flow_11
41,417,795 264,261 [ : : 12] 1% Flow_11
1,746,882,294 3,158,255 [ : : 12] 0% Flow_12
also when we try to extract fields for CPU TIME of ended phases Splunk expression generator randomly picks up some numbers across different phases..
what si the best way to
1)ensure splunk considers only ended phases as distinct records
2)for every ended records extract fields like cpu time,vertex,flow etc >
... View more