Getting Data In

Importing rsyslog json as metrics

krunoslav
Engager

Hi everyone,

I'm trying to import the following type of log data as metrics (extract shown):

Nov 14 03:23:42 hostname rsyslogd-pstats:{ "name": "global", "origin": "dynstats", "values": { } }
Nov 14 03:23:42 hostname rsyslogd-pstats:{ "name": "imuxsock", "origin": "imuxsock", "submitted": 0, "ratelimit.discarded": 0, "ratelimit.numratelimiters": 0 }
Nov 14 03:23:42 hostname rsyslogd-pstats:{ "name": "action 0", "origin": "core.action", "processed": 50996, "failed": 0, "suspended": 0, "suspended.duration": 0, "resumed": 0 }
Nov 14 03:23:42 hostname rsyslogd-pstats:{ "name": "action 1", "origin": "core.action", "processed": 50996, "failed": 0, "suspended": 0, "suspended.duration": 0, "resumed": 0 }

The entry in props.conf looks like this:

[t_json_test_m]
LINE_BREAKER = ([\r\n]+)
MAX_TIMESTAMP_LOOKAHEAD = 15
NO_BINARY_CHECK = true
TIME_FORMAT = %b %d %T
SEDCMD-strip = s/^[^\{]+//
METRIC-SCHEMA-TRANSFORMS = metric-schema:t_json_test_m_1579526919489
SHOULD_LINEMERGE = false
category = Log to Metrics
disabled = false
AUTO_KV_JSON = false
KV_MODE = none
INDEXED_EXTRACTIONS = json

And the corresponding entry in transforms.conf is:

[metric-schema:t_json_test_m_1579526919489]
METRIC-SCHEMA-MEASURES = _ALLNUMS_

However, when I add the data to a metrics index, I see nothing. I got no messages from Splunk in the GUI, but I saw a JSON parsing error in the _internal index (01-20-2020 16:59:43.458 +0100 ERROR JsonLineBreaker - JSON StreamId:0 had parsing error:Unexpected character while looking for value: 'N'...). But, when I remove the metrics part from the config and index the file to a normal index, I can see the data. Any clues? I tried to follow the guidelines at https://docs.splunk.com/Documentation/Splunk/8.0.0/Metrics/L2MSplunkWeb. My Splunk version is 8.0.1 and I'm doing all this on a single machine. Thanks.

0 Karma
Get Updates on the Splunk Community!

Splunk Forwarders and Forced Time Based Load Balancing

Splunk customers use universal forwarders to collect and send data to Splunk. A universal forwarder can send ...

NEW! Log Views in Splunk Observability Dashboards Gives Context From a Single Page

Today, Splunk Observability releases log views, a new feature for users to add their logs data from Splunk Log ...

Last Chance to Submit Your Paper For BSides Splunk - Deadline is August 12th!

Hello everyone! Don't wait to submit - The deadline is August 12th! We have truly missed the community so ...