Splunk Search

Why do I have empty stack fields in some logs?

sc_admin11
Explorer

I have uploaded the screenshots of logs of same time but in one log stack and task field is empty and in one it is filled . What is the reason behind ? 
Can someone help me to figure it out?

Screenshot 2023-01-02 at 5.55.24 PM.pngScreenshot 2023-01-02 at 5.55.32 PM.png

Labels (1)
0 Karma

bowesmana
SplunkTrust
SplunkTrust

Your stack value of ust-Dashboard-Demo-Service does not appear to be in the visible _raw data, so it is presumably a calculated, or some other kind of auto populated field, that is being generated as a result of some props/transforms. Same applies to task - that's not in the visible screenshot raw listing

If you 

| table _raw

do you see either task or stack in the data?

If not check the field settings for the sourcetype=format_v1 

 

  

0 Karma

PickleRick
SplunkTrust
SplunkTrust

It might also be an indexed field prepared by Splunk during ingestion process. It's relatively common to have additional metadata fields identifying the origin of an event in case the events themselves or the "standard" metadata (most significantly, the host value) do not provide enough information in that matter.

0 Karma

sc_admin11
Explorer

hi @bowesmana 
 stack and task is not in raw data. we are passing through entrypoint.sh and input.conf file as 

[monitor:///var/log/dashboard/dashboard.log]
sourcetype = format_v1
index = dashboard
_meta = stack::<stackname> task::<taskid>
0 Karma

PickleRick
SplunkTrust
SplunkTrust

Maybe you're manipulating the _meta somewhere during the ingestion process. (do you have any transforms with DEST_KEY=_meta?

0 Karma

sc_admin11
Explorer

@PickleRick  no we don't have any transforms with DEST_KEY=_meta

0 Karma

bowesmana
SplunkTrust
SplunkTrust

How are you getting stackname and taskid fields?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Event Series: Splunk Observability Metrics Cost Optimization

Balancing Scale and Spend: Gaining Control Over High-Volume Metrics in Splunk Observability Cloud As ...

Kick the Tires Before You Commit: A Hands-On Tour of the Splunk Observability Cloud ...

Evaluating an enterprise observability platform usually goes like this: fill out a form, get a free trial with ...

Deep insights, no barriers: Splunk Observability Cloud Free Edition

As software delivery cycles continue to accelerate, observability shouldn’t be a luxury — it should be a ...