Splunk Search

Can you list every field an index contains?

learnyboi1
Observer

Greetings,

I have a search that list every index and what sourcetypes are contained within it.

|tstats values(sourcetype) where index=* by index

What I like about it is that I can see each index and a list of all of the sourcetypes specific tot that index. I'm trying to see this same data format by with a column of the indexes and a column of all of the fields that index contains.

I'm working on adding indexes to an app that already list what fields it needs but doesn't know what index they are associated to. So I have something like hash value fields md5 and MD5. They are different because of the source they come from but I need to find the index they live to add it.

I also think it would just be useful for audit purposes so if expected fields can be confirmed at a glance.

Please let me know if you have any questions. Thank you!

Best,

Brian

Labels (1)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

Check out the walklex command.  It will tell you which fields are indexed, as opposed to all the fields in an index.  See https://docs.splunk.com/Documentation/Splunk/9.1.1/SearchReference/Walklex

| walklex type=field index=foo
---
If this reply helps you, Karma would be appreciated.

bowesmana
SplunkTrust
SplunkTrust

There's not really a good way to get fields for an index, but you can do it like this using the output from fieldsummary as a subsearch

index=*
[ search index=*
  | fieldsummary maxvals=1
  | fields field 
  | eval {field}=if(match(field, "_time"), null(), "*")
  | fields - field  
  ]
  | foreach * [ eval fields=mvappend(fields, if(isnotnull('<<FIELD>>'), "<<FIELD>>", null())) ]
  | stats values(fields) as fields by index

It's not particularly efficient, but will give you a idea - the _time check is because search won't like earliest_time="*" in the subsearch output.

 

0 Karma
Get Updates on the Splunk Community!

Technical Workshop Series: Splunk Data Management and SPL2 | Register here!

Hey, Splunk Community! Ready to take your data management skills to the next level? Join us for a 3-part ...

Spotting Financial Fraud in the Haystack: A Guide to Behavioral Analytics with Splunk

In today's digital financial ecosystem, security teams face an unprecedented challenge. The sheer volume of ...

Solve Problems Faster with New, Smarter AI and Integrations in Splunk Observability

Solve Problems Faster with New, Smarter AI and Integrations in Splunk Observability As businesses scale ...