Splunk Search

ingest-time eval (creating new field dynamically on index time) not working

agro1986001
Engager

Hi. I tried the ingest-time eval documentation at (single enterprise instance):
https://docs.splunk.com/Documentation/Splunk/7.2.3/Data/IngestEval

However I could find the new field from the "| table eval_user" pipe. Does anyone have any experience in making it work? Thanks a lot

Tags (2)
0 Karma

woodcock
Esteemed Legend

You can only do this if the city field exists as an indexed field, which almost certainly in your case, it does not. To test, try this search:

index=_* sourcetype=testlog city::*

If this returns no events the EITHER your sourcetype is not testlog (so your props.conf stanza header is wrong) OR city is not an indexed field. You can use something like this instead:

INGEST_EVAL = eval_city=lower(replace(replace(_raw, SuffixRegExHere), PrefixRegExHere, "")
0 Karma

skoelpin
SplunkTrust
SplunkTrust

What's your purpose of wanting to create an index time eval? There's more benefit of doing it at search time

0 Karma

agro1986001
Engager

@richgalloway

Thanks for your reply

$ pwd
/Applications/Splunk/etc/system/local

$ cat transforms.conf
[myeval]
INGEST_EVAL = eval_city=lower(city)

$ cat props.conf
[testLog]
TRANSFORMS = myeval

$ cat fields.conf
[eval_city]
INDEXED = True

Here's my search

sourcetype=testLog
time=2019-01-27T15:23:02.664129+09:00 eventName=purchase userId=8304 city="London" item=food price=4200

And here's trying to get the ingest-time eval field

sourcetype=testLog | table userId, city, eval_city

but eval_city is blank

Any idea? Thanks a lot!

0 Karma

jkat54
SplunkTrust
SplunkTrust

What version of Splunk are you using?

0 Karma

richgalloway
SplunkTrust
SplunkTrust

Have you also added to fields.conf?

[eval_city]
INDEXED = True
---
If this reply helps you, Karma would be appreciated.
0 Karma

richgalloway
SplunkTrust
SplunkTrust

What are your props.conf and transforms.conf settings? What is the full query you're using to find the field?

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...