topic Re: How to configure Splunk to parse uppercase field values and make them lowercase? in Getting Data In

How to configure Splunk to parse uppercase field values and make them lowercase?

renanprado96 — Thu, 30 Jun 2016 13:58:58 GMT

I have an index that has some data entering written in uppercase and other data in lowercase, but they are about the same thing.

Here is an example:

HOTMAIL.COM It is the same as hotmail.com

I know the lower() function, but how to deal with this data before inserting them?

I tried using in the file .props this:

SEDCMD-upper2lower = s/[aA]/a/g s/[bB]/b/g s/[cC]/c/g s/[dD]/d/g s/[eE]/e/g s/[fF]/f/g s/[gG]/g/g s/[hH]/h/g s/[iI]/i/g s/j/[jJ]/g s/[kK]/k/g s/[lL]/l/g s/[mM]/m/g s/[nN]/n/g s/[oO]/o/g s/[pP]/p/g s/[qQ]/q/g s/[rR]/r/g s/[sS]/s/g s/[tT]/t/g s/[uU]/u/g s/[vV]/v/g s/[wW]/w/g s/[xX]/x/g s/[yY]/y/g s/[zZ]/z/g

but could not make it work

Thank you!!

Re: How to configure Splunk to parse uppercase field values and make them lowercase?

woodcock — Thu, 30 Jun 2016 14:12:45 GMT

You should have made an update to your original answer instead of opening a new one. In any case, the solution does work so you need to share the details of how you implemented it. What is the full path for your props.conf file? Where did you put this file (what servers)?

You need to put this on your indexers (unless you are using INDEXED_EXTRACTIONS) and you need to restart all splunk instances there. After that, the changes will only apply to data that is indexed after the restart (older events will not be effected).

Re: How to configure Splunk to parse uppercase field values and make them lowercase?

renanprado96 — Thu, 30 Jun 2016 17:43:38 GMT

props.conf:

.
.
.

input.conf:

.
.

directory files:
D:\Splunk\SplunkIn\dd

Re: How to configure Splunk to parse uppercase field values and make them lowercase?

woodcock — Thu, 30 Jun 2016 18:16:08 GMT

Ah, you are using INDEXED_EXTRACTIONS. In that case, I would switch to using calculated fields which would effect post-indexed data. It should allow everything to work as you would expect but it will not change the raw data. Try this in props.conf:

[digital2_csv]
EVAL-Dominio=lower(Dominio)

Re: How to configure Splunk to parse uppercase field values and make them lowercase?

renanprado96 — Thu, 30 Jun 2016 18:37:21 GMT

Oh yeah, I get it.
I've tested it and it worked.
Thank you very much!!

Have a good day or night.. haha