topic Re: How to configure Character Set Encoding when using Splunk DB Connect? in All Apps and Add-ons

How to configure Character Set Encoding when using Splunk DB Connect?

Amirahussein — Mon, 20 Mar 2017 10:44:15 GMT

Dears,

I am getting data from database using Splunk DB Connect, the data is stored in Arabic and needs to be encoded in Splunk.
I have edited props.conf with the character set configuration as below, but the data still appear

I tried all below configurations
1:
[sourcetype]
CHARSET= CP1256
2:
[sourcetype]
CHARSET= ISO-8859-6
3:
[sourcetype]
CHARSET= AUTO

Re: How to configure Character Set Encoding when using Splunk DB Connect?

cdpascariu — Mon, 10 Apr 2017 10:05:39 GMT

Hi Amirahussein,

I got into the same issue with names being retrieved correctly from the DB but not being properly indexed. After some digging I found that I had some extra parameters to the JVM Options, restart the Task Server (JAVA) and everything was back to normal again.

The JVM options are:
-Dfile.encoding=UTF-8
-DdefaultCharset=UTF-8

This worked in my case. Hopefully that will help you. Maybe in your case should be some Arabic CHARSET.

--Chip

Re: How to configure Character Set Encoding when using Splunk DB Connect?

mikaelbje — Mon, 15 May 2017 09:52:25 GMT

Thanks for this. Solved my charset issues after upgrading to DB Connect 3.0.2 from 2.4.0

Re: How to configure Character Set Encoding when using Splunk DB Connect?

Amirahussein — Wed, 17 May 2017 11:32:34 GMT

Dears,

please note that the right mapping (character set ) needed is "windows-1265" which will map the Arabic massage correctly when being input from external database

after looking/searching in the documentation i found only the below codes:

Language Code
Arabic CP1256
Arabic ISO-8859-6

so any suggestion please

Amira

Re: How to configure Character Set Encoding when using Splunk DB Connect?

rashid47010 — Mon, 13 May 2019 19:51:28 GMT

hi
how to add both language codes in props.conf file