REST API Modular Input: Why are Arabic characters not encoded properly?

[toumii]

Hi everyone,

I'm using the REST API Modular Input to get data from a web page (php). The thing is that data is a mix of arabic and french characters. I specified the charset in props.conf, but that data I'm getting is still not correctly encoded. I tried both CP1256 and ISO-8859-6 codes.

Can anyone please help me figure that out?

[Friss]

Here's the sourcetype config and the specified encoding :

[ivd]
 pulldown_type = true
 LINE_BREAKER = ([\r\n]*)>
 NO_BINARY_CHECK = true
 DATETIME_CONFIG = CURRENT

[host::GI-PC]
 CHARSET = CP1256

and as you can see in the screenshots the rest api seems to be okay, still the search results are not as they should be.

[Damien_Dallimor]

I don't have any issues with arabic charsets.

[Damien_Dallimor]

No issues with json either.

[toumii]

Thank you very much for your respose. I am working with a json response. Do you think this parameter has anything to do with this issue?

[Friss]

hey I m facing the same issue i was wondering if you got the solution then maybe you could share 🙂
have a nice one .