topic REST API Modular Input: Why are Arabic characters not encoded properly? in All Apps and Add-ons

REST API Modular Input: Why are Arabic characters not encoded properly?

toumii — Fri, 24 Jul 2015 11:57:48 GMT

Hi everyone,

I'm using the REST API Modular Input to get data from a web page (php). The thing is that data is a mix of arabic and french characters. I specified the charset in props.conf, but that data I'm getting is still not correctly encoded. I tried both CP1256 and ISO-8859-6 codes.

Can anyone please help me figure that out?

Re: REST API Modular Input: Why are Arabic characters not encoded properly?

Friss — Fri, 24 Jul 2015 12:45:15 GMT

hey I m facing the same issue i was wondering if you got the solution then maybe you could share 🙂
have a nice one .

Re: REST API Modular Input: Why are Arabic characters not encoded properly?

Damien_Dallimor — Fri, 24 Jul 2015 17:38:34 GMT

I don't have any issues with arabic charsets.

Re: REST API Modular Input: Why are Arabic characters not encoded properly?

toumii — Fri, 24 Jul 2015 18:08:54 GMT

Thank you very much for your respose. I am working with a json response. Do you think this parameter has anything to do with this issue?

Re: REST API Modular Input: Why are Arabic characters not encoded properly?

Damien_Dallimor — Fri, 24 Jul 2015 18:35:10 GMT

No issues with json either.

Re: REST API Modular Input: Why are Arabic characters not encoded properly?

Friss — Mon, 27 Jul 2015 08:41:23 GMT

Here's the sourcetype config and the specified encoding :

[ivd]
 pulldown_type = true
 LINE_BREAKER = ([\r\n]*)>
 NO_BINARY_CHECK = true
 DATETIME_CONFIG = CURRENT

[host::GI-PC]
 CHARSET = CP1256

and as you can see in the screenshots the rest api seems to be okay, still the search results are not as they should be.