topic Re: Why is the REST API modular input response xml data charset is broken? in All Apps and Add-ons

Why is the REST API modular input response xml data charset is broken?

leeyounsoo — Wed, 02 May 2018 11:23:52 GMT

Hi,
i have a problem with the character set.

I am using the REST API modular input.
However, characters are broken in the xml data received in response through the REST API.
like this:

<?xml version="1.0" encoding="UTF-8"?>
<tag1>
<![CDATA[ìœ ì˜ë¯¸ì˜ ë§ˆìŒì€ ì–¸ì œë‚˜ ì²ì¶˜]]>
</tag1>

I tried this thing:

modify props.conf

[sourcetype]
CHARSET = UTF-8

modify responsehandler.py

coding: utf-8
import sys
reload(sys)
sys.setdefaultencoding('utf-8')

import json
import datetime

class MyResponseHandler:

def __init__(self,**args):
    pass

def __call__(self, response_object,raw_response_output,response_type,req_args,endpoint):
    cookies = response_object.cookies
    if cookies:
        req_args["cookies"] = cookies
    raw_response_output.encode('utf-8')
    print_xml_stream(raw_response_output)

....(skip)
what should I do?

Re: Why is the REST API modular input response xml data charset is broken?

asohahn_splunk — Wed, 02 May 2018 15:41:44 GMT

It seems like your broken text is encoded with iso-8859-1(Latin1). Is the first line of your responsehandler.py "coding: utf-8" just a typo? It should be something like "#-- coding: utf-8 --".

Re: Why is the REST API modular input response xml data charset is broken?

leeyounsoo — Thu, 03 May 2018 01:53:29 GMT

that is a typo.
splunk answer comment form automatically change that String.

i write like this :
"# -- coding : utf-8 --"

but, that is broken yet.

my python version is 2.7.x