All Apps and Add-ons

website input charset problem

akdake
Explorer

I have create an input for scraping web-pages for data through Website Inputs add-on, and it work well.

However, the search result is some unreadable codes instead of Chinese character, , such Âé×핽ʽ£ºÈ«Â,
the html charset is gb2312, as following,

Also, the the CHARSET in props.conf is also gb2312

I have also tried charset HZ,utf-8,AUTO, in vain,

who can tell me why ? thanks .

Tags (2)
0 Karma

LukeMurphey
Champion

Please let me know if version 0.8 fixes your problem (or accept the answer so I know it worked).

0 Karma

LukeMurphey
Champion

This is a bug. The input isn't correctly determining the encoding of the page. I have a bug report created for and will get it fixed very soon.

Update:
This should work now as of version 0.8.

LukeMurphey
Champion

Is the site you are trying to get information from public? If so, could you share the selector you are using and the URL you are trying to load data from so that I could reproduce the issue?

akdake
Explorer

Yes, no search result was caputured after installing version, 0.8, I have tried this version on different Splunk demo,

0 Karma

LukeMurphey
Champion

Are you saying that it is no longer logging the results in Splunk?

0 Karma

akdake
Explorer

Many thanks, i update the add on to 0.8 , but it doesn't work, which cannot get any search result., pls confirm that.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...