topic settings to configure hunk for Hive ORC table in Getting Data In

settings to configure hunk for Hive ORC table

pawantiwari3987 — Thu, 22 Jan 2015 11:38:49 GMT

Hi Team,
Please help us in configuring hadoop provider/virtual index so that we can map it on hive orc table. we are able to search on simple/text table however when we give path of orc table it show output in some unreadable format.

Regards
Pawan Tiwari

Re: settings to configure hunk for Hive ORC table

rdagan_splunk — Mon, 28 Sep 2020 18:44:19 GMT

If you have access to the Metastore URI, it should look similar to this example

In the Provider add these two flags:
vix.splunk.search.splitter = HiveSplitGenerator
vix.hive.metastore.uris = thrift://sandbox:9083 (you can find the value in hive-site.xml)

In the Virtual Index you will need to point to the actual ORC file, DB Name, Table Name:
[employee_orc]
vix.input.1.path = /apps/hive/warehouse/employees_orc
vix.provider = HiveHDPProvider
vix.input.1.splitter.hive.dbname = default
vix.input.1.splitter.hive.tablename = employees_rc

Re: settings to configure hunk for Hive ORC table

hyan_splunk — Fri, 03 Apr 2015 15:45:05 GMT

For any hive formats other than text, you need to specify fileformat property. So in your case:

vix.input.1.splitter.hive.fileformat = orc