Hi Team,
Please help us in configuring hadoop provider/virtual index so that we can map it on hive orc table. we are able to search on simple/text table however when we give path of orc table it show output in some unreadable format.
Regards
Pawan Tiwari
For any hive formats other than text, you need to specify fileformat property. So in your case:
vix.input.1.splitter.hive.fileformat = orc
If you have access to the Metastore URI, it should look similar to this example
In the Provider add these two flags:
vix.splunk.search.splitter = HiveSplitGenerator
vix.hive.metastore.uris = thrift://sandbox:9083 (you can find the value in hive-site.xml)
In the Virtual Index you will need to point to the actual ORC file, DB Name, Table Name:
[employee_orc]
vix.input.1.path = /apps/hive/warehouse/employees_orc
vix.provider = HiveHDPProvider
vix.input.1.splitter.hive.dbname = default
vix.input.1.splitter.hive.tablename = employees_rc