- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
How to configure Hunk for ORC format data in Hive?
Hi Team,
I am using Apache Hadoop 2.6.0 and Hive 0.14. I have configured Hunk for text data in hive and HDFS.
but I am not able to configure ORC format data in Hive. I tried properties discussed in (http://answers.splunk.com/answers/210194/settings-to-configure-hunk-for-hive-orc-table.html ) but it is not working. I am getting a garbage values in Hunk.
Please help me by providing settings.
Thanks & Regards
Abhisek
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content

For any hive formats other than text, you need to specify fileformat property. So in your case:
vix.input.1.splitter.hive.fileformat = orc
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
I'm using Splunk and Hunk on AWS. We have a Hive external table with textfile format. It's field delimiter is comma. I'm able to setup a index provider and virtual index for the hive table with the following setup. However, the field values are not parsed properly. It seems Splunk put the entire row to the 1st field. Is there a vix.input.1.hive.??? parameter for hive field delimiter?
vix.input.1.splitter.hive.columnnames=id,source,type,amount,status,from_pin,region_id,ip_address,date_closing,date_created,date_event,user_seller,account_seller,advertiser_id,user_id,account_id,sale_type,sale_item,sale_id,sale_amount,request,order_id,from_co,client_id,product_price,utcdate,bonus
vix.input.1.splitter.hive.columntypes=string:string:string:double:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string:string
vix.input.1.splitter.hive.dbname=rs_analytics
vix.input.1.splitter.hive.tablename=transaction
vix.input.1.splitter.hive.fileformat=textfile
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content

Yes.
vix.input.1.splitter.hive.rowformat.fields.terminated=,
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content

Also, it seems like the provider may be missing this flag
vix.hive.metastore.uris = thrift://metastore.example.com:9083
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi please find below current settings:
Provider:
vix.splunk.search.splitter=HiveSplitGenerator
and all other properties are set to default
Virtual Index:
Path to data in HDFS =
vix.input.1.splitter.hive.dbname = default
vix.input.1.splitter.hive.tablename = hivetable_orc
the above setting is working fine with text files but not working with ORC format.
please help...
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content

Can you please post how your existing settings look like (provider + virtual index).
