All Apps and Add-ons

Is the Hunk App for HBase compatible with HBase version 1.1.1.2, or do I have to be on 1.1.2?

Moonveil
Explorer

Hello,

Does the Hunk App for HBase also work with version 1.1.1.2 of HBase? Or do I have to be on 1.1.2?

Thank you!

Tags (2)
0 Karma

jruaux_splunk
Splunk Employee
Splunk Employee

Yes this should work. Here is a link to the HBase version compatibility matrix: https://hbase.apache.org/book.html#hbase.versioning
The line of interest here is the "Client-Server wire Compatibility", which indicates that a 1.1.2 client (the Hunk App for HBase) can talk to a 1.1.1.2 server.

0 Karma

Moonveil
Explorer

Hmm, I've installed the app, but am not getting any results. I'm seeing lots of errors being thrown when I inspect the search log in Hunk after setting loglevel to DEBUG.

Does this app support vix.zookeeper.znode.parent = /hbase-secure? We're using Kerberos to secure hdfs and hbase. That's the only difference I see from the tutorial example.

Thank you.

Edit - I've included some of the errors that I'm seeing in the search log below:

11-01-2016 16:36:26.225 ERROR ERP.hbase -  {"action":"search","conf":{"provider":{"dfs.namenode. ...{skipping 22392 bytes}... server\""}]}]}}}
11-01-2016 16:36:26.455 ERROR ERP.hbase -  Handling deprecation for all properties in config...
11-01-2016 16:36:26.456 ERROR ERP.hbase -  Handling deprecation for hbase.auth.token.max.lifetime
...
11-01-2016 16:22:07.772 ERROR ERP.hbase -  hbase.online.schema.update.enabletruehbase-default.xml
11-01-2016 16:22:07.772 ERROR ERP.hbase -  hbase.table.lock.enabletruehbase-default.xml
11-01-2016 16:22:07.772 ERROR ERP.hbase -  hbase.master.port16000hbase-default.xml
...
11-01-2016 16:36:26.671 ERROR ERP.hbase -  field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.682 ERROR ERP.hbase -  field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.682 ERROR ERP.hbase -  field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[GetGroups], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.683 ERROR ERP.hbase -  UgiMetrics, User and group related metrics
11-01-2016 16:36:26.902 ERROR ERP.hbase -   Creating new Groups object
11-01-2016 16:36:26.904 ERROR ERP.hbase -  Trying to load the custom-built native-hadoop library...
11-01-2016 16:36:26.904 ERROR ERP.hbase -  Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
11-01-2016 16:36:26.904 ERROR ERP.hbase -  java.library.path=/var/data/splunk/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
11-01-2016 16:36:26.905 ERROR ERP.hbase -  Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
11-01-2016 16:36:26.905 ERROR ERP.hbase -  Falling back to shell based
11-01-2016 16:36:26.905 ERROR ERP.hbase -  Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
11-01-2016 16:36:26.918 ERROR ERP.hbase -  setsid exited with exit code 0
11-01-2016 16:36:26.918 ERROR ERP.hbase -  Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
11-01-2016 16:36:26.925 ERROR ERP.hbase -  hadoop login
11-01-2016 16:36:26.926 ERROR ERP.hbase -  hadoop login commit
11-01-2016 16:36:26.929 ERROR ERP.hbase -  using local user:UnixPrincipal: root
11-01-2016 16:36:26.930 ERROR ERP.hbase -  UGI loginUser:root (auth:SIMPLE)
11-01-2016 16:36:27.145 ERROR ERP.hbase -  Process identifier=hconnection-0x7c0e4e8c connecting to ZooKeeper ensemble=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100
...
11-01-2016 16:36:27.155 ERROR ERP.hbase -  Initiating client connection, connectString=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100 sessionTimeout=90000 watcher=hconnection-0x7c0e4e8c0x0, quorum=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100, baseZNode=/hbase-secure
11-01-2016 16:36:27.159 ERROR ERP.hbase -  zookeeper.disableAutoWatchReset is false
11-01-2016 16:36:27.181 ERROR ERP.hbase -  Opening socket connection to server ser2.hd.tel.com/192.168.1.12:2100. Will not attempt to authenticate using SASL (unknown error)
11-01-2016 16:36:27.188 ERROR ERP.hbase -  Socket connection established to ser2.hd.tel.com/192.168.1.12:2100, initiating session
11-01-2016 16:36:27.189 ERROR ERP.hbase -  Session establishment request sent on ser2.hd.tel.com/192.168.1.12:2100
11-01-2016 16:36:27.194 ERROR ERP.hbase -  Session establishment complete on server ser2.hd.tel.com/192.168.1.12:2100, sessionid = 0x35808b91ead65aa, negotiated timeout = 40000
11-01-2016 16:36:27.196 ERROR ERP.hbase -  hconnection-0x7c0e4e8c0x0, quorum=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null
11-01-2016 16:36:27.198 ERROR ERP.hbase -  hconnection-0x7c0e4e8c-0x35808b91ead65aa connected
11-01-2016 16:36:27.200 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 1,3  replyHeader:: 1,1413045927159,0  request:: '/hbase-secure/hbaseid,F  response:: s{601295421767,1413045908958,1450390354271,1478040387927,39,0,0,0,67,0,601295421767} 
11-01-2016 16:36:27.204 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 2,4  replyHeader:: 2,1413045927159,0  request:: '/hbase-secure/hbaseid,F  response:: #ffffffff000146d61737465723a3136303030ffffffbaffffffdc4fffffff93fffffff9ffffffc3ffffffecffffff9f50425546a2432633833323230312d643239652d346133392d616635662d323037313831306639323736,s{601295421767,1413045908958,1450390354271,1478040387927,39,0,0,0,67,0,601295421767} 
11-01-2016 16:36:27.336 ERROR ERP.hbase -  Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@659cc1d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
11-01-2016 16:36:27.342 ERROR ERP.hbase -  Getting table 'hbase_table' and column family '*'
11-01-2016 16:36:27.358 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 3,3  replyHeader:: 3,1413045927161,0  request:: '/hbase-secure,F  response:: s{601295421598,601295421598,1450390322736,1450390322736,0,164,0,0,0,18,1413045909076} 
11-01-2016 16:36:27.362 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 4,4  replyHeader:: 4,1413045927161,0  request:: '/hbase-secure/master,F  response:: #ffffffff000146d61737465723a3136303030ffffff9bffffffd07afffffffb177b4e6150425546a28a1c6d6173746572312e6861646f6f702e74736c2e74656c75732e636f6d10ffffff807d18fffffff4ffffffbcffffffc9ffffff90ffffff822b10018ffffff8a7d,s{1413045908941,1413045908941,1478040386375,1478040386375,0,0,0,96836983061353612,76,0,1413045908941} 
11-01-2016 16:36:27.539 ERROR ERP.hbase -  Use SIMPLE authentication for service MasterService, sasl=false
11-01-2016 16:36:27.556 ERROR ERP.hbase -  Connecting to ser1.hd.tel.com/192.171.1.10:16000
11-01-2016 16:36:27.768 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 5,3  replyHeader:: 5,1413045927162,0  request:: '/hbase-secure,F  response:: s{601295421598,601295421598,1450390322736,1450390322736,0,164,0,0,0,18,1413045909076} 
11-01-2016 16:36:27.771 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 6,4  replyHeader:: 6,1413045927162,0  request:: '/hbase-secure/master,F  response:: #ffffffff000146d61737465723a3136303030ffffff9bffffffd07afffffffb177b4e6150425546a28a1c6d6173746572312e6861646f6f702e74736c2e74656c75732e636f6d10ffffff807d18fffffff4ffffffbcffffffc9ffffff90ffffff822b10018ffffff8a7d,s{1413045908941,1413045908941,1478040386375,1478040386375,0,0,0,96836983061353612,76,0,1413045908941} 
...
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:147)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at org.apache.hadoop.hbase.client.HTable.executeMasterCallable(HTable.java:603)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at org.apache.hadoop.hbase.client.HTable.getTableDescriptor(HTable.java:579)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at com.splunk.erp.hbase.HBaseERP.scan(HBaseERP.java:190)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at com.splunk.erp.hbase.HBaseERP.main(HBaseERP.java:350)
11-01-2016 16:45:18.279 ERROR ERP.hbase -  Caused by: org.apache.hadoop.hbase.MasterNotRunningException: com.google.protobuf.ServiceException: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: IPC Client (2026433662) connection to ser1.hd.tel.com/192.171.1.10:16000 from root is closing
0 Karma
Get Updates on the Splunk Community!

What's new in Splunk Cloud Platform 9.1.2312?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.1.2312! Analysts can ...

What’s New in Splunk Security Essentials 3.8.0?

Splunk Security Essentials (SSE) is an app that can amplify the power of your existing Splunk Cloud Platform, ...

Let’s Get You Certified – Vegas-Style at .conf24

Are you ready to level up your Splunk game? Then, let’s get you certified live at .conf24 – our annual user ...