Hello,
Does the Hunk App for HBase also work with version 1.1.1.2 of HBase? Or do I have to be on 1.1.2?
Thank you!
Yes this should work. Here is a link to the HBase version compatibility matrix: https://hbase.apache.org/book.html#hbase.versioning
The line of interest here is the "Client-Server wire Compatibility", which indicates that a 1.1.2 client (the Hunk App for HBase) can talk to a 1.1.1.2 server.
Hmm, I've installed the app, but am not getting any results. I'm seeing lots of errors being thrown when I inspect the search log in Hunk after setting loglevel to DEBUG.
Does this app support vix.zookeeper.znode.parent = /hbase-secure? We're using Kerberos to secure hdfs and hbase. That's the only difference I see from the tutorial example.
Thank you.
Edit - I've included some of the errors that I'm seeing in the search log below:
11-01-2016 16:36:26.225 ERROR ERP.hbase - {"action":"search","conf":{"provider":{"dfs.namenode. ...{skipping 22392 bytes}... server\""}]}]}}}
11-01-2016 16:36:26.455 ERROR ERP.hbase - Handling deprecation for all properties in config...
11-01-2016 16:36:26.456 ERROR ERP.hbase - Handling deprecation for hbase.auth.token.max.lifetime
...
11-01-2016 16:22:07.772 ERROR ERP.hbase - hbase.online.schema.update.enabletruehbase-default.xml
11-01-2016 16:22:07.772 ERROR ERP.hbase - hbase.table.lock.enabletruehbase-default.xml
11-01-2016 16:22:07.772 ERROR ERP.hbase - hbase.master.port16000hbase-default.xml
...
11-01-2016 16:36:26.671 ERROR ERP.hbase - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.682 ERROR ERP.hbase - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.682 ERROR ERP.hbase - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[GetGroups], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.683 ERROR ERP.hbase - UgiMetrics, User and group related metrics
11-01-2016 16:36:26.902 ERROR ERP.hbase - Creating new Groups object
11-01-2016 16:36:26.904 ERROR ERP.hbase - Trying to load the custom-built native-hadoop library...
11-01-2016 16:36:26.904 ERROR ERP.hbase - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
11-01-2016 16:36:26.904 ERROR ERP.hbase - java.library.path=/var/data/splunk/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
11-01-2016 16:36:26.905 ERROR ERP.hbase - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
11-01-2016 16:36:26.905 ERROR ERP.hbase - Falling back to shell based
11-01-2016 16:36:26.905 ERROR ERP.hbase - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
11-01-2016 16:36:26.918 ERROR ERP.hbase - setsid exited with exit code 0
11-01-2016 16:36:26.918 ERROR ERP.hbase - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
11-01-2016 16:36:26.925 ERROR ERP.hbase - hadoop login
11-01-2016 16:36:26.926 ERROR ERP.hbase - hadoop login commit
11-01-2016 16:36:26.929 ERROR ERP.hbase - using local user:UnixPrincipal: root
11-01-2016 16:36:26.930 ERROR ERP.hbase - UGI loginUser:root (auth:SIMPLE)
11-01-2016 16:36:27.145 ERROR ERP.hbase - Process identifier=hconnection-0x7c0e4e8c connecting to ZooKeeper ensemble=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100
...
11-01-2016 16:36:27.155 ERROR ERP.hbase - Initiating client connection, connectString=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100 sessionTimeout=90000 watcher=hconnection-0x7c0e4e8c0x0, quorum=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100, baseZNode=/hbase-secure
11-01-2016 16:36:27.159 ERROR ERP.hbase - zookeeper.disableAutoWatchReset is false
11-01-2016 16:36:27.181 ERROR ERP.hbase - Opening socket connection to server ser2.hd.tel.com/192.168.1.12:2100. Will not attempt to authenticate using SASL (unknown error)
11-01-2016 16:36:27.188 ERROR ERP.hbase - Socket connection established to ser2.hd.tel.com/192.168.1.12:2100, initiating session
11-01-2016 16:36:27.189 ERROR ERP.hbase - Session establishment request sent on ser2.hd.tel.com/192.168.1.12:2100
11-01-2016 16:36:27.194 ERROR ERP.hbase - Session establishment complete on server ser2.hd.tel.com/192.168.1.12:2100, sessionid = 0x35808b91ead65aa, negotiated timeout = 40000
11-01-2016 16:36:27.196 ERROR ERP.hbase - hconnection-0x7c0e4e8c0x0, quorum=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null
11-01-2016 16:36:27.198 ERROR ERP.hbase - hconnection-0x7c0e4e8c-0x35808b91ead65aa connected
11-01-2016 16:36:27.200 ERROR ERP.hbase - Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 1,3 replyHeader:: 1,1413045927159,0 request:: '/hbase-secure/hbaseid,F response:: s{601295421767,1413045908958,1450390354271,1478040387927,39,0,0,0,67,0,601295421767}
11-01-2016 16:36:27.204 ERROR ERP.hbase - Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 2,4 replyHeader:: 2,1413045927159,0 request:: '/hbase-secure/hbaseid,F response:: #ffffffff000146d61737465723a3136303030ffffffbaffffffdc4fffffff93fffffff9ffffffc3ffffffecffffff9f50425546a2432633833323230312d643239652d346133392d616635662d323037313831306639323736,s{601295421767,1413045908958,1450390354271,1478040387927,39,0,0,0,67,0,601295421767}
11-01-2016 16:36:27.336 ERROR ERP.hbase - Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@659cc1d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
11-01-2016 16:36:27.342 ERROR ERP.hbase - Getting table 'hbase_table' and column family '*'
11-01-2016 16:36:27.358 ERROR ERP.hbase - Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 3,3 replyHeader:: 3,1413045927161,0 request:: '/hbase-secure,F response:: s{601295421598,601295421598,1450390322736,1450390322736,0,164,0,0,0,18,1413045909076}
11-01-2016 16:36:27.362 ERROR ERP.hbase - Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 4,4 replyHeader:: 4,1413045927161,0 request:: '/hbase-secure/master,F response:: #ffffffff000146d61737465723a3136303030ffffff9bffffffd07afffffffb177b4e6150425546a28a1c6d6173746572312e6861646f6f702e74736c2e74656c75732e636f6d10ffffff807d18fffffff4ffffffbcffffffc9ffffff90ffffff822b10018ffffff8a7d,s{1413045908941,1413045908941,1478040386375,1478040386375,0,0,0,96836983061353612,76,0,1413045908941}
11-01-2016 16:36:27.539 ERROR ERP.hbase - Use SIMPLE authentication for service MasterService, sasl=false
11-01-2016 16:36:27.556 ERROR ERP.hbase - Connecting to ser1.hd.tel.com/192.171.1.10:16000
11-01-2016 16:36:27.768 ERROR ERP.hbase - Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 5,3 replyHeader:: 5,1413045927162,0 request:: '/hbase-secure,F response:: s{601295421598,601295421598,1450390322736,1450390322736,0,164,0,0,0,18,1413045909076}
11-01-2016 16:36:27.771 ERROR ERP.hbase - Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 6,4 replyHeader:: 6,1413045927162,0 request:: '/hbase-secure/master,F response:: #ffffffff000146d61737465723a3136303030ffffff9bffffffd07afffffffb177b4e6150425546a28a1c6d6173746572312e6861646f6f702e74736c2e74656c75732e636f6d10ffffff807d18fffffff4ffffffbcffffffc9ffffff90ffffff822b10018ffffff8a7d,s{1413045908941,1413045908941,1478040386375,1478040386375,0,0,0,96836983061353612,76,0,1413045908941}
...
11-01-2016 16:45:18.279 ERROR ERP.hbase - at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:147)
11-01-2016 16:45:18.279 ERROR ERP.hbase - at org.apache.hadoop.hbase.client.HTable.executeMasterCallable(HTable.java:603)
11-01-2016 16:45:18.279 ERROR ERP.hbase - at org.apache.hadoop.hbase.client.HTable.getTableDescriptor(HTable.java:579)
11-01-2016 16:45:18.279 ERROR ERP.hbase - at com.splunk.erp.hbase.HBaseERP.scan(HBaseERP.java:190)
11-01-2016 16:45:18.279 ERROR ERP.hbase - at com.splunk.erp.hbase.HBaseERP.main(HBaseERP.java:350)
11-01-2016 16:45:18.279 ERROR ERP.hbase - Caused by: org.apache.hadoop.hbase.MasterNotRunningException: com.google.protobuf.ServiceException: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: IPC Client (2026433662) connection to ser1.hd.tel.com/192.171.1.10:16000 from root is closing