Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

carlkennedy — Tue, 19 Apr 2016 15:43:35 GMT

Thanks to this forum, I got the correct permissions in AWS and can now pull in Kinesis data to my Mac laptop.
I use the exact same modular input configuration on my Splunk Enterprise (Linux) and get this error message:

04-19-2016 14:30:27.715 +0000 INFO  ExecProcessor - Removing status item "/opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py (isModInput=yes)
04-19-2016 14:30:27.717 +0000 INFO  ExecProcessor - New scheduled exec process: python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py
04-19-2016 14:30:32.104 +0000 INFO  ExecProcessor - Removing status item "/opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py (isModInput=yes)
04-19-2016 14:30:32.105 +0000 INFO  ExecProcessor - New scheduled exec process: python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.splunk.modinput.kinesis.KinesisModularInput$MessageReceiver.run(Unknown Source)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.run(Worker.java:321)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.initialize(Worker.java:377)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.KinesisClientLibLeaseCoordinator.initialize(KinesisClientLibLeaseCoordinator.java:172)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.leases.impl.LeaseManager.createLeaseTableIfNotExists(LeaseManager.java:117)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.createTable(AmazonDynamoDBClient.java:989)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.invoke(AmazonDynamoDBClient.java:2908)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:245)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:402)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:381)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.DefaultRequestDirector.determineRoute(DefaultRequestDirector.java:762)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.conn.DefaultHttpRoutePlanner.determineRoute(DefaultHttpRoutePlanner.java:116)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.<init>(HttpRoute.java:170)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.<init>(HttpRoute.java:74)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.normalize(HttpRoute.java:106)
04-19-2016 14:30:33.434 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py" Stanza kinesis://bluvision : Error running message receiver : java.lang.NoSuchMethodError: org.apache.http.HttpHost.getAddress()Ljava/net/InetAddress;
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.splunk.modinput.kinesis.KinesisModularInput$MessageReceiver.run(Unknown Source)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.run(Worker.java:321)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.initialize(Worker.java:377)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.KinesisClientLibLeaseCoordinator.initialize(KinesisClientLibLeaseCoordinator.java:172)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.kinesis.leases.impl.LeaseManager.createLeaseTableIfNotExists(LeaseManager.java:117)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.createTable(AmazonDynamoDBClient.java:989)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.invoke(AmazonDynamoDBClient.java:2908)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:245)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:402)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:381)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.DefaultRequestDirector.determineRoute(DefaultRequestDirector.java:762)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.conn.DefaultHttpRoutePlanner.determineRoute(DefaultHttpRoutePlanner.java:116)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.<init>(HttpRoute.java:170)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.<init>(HttpRoute.java:74)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.normalize(HttpRoute.java:106)
04-19-2016 14:30:33.463 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py" Stanza kinesis://bluvision : Error running message receiver : java.lang.NoSuchMethodError: org.apache.http.HttpHost.getAddress()Ljava/net/InetAddress;
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:381)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.client.DefaultRequestDirector.determineRoute(DefaultRequestDirector.java:762)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.impl.conn.DefaultHttpRoutePlanner.determineRoute(DefaultHttpRoutePlanner.java:116)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.<init>(HttpRoute.java:170)
04-19-2016 14:30:33.489 +0000 ERROR ExecProcessor - message from "python /opt/splunk/etc/apps/kinesis_ta/bin/kinesis.py"    at org.apache.http.conn.routing.HttpRoute.<init>(HttpRoute.java:74)

Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

Damien_Dallimor — Tue, 19 Apr 2016 16:33:29 GMT

java.lang.NoSuchMethodError: org.apache.http.HttpHost.getAddress()Ljava/net/InetAddress;

What Java runtime version are you executing with ?

Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

carlkennedy — Tue, 29 Sep 2020 09:30:41 GMT

[ccevpspk104-HF]$ java -version
java version "1.7.0_85"
OpenJDK Runtime Environment (amzn-2.6.1.3.61.amzn1-x86_64 u85-b01)
OpenJDK 64-Bit Server VM (build 24.85-b03, mixed mode)

Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

khutchinson_spl — Mon, 13 Jun 2016 15:36:00 GMT

We have an instance in AWS that is running java version "1.7_101". Should that make a difference, Damien. Thanks for your help.

topic Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)? in All Apps and Add-ons

Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?

Re: Success with Amazon Kinesis Modular Input on local Mac, but why am I getting errors with the same configuration on Splunk Enterprise (Linux)?