Developing for Splunk Enterprise

Why am I getting "Could not setup handler 'spmeta' due to missing file 'rh_spmeta.py'" and similar errors, causing a Splunk Web timeout?

hagjos43
Contributor

I'm getting a few errors on the search head and trying to narrow down what the issues are. One thing I noticed on the indexers was a large replication bundle size (150MB). We have quite a few apps so that could be causing the large size. (I've extracted the errors I'm seeing in the splunkd.log and posting them at the bottom).

Here's what I've done so far:
My distsearch.conf on the search head is posted below (note the change I made was the blacklist portion) but it is still sending the contents of the bin folders to the indexers as part of the bundle replication. Am I doing something wrong or do I need to make this change elsewhere?

[distributedSearch:dmc_group_cluster_master]

[distributedSearch:dmc_group_license_master]
servers = server.domain:8089

[distributedSearch:dmc_group_search_head]
servers = localhost:localhost

[distributedSearch:dmc_group_deployment_server]

[distributedSearch:dmc_group_kv_store]

[distributedSearch:dmc_group_indexer]
default = false
servers = server.domain:8089

[replicationSettings]
sendRcvTimeout = 120

[distributedSearch]
disabled = 0

[replicationBlacklist]
noBinDir = (...\bin\*)

ERROR / WARN:

11-25-2015 08:10:50.129 -0500 WARN  DistributedBundleReplicationManager - Asynchronous bundle replication to 2 peer(s) succeeded; however it took too long (longer than 10 seconds): elapsed_ms=186163, tar_elapsed_ms=84934, bundle_file_size=154000KB, replication_id=1448456863, replication_reason="async replication allowed"

11-25-2015 08:12:29.781 -0500 ERROR AdminManager - Could not setup handler 'spmeta' due to missing file 'rh_spmeta.py'.  Please ensure that it is in the bin subdirectory of the appropriate Splunk app path.

11-25-2015 08:12:41.709 -0500 ERROR ExecProcessor - Couldn't start command ""D:\Program Files\Splunk\bin\scripts\splunkd.bat"": The system cannot find the file specified.
11-25-2015 08:12:41.820 -0500 ERROR ExecProcessor - Couldn't start command ""D:\Program Files\Splunk\bin\scripts\spooler.bat"": The system cannot find the file specified.


11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py"" Traceback (most recent call last):
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py", line 76, in <module>
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     process = java.execute("com.splunk.bridge.JavaBridgeServer", [str(os.getpid())])
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\etc\apps\dbx\bin\spp\java\__init__.py", line 148, in execute
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     return JavaProcess(Popen(cmd + self.options + [main_class] + args, **options))
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\Python-2.7\Lib\subprocess.py", line 710, in __init__
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     errread, errwrite)
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\Python-2.7\Lib\subprocess.py", line 958, in _execute_child
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     startupinfo)
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py"" WindowsError: [Error 2] The system cannot find the file specified

11-25-2015 08:12:47.961 -0500 ERROR ApplicationUpdater - Error checking for update, URL=/api/apps:resolve/checkforupgrade: Connect to=https://apps.splunk.com timed out; exceeded 10sec
0 Karma
1 Solution

hagjos43
Contributor
0 Karma

hagjos43
Contributor
0 Karma
.conf21 CFS Extended through 5/20!

Don't miss your chance
to share your Splunk
wisdom in-person or
virtually at .conf21!

Call for Speakers has
been extended through
Thursday, 5/20!