Security

Why do we get the exited with code 255 error for each indexer?

danielbb
Motivator

When running | datamodel Intrusion_Detection search I get the following error message for each indexer -

[<indexer name>] Search process did not exit cleanly, exit_code=255, description="exited with code 255". Please look in search.log for this peer in the Job Inspector for more info. 

What can it be?

Tags (1)
0 Karma

MuS
Legend

Hi danielbb,

check the OS logs of your indexer, one of the reasons for this can be that your search job was killed by OOM (Out of Memory) Killer .. assuming you are running the indexers on nix.

cheers, MuS

danielbb
Motivator

@MuS, I've been working with Support on that and we found out that all the indexers throw the following error -

-- 10-16-2019 16:03:39.534 ERROR SearchParser - The search specifies a macro varonis_index that cannot be found. Reasons include: the macro name is misspelled, you do not have "read" permission for the macro, or the macro has not been shared with this application. Click Settings, Advanced search, Search Macros to view macro information.

We also saw that when running index=_internal, we see the same error (many times), but in the case of index=_internal, this error doesn't prevent the command from completing its work and display the results.

A similar thread at ERROR SearchParser - The search specifies a macro 'cs_get_index' that cannot be found.

0 Karma

danielbb
Motivator

Support is saying that every search I submit is checked against my eventtype.confs

0 Karma

danielbb
Motivator
0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...