Getting Data In

Is anyone using splunk to monitor NIFI logs in AWS?

Log_wrangler
Builder

I have a few nifi nodes (on EC2 instances) running in AWS.
I use nifi to process data into s3.

I am looking for a way to splunk the /nifi-app.log (logs) for warning, errors, failures, etc.
I am thinking about putting a UF on each of the nifi nodes/EC2 and sending the data to the indexers.

Any advice on this scenario is appreciated.

Thank you

Tags (2)
0 Karma
1 Solution

Log_wrangler
Builder

well this seems to be the way, I will let you know if there are any issues.

View solution in original post

0 Karma

jamessevenerlmc
New Member

Another option would be to use the splunk java logging framework. Drop in the jar file, add the stanza to your logback.conf and you're all set!
http://dev.splunk.com/view/splunk-logging-java/SP-CAAAE2K

0 Karma

Log_wrangler
Builder

well this seems to be the way, I will let you know if there are any issues.

0 Karma
Get Updates on the Splunk Community!

Take Your Breath Away with Splunk Risk-Based Alerting (RBA)

WATCH NOW!The Splunk Guide to Risk-Based Alerting is here to empower your SOC like never before. Join Haylee ...

SignalFlow: What? Why? How?

What is SignalFlow? Splunk Observability Cloud’s analytics engine, SignalFlow, opens up a world of in-depth ...

Federated Search for Amazon S3 | Key Use Cases to Streamline Compliance Workflows

Modern business operations are supported by data compliance. As regulations evolve, organizations must ...