Getting Data In

Is anyone using splunk to monitor NIFI logs in AWS?

Log_wrangler
Builder

I have a few nifi nodes (on EC2 instances) running in AWS.
I use nifi to process data into s3.

I am looking for a way to splunk the /nifi-app.log (logs) for warning, errors, failures, etc.
I am thinking about putting a UF on each of the nifi nodes/EC2 and sending the data to the indexers.

Any advice on this scenario is appreciated.

Thank you

Tags (2)
0 Karma
1 Solution

Log_wrangler
Builder

well this seems to be the way, I will let you know if there are any issues.

View solution in original post

0 Karma

jamessevenerlmc
New Member

Another option would be to use the splunk java logging framework. Drop in the jar file, add the stanza to your logback.conf and you're all set!
http://dev.splunk.com/view/splunk-logging-java/SP-CAAAE2K

0 Karma

Log_wrangler
Builder

well this seems to be the way, I will let you know if there are any issues.

0 Karma
Get Updates on the Splunk Community!

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...

Updated Team Landing Page in Splunk Observability

We’re making some changes to the team landing page in Splunk Observability, based on your feedback. The ...