Getting Data In

Can we use heavy forwarder so the output can be send to Logstash host and port? No way to stream data to AWS Kinesis?

nikk
Engager

Hi everyone, 

I am trying to redirect logs from Splunk Enterprise locally installed to OpenSearch Logstash or to Aws Kinesis. 

I am quite new to Splunk so it brings troubles in getting the idea how it can be achieved. 
Am I right ? : 
1. We can use heavy forwarder so the output can be send to Logstash host and port ? 
2. No way to stream data to Aws Kinesis even with add-ons nither CLI nor Web Splunk. 

Probably it is possible to use splunk sdk / api for getting stream of data so it can be programmatically transferred to Kinesis by aws jdk. 

I hope someone has some experience with it. 

Thanks ! 

Labels (3)
0 Karma
1 Solution

VatsalJagani
SplunkTrust
SplunkTrust

@nikk - Answers to your questions below: 

  1. Yes, you need to use HF
    1. Reference - https://docs.splunk.com/Documentation/Splunk/latest/Forwarding/Forwarddatatothird-partysystemsd
  2. Splunk Add-on for AWS is to collect the data in Splunk from AWS, not to send data to AWS Kinesis
    1. To do that you could use the above-given reference
    2. forward the data to another Linux machine
    3. write a custom script to retrieve the data being sent on a port by Splunk
    4. and send it to AWS Kinesis

 

I hope this helps!!! Kindly upvote if it does!!!

View solution in original post

VatsalJagani
SplunkTrust
SplunkTrust

@nikk - Answers to your questions below: 

  1. Yes, you need to use HF
    1. Reference - https://docs.splunk.com/Documentation/Splunk/latest/Forwarding/Forwarddatatothird-partysystemsd
  2. Splunk Add-on for AWS is to collect the data in Splunk from AWS, not to send data to AWS Kinesis
    1. To do that you could use the above-given reference
    2. forward the data to another Linux machine
    3. write a custom script to retrieve the data being sent on a port by Splunk
    4. and send it to AWS Kinesis

 

I hope this helps!!! Kindly upvote if it does!!!

Get Updates on the Splunk Community!

.conf24 | Personalize your .conf experience with Learning Paths!

Personalize your .conf24 Experience Learning paths allow you to level up your skill sets and dive deeper ...

Threat Hunting Unlocked: How to Uplevel Your Threat Hunting With the PEAK Framework ...

WATCH NOWAs AI starts tackling low level alerts, it's more critical than ever to uplevel your threat hunting ...

Splunk APM: New Product Features + Community Office Hours Recap!

Howdy Splunk Community! Over the past few months, we’ve had a lot going on in the world of Splunk Application ...