Limiting ingested fields in Azure Event Hubs

[zippo706]

I"d like to send audit data through an event hub.   However, i want my heavy fwd'r to not send all fields to splunk as 75% of is will be useless and take up all my ingesting quota. 

Is there an easy way to do this?  The data coming in is Azure SQL where i don't beleive i can change data going into the hub.

[richgalloway]

If you want to discard entire events, see https://docs.splunk.com/Documentation/Splunk/8.0.5/Forwarding/Routeandfilterdatad#Filter_event_data_...

If you want to discard parts of events, use SEDCMD in props.conf.

[mysourcetype]
SEDCMD-winevent = s/This event is generated.*//

[zippo706]

Thanks for the info.   can i discard or manipulate fields in an event.   I'm going to speak logstash here and mutate to delete "reallybigfieldIdon'tcareabout"

[richgalloway]

Yes, you can do that with SEDCMD. It will be on the raw event, however, since fields haven't been extracted when SEDCMD runs.

[zippo706]

Thank you, much appreciated.