application log collection

[ramkidurai]

Hi,

I would need to setup Spunk to capture/monitor Oracle, people soft application logs. Please let me know whether a forwarder has to be installed on the servers running those applications. Any modification(user activity) done on those applications needs to be captured.

Also let me know whether the daily log size limit(500MB) will cause issue, in collecting the live data.

Thanks,
Ramesh

[thesteve]

Installing a forwarder is the best practice. You can obtain information without a forwarder, but it's not nearly as straightforward.

You can filter the data that you send to try to keep under the 500mb limit. http://docs.splunk.com/Documentation/Splunk/6.0.1/Forwarding/Routeandfilterdatad Whether PeopleSoft and Oracle logs will exceed that amount on a regular basis, I imagine it won't, but there are times when detailed logs are enabled for troubleshooting and whatnot where 500mb isn't all that much.

It should be noted that you cannot filter data using a light forwarder. Light forwarders don't use transforms.conf and don't fully parse the incoming data.

[alacercogitatus]

Ramesh - are you familiar with how Splunk collects data?

Community Doc: https://wiki.splunk.com/Community:Getting_data_into_Splunk

The daily log size limit depends on your environment. My guess: It will violate that everyday. Oracle and People soft is not a small data task. If you have enterprise support - use it, they are very helpful.

[ramkidurai]

Thanks for providing the link, I am going through it.

I do understand it will exceed the limit. But I thought of asking whether is there any solution to filter specific events for particular time duration, so that it may not violate the size limit(requirement is to receive some application log data).