How to extract data from logfiles in XML format?

chezbert — Tue, 24 Jun 2014 14:53:20 GMT

I have set up a universal forwarder to monitor my
server logfile. The file is written in XML format
and thus has a header and footer of:

<?xml version="1.0" encoding="UTF-8"?><rps_logfile version="1.0">

and:

</rps_logfile>

respectively.

As the server produces log output, it appends to the file by
backing up over the footer, writing the new entry, and re-writing
the footer.

This causes the universal forwarder to send redundant information
and the splunkd receiving the data seems to get confused sometimes.

What are my options for having the header & footer ignored or
having the forwarder send only the truly new information?

Re: How to extract data from logfiles in XML format?

chezbert — Wed, 25 Jun 2014 11:11:51 GMT

I decided to indulge in a preprocessing approach.