Getting Data In

How to ingest only those lines from the log that start with "date/time"

mlevsh
Builder

We have logs , where first few lines needs to be omitted from ingesting.
We only need to on-board the events , that start with the date/time in the following format:
"%m/%d/%Y@%H:%M"

Appreciate all the ideas and suggestions.


Here is  the log example (there are also empty lines
before first "#-----------------------------------------" and
after last "#-----------------------------------------"):



      #-----------------------------------------
      #DATE CREATED:  11/02/2021@04:16
      #SUBJECT:       REPORT ON THE GENERAL STATUS OF AUTOSYS JOBS
      #ENVIRONMENT:   CBA
      #-----------------------------------------

      11/02/2021@04:16,CBA,OTHER,CBA_CLIENT_REPORT_BOX,OI
      11/02/2021@04:16,CBA,OTHER,CBA_copy_file_job,OI
      11/02/2021@04:16,CBA,OTHER,CBA_ABC_SCHEDULER_BOX,OI
      11/02/2021@04:16,CBA,OTHER,CBA_ABC_REPORT_BOX,OI

Labels (2)
Tags (1)
0 Karma

badrinath_itrs
Communicator

@mlevsh , This question is already answered in the past. 

Can you please look into below link and see that helps. 

Ignoring-any-data-record-that-begins-with-a-quot-quot-character

You can do this with props and Transforms as mentioned in the above post. 

0 Karma
Get Updates on the Splunk Community!

Cultivate Your Career Growth with Fresh Splunk Training

Growth doesn’t just happen—it’s nurtured. Like tending a garden, developing your Splunk skills takes the right ...

Introducing a Smarter Way to Discover Apps on Splunkbase

We’re excited to announce the launch of a foundational enhancement to Splunkbase: App Tiering.  Because we’ve ...

How to Send Splunk Observability Alerts to Webex teams in Minutes

As a Developer Evangelist at Splunk, my team and I are constantly tinkering with technology to explore its ...