https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300101#M93707 <P>Could you recommend me the best platform to do this?</P> Wed, 22 Nov 2017 16:01:12 GMT mahbs 2017-11-22T16:01:12Z https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300097#M93703 <P>Hi,</P> <P>I need to be able to validate the format of a file. This entails checking if a date column is actually a date column and if the format of the date value is in the correct format.<BR /> I'm not concerned with the content of the data, i.e. im not validating the content, rather I'm more focused on the structure of the data.</P> <P>Does splunk allow this? And if so how would I go about achieving this?</P> <P>Thanks</P> Tue, 21 Nov 2017 17:40:54 GMT https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300097#M93703 mahbs 2017-11-21T17:40:54Z https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300098#M93704 <P>Splunk recognizes lots of file formats (<A href="https://docs.splunk.com/Documentation/Splunk/7.0.0/Data/Listofpretrainedsourcetypes">https://docs.splunk.com/Documentation/Splunk/7.0.0/Data/Listofpretrainedsourcetypes</A>)</P> <P>If your file is something unique to your business then I suggest that you make sure that whatever process which creates it does so correctly.</P> Tue, 21 Nov 2017 19:12:38 GMT https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300098#M93704 lycollicott 2017-11-21T19:12:38Z https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300099#M93705 <P>Hi,</P> <P>I'm focused mainly on writing queries that basically validates whether a file is in the correct format and then outputting those files that fail validation. I'm not focused on the content, rather the structure - Does Splunk enable this?</P> Wed, 22 Nov 2017 13:37:58 GMT https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300099#M93705 mahbs 2017-11-22T13:37:58Z https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300100#M93706 <P>No splunk does not do this. However you can write a script outside splunk and use that script to validate the file meets the format you want before moving it to a folder splunk is ingesting. This is the work around i used to get around files with weird or unreadable formats to splunk</P> Wed, 22 Nov 2017 15:49:06 GMT https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300100#M93706 afamoyib 2017-11-22T15:49:06Z https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300101#M93707 <P>Could you recommend me the best platform to do this?</P> Wed, 22 Nov 2017 16:01:12 GMT https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300101#M93707 mahbs 2017-11-22T16:01:12Z https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300102#M93708 <P>No, it does not. You would have to do that externally.</P> Thu, 23 Nov 2017 16:09:43 GMT https://community.splunk.com/t5/Getting-Data-In/Does-Splunk-allow-you-to-validate-structure-of-a-file/m-p/300102#M93708 lycollicott 2017-11-23T16:09:43Z