Getting Data In

Why UF think my file is binary?

yutaka1005
Builder

In my environment, UF monitors the file and forwards it to Splunk.

It was able to capture the file without problems before,
Due to the version upgrade of software that outputs log that was being monitored,
and the character code is changed from Shift_jis to utf-16LE (with BOM), it is no longer imported.

When checking the internal log of UF, message saying "it was a binary file, so ignored it".

Is this a bug?
Is there any workaround other than updating?

If anyone knows, it would be greatly appreciated if you could tell me.

UF ver: 6.2.0

0 Karma
1 Solution

mayurr98
Super Champion

hey

specify this attribute in props.conf

[host::my-foreign-docs]
CHARSET=AUTO

http://docs.splunk.com/Documentation/Splunk/6.3.3/data/Configurecharactersetencoding#Automatically_s...

Also put this

NO_BINARY_CHECK = [true|false]
* When set to true, Splunk processes binary files.
* Can only be used on the basis of [<sourcetype>], or [source::<source>],
  not [host::<host>].
* Defaults to false (binary files are ignored).
* This setting applies at input time, when data is first read by Splunk.
  The setting is used on a Splunk system that has configured inputs
  acquiring the data.

let me know if this helps!

View solution in original post

0 Karma

mayurr98
Super Champion

hey

specify this attribute in props.conf

[host::my-foreign-docs]
CHARSET=AUTO

http://docs.splunk.com/Documentation/Splunk/6.3.3/data/Configurecharactersetencoding#Automatically_s...

Also put this

NO_BINARY_CHECK = [true|false]
* When set to true, Splunk processes binary files.
* Can only be used on the basis of [<sourcetype>], or [source::<source>],
  not [host::<host>].
* Defaults to false (binary files are ignored).
* This setting applies at input time, when data is first read by Splunk.
  The setting is used on a Splunk system that has configured inputs
  acquiring the data.

let me know if this helps!

0 Karma

yutaka1005
Builder

Thank you for answer mayurr98.

As a result of setting like below,
similar events did not recur.

[<sourcetype name>]
CHARSET=utf-16le
NO_BINARY_CHECK = true

It was very helpful!

0 Karma

inventsekar
SplunkTrust
SplunkTrust

Good discussions at https://answers.splunk.com/answers/373137/why-does-splunk-think-my-file-is-binary.html

thanks and best regards,
Sekar

PS - If this or any post helped you in any way, pls consider upvoting, thanks for reading !
0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...