My application generates around 100,000 files per day. Although I tested to index them by monitoring files, it took almost a week. Anybody know cause of the issue and solution? I think it will be improved if number of active log files were not so many, but I have to do so in our environment.
There is no hard limit and it will require some testing to discover the breaking point. This question, looking for the same answer, basically says the same:
How are the files being written now? Are they in separate directories? Is there a naming convention?