topic Re: Configure multiple LINE_BREAKER strings? in Getting Data In

Configure multiple LINE_BREAKER strings?

woodcock — Tue, 06 Dec 2011 20:17:53 GMT

I have line breaks signified by 2 different strings.

This works (keeping BK1 text as part of next event):

LINE_BREAKER = ([\r\n]+)(BK1)

This works (discarding BK2 text as part of breaker):

LINE_BREAKER = ([\r\n]+BK2)

But this does not work:

LINE_BREAKER = (?:([\r\n]+)(BK1))|(?:([\r\n]+BK2))

I assume this doesn't work because the 3 captures are taken as $1, $2 and $3 (and $3 is undefined as far as LINE_BREAKER REGEX goes) instead of as $1, $2v1, $2v2.

Re: Configure multiple LINE_BREAKER strings?

_d_ — Tue, 06 Dec 2011 20:47:50 GMT

Give this a try:

LINE_BREAKER = ([\r\n]+BK2)|([\r\n]+)(?=BK1)

Hope this helps.

> please upvote and accept answer if you find it useful - thanks!

Re: Configure multiple LINE_BREAKER strings?

fairoldi — Thu, 15 Dec 2011 08:27:20 GMT

You can try:

LINE_BRAKER=([\r\n]+(?=BK1)|[\r\n]+BK2)

However this is subject to lookahead limitations: if I remember correctly this means you can not use +,? and * in BK1 (not sure about {n})

Re: Configure multiple LINE_BREAKER strings?

Ayn — Thu, 15 Dec 2011 09:05:11 GMT

I find that dealing with LINE_BREAKER settings tends to get messy when often it's simpler and equally effective to achieve the same thing by configuring proper line merging settings instead. Have you investigated that option?

Re: Configure multiple LINE_BREAKER strings?

woodcock — Sat, 06 Jun 2015 05:18:35 GMT

No worky; this completely ate the records starting with BK1 (for the same $1/$2/$3 reason/problem).

Re: Configure multiple LINE_BREAKER strings?

woodcock — Wed, 02 May 2018 22:00:15 GMT

Using LINE_BREAKER if it is a valid option, is always the most efficient impact on the Indexer, so I always start there.