topic Re: join is skipping rows in Getting Data In

join is skipping rows

jiaqya — Fri, 10 May 2019 14:18:17 GMT

csv files has 70k entries and when i join it with index which has 30k rows, it fails to join random records even when data is available.

when i specify the record before and after join it picks up the value.

any idea if this is due to any kind of limitation.

Re: join is skipping rows

richgalloway — Fri, 10 May 2019 14:33:28 GMT

Which form of join are you using? Please share your query.

Re: join is skipping rows

jiaqya — Fri, 10 May 2019 14:36:36 GMT

join type=left [|inputlookup

Re: join is skipping rows

koshyk — Fri, 10 May 2019 14:37:54 GMT

You need to put the "KEY" which are you joining upon

so
| join type=left COMMONKEY [|inputlookup ..

Re: join is skipping rows

jiaqya — Fri, 10 May 2019 14:39:41 GMT

yes correct, i have used it the same same.
i get results for some records from the file and some i do not..

Re: join is skipping rows

Vijeta — Fri, 10 May 2019 14:57:56 GMT

@jiaqya It may be due to subsearch limitation of 10K records, hence your join subsearch is not returning all records. You should try avoiding the join and use lookup command instead.

Re: join is skipping rows

woodcock — Fri, 10 May 2019 20:09:16 GMT

Join is subject to subsearch and RAM limits. Do not use it. Use ... | stats values(*) AS * BY <joinerfield here> instead.