Splunk Search

How to combine multivalue fields of different lengths?

dethaspagan
New Member

So I am trying to figure out how to separate out multi value fields of different lengths. The problem is that mvzip will use the previous value when one value runs out instead of placing null. For example

If I have

TransID            ProductID        ProductPropertyB        ProductPropertyC      ProductPropertyD 
001                     P003             B1                  C1                       D1
                        P004             B2                  C3                       D2
                        P005             B4                  C2
                        P006             B2                  C2
002                     P003             B2                  C1                       D3
                        P005             B4                  C2                       D3

Using the following code

| eval reading=mvzip(ProductID, ProductPropertyB)    
| eval reading=mvzip(reading, ProductPropertyC)
| eval reading=mvzip(reading, ProductPropertyD)
| mvexpand reading                    
| makemv reading delim=","           
| eval ProductID=mvindex(reading, 0)      
| eval ProductPropertyB=mvindex(reading, 1)      
| eval ProductPropertyC=mvindex(reading, 2)    
| eval ProductPropertyD=mvindex(reading, 3)  
| table TransID,ProductID,ProductPropertyB,ProductPropertyC,ProductPropertyD

evaluates to

TransID            ProductID        ProductPropertyB        ProductPropertyC      ProductPropertyD 
001                     P003             B1                  C1                       D1
001                     P004             B2                  C3                       D2
001                     P005             B4                  C2                       D2
001                     P006             B2                  C2                       D2
002                     P003             B2                  C1                       D3
002                     P005             B4                  C2                       D3

when I want

TransID            ProductID        ProductPropertyB        ProductPropertyC      ProductPropertyD 
001                     P003             B1                  C1                       D1
001                     P004             B2                  C3                       D2
001                     P005             B4                  C2                       Null
001                     P006             B2                  C2                       Null
002                     P003             B2                  C1                       D3
002                     P005             B4                  C2                       D3

So how can I achieve this?

0 Karma

somesoni2
Revered Legend

Give this a try

your current search giving first output
| fillnull value="NULL"
| eval reading=mvzip(ProductID, ProductPropertyB)    
 | eval reading=mvzip(reading, ProductPropertyC)
 | eval reading=mvzip(reading, ProductPropertyD)
 | mvexpand reading                    
 | makemv reading delim=","           
 | eval ProductID=mvindex(reading, 0)      
 | eval ProductPropertyB=mvindex(reading, 1)      
 | eval ProductPropertyC=mvindex(reading, 2)    
 | eval ProductPropertyD=mvindex(reading, 3)  
 | table TransID,ProductID,ProductPropertyB,ProductPropertyC,ProductPropertyD
| foreach * [eval <<FIELD>>=if('<<FIELD>>'="NULL",null(),'<<FIELD>>') ]

gvmorley
Contributor

Hi,

I put your original data from the question into a CSV for testing, then did:

| from inputlookup:"test-mvzip.csv" 
| table TransID,ProductID,ProductPropertyB,ProductPropertyC,ProductPropertyD 
| streamstats last(TransID) as TransID

Which produces the table:

alt text

You'd want to test it with your original data and Search. But I hope that helps.

0 Karma
Get Updates on the Splunk Community!

Index This | What did the zero say to the eight?

June 2025 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with this month’s ...

Splunk Observability Cloud's AI Assistant in Action Series: Onboarding New Hires & ...

This is the fifth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how to ...

Now Playing: Splunk Education Summer Learning Premieres

It’s premiere season, and Splunk Education is rolling out new releases you won’t want to miss. Whether you’re ...