Getting Data In

XML parsing is not working as expected, field values are truncating

imsidrai
Explorer

XML parsing is not working as expected, field values are truncating , tried changing truncate values in props but that doesnt help..

Tried with and without KV_MODE as well

props.conf on HF

[iiq_db]
TRUNCATE = 100000
NO_BINARY_CHECK = true
SHOULD_LINEMERGE = false
category = custom
pulldown_type = true
KV_MODE = xml

sample log

 

2021-09-24 14:28:29.011, id="XXXXXXX", created_dt="2021-09-24 08:18:01.87", created="1632489481870", source="RequestHandler", action="provision", target="XXXX", application="Enterprise Directory", account_name="XXXX,ou=XXXXX,ou=XXXX,ou=HO,o=XXX.com", attributes="<Attributes>
<Map>
<entry key="IIQDisabled">
<value>
<Boolean></Boolean>
</value>
</entry>
<entry key="accountFlag" value="ACTIVE"/>
<entry key="cn" value="XXXXX"/>
<entry key="dn" value="uid=XXXX,ou=XXXX,ou=XXXX,ou=HO,o=XXX.com"/>
<entry key="email" value="XX@XX.com"/>
<entry key="employeeNumber" value="XXXXX"/>
<entry key="employeeType" value="E"/>
<entry key="givenname" value="XXXXX"/>
<entry key="globaluid" value="XXX"/>
<entry key="mail" value="(XX0:XX1:XX3:XX0:XX0:XX0:XX0:XX0:XX0:XX0)XX@XX.com"/>
<entry key="mailAccessDomain" value="HO XXX"/>
<entry key="mailRoutingAddress" value="(XX0)EX"/>
<entry key="mailalternateaddress">
<value>
<List>
<String>(XX0:XX11)S=XXXX/G=XXX/OU=XXXX.com</String>
</List>
</value>
</entry>
<entry key="XXUniqueId" value="XYZ"/>
<entry key="XXaccountstatus" value="0"/>
<entry key="XXlcsp1" value="XYZ"/>
<entry key="XXlinteractivep1" value="XYZ"/>
<entry key="XXllcp1" value="XXXXYZ"/>
<entry key="XXlmaildisplayname" value="XY , AB"/>
<entry key="XXlmemberof">
<value>
<List>
<String>cn=Passphrase-Policy-Users,ou=groups,o=XXl.com</String>
</List>
</value>
</entry>
<entry key="XXlprofilechecksum" value="XXXX"/>
<entry key="XXorgmemberof">
<value>
<List>
<String>ou=XXX,ou=XXXX,ou=HO,o=XXl.com</String>
</List>
</value>
</entry>
<entry key="XXworkgroupmanager" value="XXXXXXX"/>
<entry key="nsAccountLock" value="FALSE"/>
<entry key="objectClass">
<value>
<List>
<String>top</String>
<String>person</String>
<String>organizationalperson</String>
<String>inetorgperson</String>
<String>mailrecipient</String>
<String>universaluniqueid</String>
<String>XXlorgperson</String>
</List>
</value>
</entry>
<entry key="op">
<value>
<ObjectOperation>Modify</ObjectOperation>
</value>
</entry>
<entry key="sn" value="XXXX"/>
<entry key="uid" value="XXXX"/>
<entry key="uidns" value="XXXX"/>
<entry key="uuid" value="XXXXX"/>
</Map>
</Attributes>
", string1="Enterprise Directory", string2="committed"

 

imsidrai_0-1632735163694.png

 

Labels (3)
0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

It looks to me like the issue is not to do with the size but to do with the fact that the double quotes in the attributes field have not been escaped, so the attributes field is being terminated at the first double quote in the field.

0 Karma

imsidrai
Explorer

Hi @ITWhisperer 

I am a bit new to splunk , what should i do to avoid that ?

custom extractions?

Thank you 

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

Yes, I think you will need custom extractions

0 Karma

imsidrai
Explorer

@ITWhisperer it would be appreciable if you can point me to something to start with....

 

Thank you 

0 Karma
Get Updates on the Splunk Community!

Enhance Your Splunk App Development: New Tools & Support

UCC FrameworkAdd-on Builder has been around for quite some time. It helps build Splunk apps faster, but it ...

Prove Your Splunk Prowess at .conf25—No Prereqs Required!

Your Next Big Security Credential: No Prerequisites Needed We know you’ve got the skills, and now, earning the ...

Splunk Observability Cloud's AI Assistant in Action Series: Observability as Code

This is the sixth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how to ...