This is driving me nuts 🙂 Trying to index a CSV file which a server creates once an hour (in this case this is DHCP assignment, but can be anything else -- note that I'm not looking for a specific info on bringing in DHCP data, but rather a general answer on CSV indexing). I've created a deployment app for it, with the following conf files. The data is uploaded and is indexed, but the fields aren't extracted in the search (see below screenshot). local\inputs.conf: [batch://C:\users\batchUser\Survery\computer_information.csv] sourcetype = ADSurvey disabled = false index = wineventlog move_policy = sinkhole interval = 5 local\props.conf: [ADSurvey] SHOULD_LINEMERGE = false TRANSFORMS-ADSurvey = dhcp_csv CHECK_METHOD = entire_md5 local\transforms.conf: [dhcp_csv] DELIMS = "," FIELDS = "DNSHostName","IPv4Address","OperatingSystem","SamAccountName","whenCreated","whenChanged","Modified","objectSid","IPv6Address","OperatingSystemVersion" My search doesn't seem to recognize the extracted fields: ... View more

A user is only allowed to log in from one of their AllowedPlatform: userAllowedPlatform.csv | User | AllowedPlatform | +----------+-----------------+ | Mike | PC | +----------+-----------------+ | Mike | iPad | +----------+-----------------+ | Andrew | PC | +----------+-----------------+ | Jennifer | iPad | +----------+-----------------+ | Jennifer | iPhone | The following datasets shows all user activities: | User | PlatformUsed | +----------+--------------+ | Mike | PC | +----------+--------------+ | Mike | iPad | +----------+--------------+ | Mike | iPhone | +----------+--------------+ | Jennifer | iPad | +----------+--------------+ | John | iPhone | To find out who uses a platform that's not AllowedPlatform, I run a simple lookup for Users in the dataset against userAllowedPlatform.csv: index="userLogs" | lookup userAllowedPlatform.csv User AS User, AllowedPlatform as PlatformUsed OUTPUT AllowedPlatform as PlatformUsed_Violation | eval description=if(isnull(PlatformUsed),PlatformUsed_Violation,description) | where NOT len(PlatformUsed_Violation) >1 Which gives me ALL unmatching results: | User | PlatformUsed_Lookup | +------+---------------------+ | Mike | iPhone | +------+---------------------+ | John | iPhone | My goal is perform this but exclude entries that are not part of userAllowedPlatform.csv (John, in this case). I can take the above results and match them again against userAllowedPlatform.csv, this time to remove entries with users that are not in userAllowedPlatform.csv, but this seems to me inefficient and over-complicated. Looking for a simple and efficient way of solving this. ... View more