All Posts

Find Answers
Ask questions. Get answers. Find technical product solutions from passionate members of the Splunk community.

All Posts

We have heavy forwarder that accept logs over HEC.  inputs.conf  [http://dd-log-token1] index= ddlogs1 token = XXXXX XXX XXX XXX [http://dd-log-token2] index= ddlogs2 token = XXXXX XXX X... See more...
We have heavy forwarder that accept logs over HEC.  inputs.conf  [http://dd-log-token1] index= ddlogs1 token = XXXXX XXX XXX XXX [http://dd-log-token2] index= ddlogs2 token = XXXXX XXX XXX XXX [http://dd-log-token3] index= ddlogs3 token = XXXXX XXX XXX XXX ________________________________ I want to forward only below inputs to 2 different splunk Instances - 1- splunkCloud (hosted by Splunk) 2-SplunkOnPrem  [http://dd-log-token2] index= ddlogs2 token = XXXXX XXX XXX XXX   ________________________________ This is my inputs.conf looks like  inputs.conf  [http://dd-log-token1] index= ddlogs1 token = XXXXX XXX XXX XXX [http://dd-log-token2] index= ddlogs2 token = XXXXX XXX XXX XXX outputgroup = splunkonprem, splunkcloud [http://dd-log-token3] index= ddlogs3 token = XXXXX XXX XXX XXX _____________ outputs.conf  [tcpout] defaultgroup = splunkonprem,splunkcloud  forceTimebasedAutoLB = true  [tcpout: splunkonprem] server= zyx.com:9997, abc.com:9997 [tcpout: splunkonprem] server= mmm.com:9997, bbb.com:9997 But these settings are only sending logs to Onprem indexers not to SplunkCloud indexers. Please suggest if any idea whats wrong with my configuration.
This just makes things confusing - why do the RPM and DEB versions (both x86 and ARM) and Windows of v9.3.3 have build hash `75595d8f83ef`, but when you look at the solaris UFs, the build hash is  `7... See more...
This just makes things confusing - why do the RPM and DEB versions (both x86 and ARM) and Windows of v9.3.3 have build hash `75595d8f83ef`, but when you look at the solaris UFs, the build hash is  `740e48416363` ?! What gives? This just makes our lives more difficult when trying to organize large-scale downloads for users in a heterogeneous environment...
The documentation that you refer to has them both in the same stanza, in steps 3 and 4: Break and reassemble the data stream into events This method oftentimes simplifies the configuration process,... See more...
The documentation that you refer to has them both in the same stanza, in steps 3 and 4: Break and reassemble the data stream into events This method oftentimes simplifies the configuration process, as it gives you access to several settings that you can use to define line-merging rules. You must perform these steps on the heavy forwarder that you have designated to send data to your Splunk Cloud Platform instance. On the forwarder that is to send data to your Splunk Cloud Platform instance, use a text editor to open $SPLUNK_HOME/etc/system/local/props.conf for editing. In this file, specify a stanza in the props.conf configuration file that represents the stream of data you want to break and reassemble into events. In that stanza, configure the LINE_BREAKER setting with a regular expression that breaks the data stream into multiple lines. Add the SHOULD_LINEMERGE setting to the stanza, and set its value to true. Configure additional line-merging settings, such as BREAK_ONLY_BEFORE and others, to specify how the forwarder is to reassemble the lines into events. For more information on the line-merging settings, see Attributes that apply only when the SHOULD_LINEMERGE setting is true later in this topic. If your data conforms well to the default LINE_BREAKER value, which is any number of newlines and carriage returns, you don't need to change the LINE_BREAKER setting. Instead, set SHOULD_LINEMERGE=true and use the line-merging settings to reassemble the data.
Splunk gives validation warnings that unknown node submit not allowed here. Is there's any fixes for this <form version="1.1" theme="dark"> <!-- Fieldset for dropdown input --> <fieldset submitBut... See more...
Splunk gives validation warnings that unknown node submit not allowed here. Is there's any fixes for this <form version="1.1" theme="dark"> <!-- Fieldset for dropdown input --> <fieldset submitButton="true" autoRun="true"> <input type="dropdown" token="A_or_B" searchWhenChanged="false"> <label>Select A or B</label> <default>A</default> <choice value="A">A</choice> <choice value="B">B</choice> </input> </fieldset> <!-- Submit block, should be placed directly inside form --> <submit> <condition match="$A_or_B$ == &quot;A&quot;"> <set token="tokenX">1</set> <set token="tokenY">2</set> </condition> <condition match="$A_or_B$ == &quot;B&quot;"> <set token="tokenX">3</set> <set token="tokenY">4</set> </condition> </submit> Microsoft 365 App for Splunk 
Following for I need to do this soon as well... hope you figure it out so I can
Short question: can I configure my window UF inputs.conf to collect Security Event logs as renderXML=false , unless it is EventCode=4662, if EventCode=4662 then I want renderXML=true inputs.conf fi... See more...
Short question: can I configure my window UF inputs.conf to collect Security Event logs as renderXML=false , unless it is EventCode=4662, if EventCode=4662 then I want renderXML=true inputs.conf file [WinEventLog://Security] disabled = 0 index = wineventlog start_from = oldest current_only = 0 evt_resolve_ad_obj = 1 checkpointInterval = 5 renderXml=false #(if EventCode=4662 then set renderXML=true   I read maybe a transform.conf would help with this...?   Explanation for this configuration request is so that I can utilized this Search for DCSync attacks provided by Enterprise Splunk Security, of which only seems to work with XML ingested Security Event 4662... : ESCU - Windows AD Replication Request Initiated by User Account - Rule `wineventlog_security` EventCode=4662 ObjectType IN ("%{19195a5b-6da0-11d0-afd3-00c04fd930c9}","domainDNS") AND Properties IN ("*Replicating Directory Changes All*", "*{1131f6ad-9c07-11d1-f79f-00c04fc2dcd2}*","*{9923a32a-3607-11d2-b9be-0000f87a36b2}*","*{1131f6ac-9c07-11d1-f79f-00c04fc2dcd2}*") AND AccessMask="0x100" AND NOT (SubjectUserSid="NT AUT*" OR SubjectUserSid="S-1-5-18" OR SubjectDomainName="Window Manager" OR SubjectUserName="*$") | stats min(_time) as _time, count by SubjectDomainName, SubjectUserName, Computer, Logon_ID, ObjectName, ObjectServer, ObjectType, OperationType, status dest | rename SubjectDomainName as Target_Domain, SubjectUserName as user, Logon_ID as TargetLogonId, _time as attack_time | appendpipe [| map search="search `wineventlog_security` EventCode=4624 TargetLogonId=$TargetLogonId$" | fields - status] | table attack_time, AuthenticationPackageName, LogonProcessName, LogonType, TargetUserSid, Target_Domain, user, Computer, TargetLogonId, status, src_ip, src_category, ObjectName, ObjectServer, ObjectType, OperationType, dest | stats min(attack_time) as _time values(TargetUserSid) as TargetUserSid, values(Target_Domain) as Target_Domain, values(user) as user, values(Computer) as Computer, values(status) as status, values(src_category) as src_category, values(src_ip) as src_ip by TargetLogonId dest
I configured the DEBUG logs and will hopefully have more to go off next week. One thing I thought I'd bring up is some confusion regarding the Certificate Profile, Subject Alternative Names (SANs) an... See more...
I configured the DEBUG logs and will hopefully have more to go off next week. One thing I thought I'd bring up is some confusion regarding the Certificate Profile, Subject Alternative Names (SANs) and Extended Key Usage we should be specifying when we send our CSRs to the high-side PKI portal.  Certificate Profiles We have a few certificate profiles to choose from, including: device, domain controller, device/TLS/Application Email, Mini Crypto Key Agreement, Encrypted File System, IPSEC, Mini Crypro Authentication, Robotic Process (RPA/BO), and what seemed to be the most fitting, TLS Server.  Subject Alternative Names (loopback?) From there, we've been defining the Subject Alternative Name which makes the most sense, the device IP dress. However, I'm being told we should be using 127.0.0.1 instead - what's your take on that? Key Usage/Extended Key Usage Selections When selecting the TLS Server certificate profile, the default Key Usages are selected:  Key Usage: digitalSignature keyEncipherment Extended Key Usage: id-kp-serverAuth I'm being told that we need to include Extended Keys for smartCardAuth and possibly  id-kp-clientAuth. The problem is that when we select additional keys for the TLS Server profile the portal, instead automatically approving the CSR, kicks it back with the following error: "An extended key usage was found that requires the certificate application to be queued. EKU for "smarCardLogon" for profile "tlsServer" requires the certificate application to be queued"  This MASSIVELY slows down the troubleshooting process, making it quite difficult to iteratively troubleshoot (not Splunk's problem, but I needed to lament the hardship). I know this is a LOT and truly appreciate everyone's help on this. Some my peers have been trying to figure this our for over a year! If we can figure this out it'd be a massive win for whole bunch of burnt out sys admins     goal/tl:dr - confirm the minimal, PKI-approved certificate profile, SAN list, and EKU set that Splunk Web needs for CAC / SIPR-token authentication, so we can eliminate certificate-format variables from our troubleshooting.  Thanks again!
@livehybrid  if i remove [] its just creating dummy logs with path its not actually searching result. like below 4/23/25 9:36:05.515 AM   04-23-25 09:36:05,515 [3820] DEBUG Common <> - S... See more...
@livehybrid  if i remove [] its just creating dummy logs with path its not actually searching result. like below 4/23/25 9:36:05.515 AM   04-23-25 09:36:05,515 [3820] DEBUG Common <> - Started thread  FileSource = *\\test\\abc\\test\\xyz\\abc\\123\\ITEM\\* eventtype = exclude_known_allowed host = test index = test linecount = 1
Hi @Ana_Smith1  Both of those apps are Archived and unsupported - I would suggest looking at https://splunkbase.splunk.com/app/6168 which is still in active development by the developer. This will a... See more...
Hi @Ana_Smith1  Both of those apps are Archived and unsupported - I would suggest looking at https://splunkbase.splunk.com/app/6168 which is still in active development by the developer. This will allow you to run JQL queries to pull back your data, you could set this up as 10 different inputs for your 10 projects, or write a JQL query to pull all 10 back in one go.  Did this answer help you? If so, please consider: Adding karma to show it was useful Marking it as the solution if it resolved your issue Commenting if you need any clarification Your feedback encourages the volunteers in this community to continue contributing
Hi @sanjai  How odd - which version of Splunk are you running and on what OS/Arch? If you navigate to $SPLUNK_HOME/etc/apps/search/appserver/static/ do you have a appIcon.png ?  Did this answer ... See more...
Hi @sanjai  How odd - which version of Splunk are you running and on what OS/Arch? If you navigate to $SPLUNK_HOME/etc/apps/search/appserver/static/ do you have a appIcon.png ?  Did this answer help you? If so, please consider: Adding karma to show it was useful Marking it as the solution if it resolved your issue Commenting if you need any clarification Your feedback encourages the volunteers in this community to continue contributing
Hi @CarlosNoob  If you want to be able to update apps from within your Splunk server's apps list then you need to enable the server to access https://apps.splunk.com/  which is details in server.con... See more...
Hi @CarlosNoob  If you want to be able to update apps from within your Splunk server's apps list then you need to enable the server to access https://apps.splunk.com/  which is details in server.conf. If you want the update notifications, *or to access docs* linked from various parts of Splunk then the server needs to be able to access http://quickdraw.splunk.com - this is detailed in web.conf here. Note - Splunk HF/Enterprise does not have the ability to update itself, it can only notify you of an update. You would need to download the packages from https://splunk.com/download  Did this answer help you? If so, please consider: Adding karma to show it was useful Marking it as the solution if it resolved your issue Commenting if you need any clarification Your feedback encourages the volunteers in this community to continue contributing
Gravedigging for karma / answering questions left unanswered: This would be set in most cases on the receiving indexers props.conf.  And you are very right, in no case should ../default/ be mod... See more...
Gravedigging for karma / answering questions left unanswered: This would be set in most cases on the receiving indexers props.conf.  And you are very right, in no case should ../default/ be modified. Create a ../local/ or a whole new app if you'd like with a ../local/props.conf If all you do is modify a local props.conf by adding a sourcetype stanza with TZ, there's no requirement to restart splunk, it should detect that change on its own.
Just wanted to report, the problem has been solved. Everything remained same, I just restarted rsyslog and I started seeing logs on the rsyslog server; when in doubt, reboot seemed to have worked her... See more...
Just wanted to report, the problem has been solved. Everything remained same, I just restarted rsyslog and I started seeing logs on the rsyslog server; when in doubt, reboot seemed to have worked here
Thank you @gcusello, this makes perfect sense, I'll go ahead and create a distinct app that would be deployed only on one of the HFs, much appreciated.
try this: on the app.conf file add below stanza: [ui] is_visible = true show_app_dark_theme = true
we've ran into two odd issues when testing a Shibboleth implementation, but I'm not sure if they are related. AQRs are setup so users are not cached, we noticed that a user without content only show ... See more...
we've ran into two odd issues when testing a Shibboleth implementation, but I'm not sure if they are related. AQRs are setup so users are not cached, we noticed that a user without content only show on a search head the load balancer has sent them to and therefore content cannot be assigned to them unless they've accessed all the search heads. along the content line, replicate certificates does not do what it says. it does not replicate the idp cert across the search heads, but as soon as that was enabled does content, users, and saml groups replicate peer-to-peer. I assume we have an incorrect setting in place, but any help is very much appreciated!
If you are not seeing failed logins in your splunkd.log, you can try updating the log.cfg or log-local.cfg file to add debugging.  This should give you more information in the splunkd.log.  The log.c... See more...
If you are not seeing failed logins in your splunkd.log, you can try updating the log.cfg or log-local.cfg file to add debugging.  This should give you more information in the splunkd.log.  The log.cfg/log-local.cfg file is located in the .../splunk/etc directory.   Find "category.AuthenticationProviderLDAP=INFO" and change INFO to DEBUG. Restart the Splunk service. This should at least give you the username it is finding.  There may be other options you can change to DEBUG to give you more information.
Splunk doesn't automatically update online - you have to manually download a new version and upload it to server(s). The sources for app downloads are listed in https://docs.splunk.com/Documentatio... See more...
Splunk doesn't automatically update online - you have to manually download a new version and upload it to server(s). The sources for app downloads are listed in https://docs.splunk.com/Documentation/Splunk/latest/Admin/Serverconf#Remote_applications_configuration_.28e.g._SplunkBase.29
I'm going to try and push through today but I reckon I'll be in the same place Monday. I really appreciate your help so far and would be so grateful if dig in deeper next week. Thanks again and enjoy... See more...
I'm going to try and push through today but I reckon I'll be in the same place Monday. I really appreciate your help so far and would be so grateful if dig in deeper next week. Thanks again and enjoy your weekend!
Good Day. I've browsed for some time the official documentation and the forum, and I haven't found exactly the answer I need, so... this is my question (it applies to HF and Enterprise). I would li... See more...
Good Day. I've browsed for some time the official documentation and the forum, and I haven't found exactly the answer I need, so... this is my question (it applies to HF and Enterprise). I would like to limit the internet access of my HF. Over the months, two possible connections come to my mind: Updating Splunk Updating Plugins from splunkbase After some reseach, I haven't found what IP addresses or URL are the right ones to configure in the firewall. Any help?