https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32888#M5864 <P>Hi Perlish,</P> <P>There's several ways to do this but it depends on how you have access to this file:</P> <OL> <LI>If you have direct access to the server, you could install a universal forwarder to monitor the file and forward it to your Splunk server.</LI> <LI>You could write a scripted input that would pickup the file (wget/ftp/scp?) and then load it into Splunk. Mind you that this wouldn't take care of duplicate entries so you'd have to arrange this sanity check yourself.</LI> <LI>If the server that has your file runs syslog (or rsyslog, or syslog-ng) you can possibly have the file sent to your Splunk server via syslog. This would require you enabling port 514 UDP/TCP (depending on the type of syslog) on your Splunk server.</LI> <LI>If the server that has the logfile can export the filesystem it has the logfile on, you can then mount the filesystem on your Splunk server (CIFS/SMB/NFS?) and ingest the file as if it was a local file. This will set the host variable to the local Splunk server so you might want to overwrite that with the remote server name.</LI> </OL> <P>As far as I know, there's no input for Splunk to monitor a file directly over HTTP from within Splunk itself.</P> Tue, 13 Aug 2013 11:09:34 GMT lcrielaa 2013-08-13T11:09:34Z https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32887#M5863 <P>I want to input data from url,such as <A href="http://my.site.com/dns_monitor.log">http://my.site.com/dns_monitor.log</A><BR /> How can I make it ?<BR /> Thank you !</P> Tue, 13 Aug 2013 10:33:41 GMT https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32887#M5863 perlish 2013-08-13T10:33:41Z https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32888#M5864 <P>Hi Perlish,</P> <P>There's several ways to do this but it depends on how you have access to this file:</P> <OL> <LI>If you have direct access to the server, you could install a universal forwarder to monitor the file and forward it to your Splunk server.</LI> <LI>You could write a scripted input that would pickup the file (wget/ftp/scp?) and then load it into Splunk. Mind you that this wouldn't take care of duplicate entries so you'd have to arrange this sanity check yourself.</LI> <LI>If the server that has your file runs syslog (or rsyslog, or syslog-ng) you can possibly have the file sent to your Splunk server via syslog. This would require you enabling port 514 UDP/TCP (depending on the type of syslog) on your Splunk server.</LI> <LI>If the server that has the logfile can export the filesystem it has the logfile on, you can then mount the filesystem on your Splunk server (CIFS/SMB/NFS?) and ingest the file as if it was a local file. This will set the host variable to the local Splunk server so you might want to overwrite that with the remote server name.</LI> </OL> <P>As far as I know, there's no input for Splunk to monitor a file directly over HTTP from within Splunk itself.</P> Tue, 13 Aug 2013 11:09:34 GMT https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32888#M5864 lcrielaa 2013-08-13T11:09:34Z https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32889#M5865 <P>Hi Icrielaa,<BR /> I can not access the web server,I can only access the url,and I thought wget is not the best way,but it seems it's the only way to do that.I hope there's a APP to make it.<BR /> Thanks for your reply.</P> Wed, 14 Aug 2013 09:33:35 GMT https://community.splunk.com/t5/Getting-Data-In/How-can-I-input-data-from-url/m-p/32889#M5865 perlish 2013-08-14T09:33:35Z