topic Re: How edit my code to display the results of a file in Splunk using Django bindings? in Splunk Dev

How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Thu, 19 Feb 2015 13:48:00 GMT

Hi everyone,

I'm trying to display the results of a file in Splunk using the django bindings, but something is wrong in my code. Could someone help me?

URL.py

url(r'^mypage/$', 'mynewapp.views.mypage_view', name='mypage'),

views.py

@render_to('mynewapp:mypage.html')
@login_required
def mypage_view(request):
file_data = ''
service = request.service
with open(csvfile, "r+") as lines:      
for line in lines:
    file_data += line
     return file_data

mypage.html

   {% for data in file_data %}
    <p>{{ data }}</p>
    {% endfor %}

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Tue, 24 Feb 2015 22:30:09 GMT

F* me, i am also struggling with this one ...

I can see that in urls.py from the framework toolkit that you can download from apps.splunk.com their rendering looks a little bit different;

urlpatterns = patterns('',
    url(r'^home/$', render('splunk_wftoolkit:home.html'), name='home'),
    url(r'^overview/$', render('splunk_wftoolkit:overview.html'), name='overview'),
    # Components
    url(r'^managers/$', render('splunk_wftoolkit:managers.html'), name='managers'),
    url(r'^charts/$', render('splunk_wftoolkit:charts.html'), name='charts'),
    url(r'^tables/$', render('splunk_wftoolkit:tables.html'), name='tables'),
    url(r'^forms/$', render('splunk_wftoolkit:forms.html'), name='forms'),
    url(r'^dataview/$', render('splunk_wftoolkit:dataview.html'), name='dataview'),
    url(r'^searchcontrols/$', render('splunk_wftoolkit:searchcontrols.html'), name='searchcontrols'),
    url(r'^map/$', render('splunk_wftoolkit:map.html'), name='map'),

Lets see what i can make happen tomorrow

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 09:18:10 GMT

I have use the demo, that I have found on the splunk page tutorial, it work to display the data, but If I change the name at the view functions or at the url, like I have done over here, anything doesn't work : (

My first problem is take the results from {{data}} and elaborate them.
And take results of the dropdown menu and the checkbox and output them in an external file.
I have try to ask, but you are the first one that are replying to me.

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 09:21:39 GMT

It is the same problem i have ... my point underneath here is that web framework toolkit app that you can download from apps.splunk.com that i would assume would have used web framework / django bindings for its views and urls looks different from the examples (in the doc) and the produced code from generating an web framework app.

Hopefully i have the energy to dig in deeper today

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 09:24:09 GMT

Yeah, I'm using it, let me know if you found something, thank you : )

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 09:54:03 GMT

Just wanted to update with some progress ..
ok, so after changing my urls.py for my app from ;

url(r'^mypage/$', 'mynewapp.views.mypage_view', name='mypage'),

url(r'^mypage/$', render('mynewapp:mypage.html'), name='mypage'),

My urls.py and "views.py" are now working.

I am still not able to display some of the contents from my views.py in my "mypage", however i can see that it gets the list of apps from splunk at least and iterate over it, but still does not display the results on mypage.

a small step for mankind but a huge leap forward for lmyrefelt 🙂

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 09:59:29 GMT

cool : ) Can I ask you when you will finish, how set a condition to execute the render? Because for now (that I have used: url(r'^pythondemo/$', 'mynewapp.views.pythondemo_view', name='pythondemo'), like in the splunk demo ) work in the moment that I open my app, but I would like that this will work only after a choose in the dropdown menu.

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 10:11:32 GMT

So you got the example(s) to work? if i do use the example(s) code in dev.splunk.com for the django app i am only getting this message over and over again.

This XML file does not appear to have any style information associated with it. The document tree is shown below.

I also get these ones (if some devs are dropping by) :

2015-02-25 11:05:11,968 ERROR urls:68 - invalid syntax (urls.py, line 13) Traceback (most recent call last): File "/opt/splunk/dev/6.2.1/splunk/etc/apps/framework/server/urls.py", line 61, in load_urls_for_app module_with_urls = importlib.import_module("%s.urls" % app) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/utils/importlib.py", line 35, in import_module __import__(name) File "/opt/splunk/dev/6.2.1/splunk/etc/apps/filex/django/filex/urls.py", line 13 ^ SyntaxError: invalid syntax

As soon as i change (urls.py) as above i get the urls to work and no more error message as above

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 10:14:16 GMT

Yes, with the example works, but if I try to change the name of the variable, anything doesn't work.
Try to look at this: http://dev.splunk.com/view/SP-CAAAEMP

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 10:17:30 GMT

Thanks, thats the page and examples i am trying to follow ... i am feeling so stupid not to even be able to get the examples to work 😛

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 10:19:43 GMT

Don't worry, I had the same problem XD
Let me know if changing the variables it start to work, like use instead of "pythondemo" "mypage", something like this.

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 11:25:37 GMT

OK, so i have manage to start to get the views.py working ... as i am a newbie with python ... i have not yet hammered the "indention" into the back of my head !
That seems to have been a big part of at least my problems!

Maybe that is something you should verify as well ? You should be able to find the messages under; sourcetype=djange_service

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 11:29:12 GMT

Yeah, I'm new in all this too : )
Sorry, I'm not sure of what you are asking, to me, could you said it again?

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 11:32:57 GMT

You might need to put your code more "inline" that is add a tab to the beginning of the code

Example (compare to your pasted code above;

@render_to('mynewapp:mypage.html')
 @login_required
 def mypage_view(request):
          file_data = ''
          service = request.service
          with open(csvfile, "r+") as lines:        
               for line in lines:
                     file_data += line
               return file_data

}

or Similar.

You should be able to find an (python) error message in index=_internal sourceype="django*"

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 11:33:57 GMT

don't forget the } at the end

}

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 11:39:43 GMT

Sure, sorry,
I'm using this indention now:

@render_to('mynewapp:mypage.html')
@login_required
def mypage_view(request):
    file_data = ''
    service = request.service
    with open(csvfile, "r+") as lines:
        for line in lines:
            file_data += line
return file_data

For each type of error that I do, I have ALWAYS this error: Internal server error.
However, my problem is not the inline of the code, like this works.
I found problem when I change the name of my file from pythondemo to mypage

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 12:14:43 GMT

so we are in the same boat (at least now:P ) ok ..
(the comments are to short for me to post this ... hopefully helpful for someone )
(for people coming in and reading)

I have created a new page timedemo.html , which can contain any content, or without .
I edited urls.py

 rlpatterns = patterns('',
        url(r'^home/$', 'test.views.home', name='home'),
        url(r'^pythondemo/$', 'test.views.pythondemo_view', name='pythondemo'),
        url(r'^timedemo/$', 'test.views.timedemo_view', name='timedemo'),
    )

With a simple yank and paste .

Restarted splunk. Trying to access my new app "test" .. only to get this;

404 Not Found

Return to Splunk home page
The path '/en-US/test/' was not found.
View more information about your request (request ID = 54edb5d1b47f93cc64a3d0) in Search

This page was linked to from http://10.0.1.21:8000/en-US/app/test/default.

Browsing / typing my old urls "home, pythondemo" from adressfield works fine.
When trying to browse my newly created page; timedemo .. this is what i get back;

 This XML file does not appear to have any style information associated with it. The document tree is shown below.
      <response><messages><msg type="ERROR">INTERNAL SERVER ERROR</msg></messages></response>

in gjango_error.log i find;

Traceback (most recent call last): File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/handlers/base.py", line 103, in get_response resolver_match = resolver.resolve(request.path_info) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/urlresolvers.py", line 321, in resolve sub_match = pattern.resolve(new_path) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/urlresolvers.py", line 321, in resolve sub_match = pattern.resolve(new_path) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/urlresolvers.py", line 321, in resolve sub_match = pattern.resolve(new_path) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/urlresolvers.py", line 223, in resolve return ResolverMatch(self.callback, args, kwargs, self.name) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/urlresolvers.py", line 230, in callback self._callback = get_callable(self._callback_str) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/utils/functional.py", line 31, in wrapper result = func(*args) File "/opt/splunk/dev/6.2.1/splunk/lib/python2.7/site-packages/django/core/urlresolvers.py", line 118, in get_callable (lookup_view, mod_name)) ViewDoesNotExist: Could not import test.views.timedemo_view. View does not exist in module test.views.

Could not import test.views.timedemo_view. View does not exist in module test.views.

So i set up some empty views in view.py and now i am not seing these messages anymore ... pain in the ass to have to this for all the pages / templats i setup.

Which seems to be necessary even if i am not doing anything special in the template ...

It seems to be some things i have not yet understoud regarding django.

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 12:42:38 GMT

Could you paste your render function too? Maybe help

Re: How edit my code to display the results of a file in Splunk using Django bindings?

lmyrefelt — Wed, 25 Feb 2015 13:07:21 GMT

Do you mean my views.py ?

@render_to('test:timedemo.html')
@login_required
def timedemo_view(request):
        return {
}

Re: How edit my code to display the results of a file in Splunk using Django bindings?

Federica_92 — Wed, 25 Feb 2015 16:21:41 GMT

Any news?