I finetuned LLM and I want to integrate that with Splunk. In Splunk Dashboard, I am going to include Question/Answering mechanism where my model going to answer the question user has.
For that, I have created an app "customApp" in src/etc/apps and added user-queries.py file in apps/customApp/bin folder and command.conf file in apps/myapp/default folder.
I loaded the finetuned model and generated response in user-queries.py
I am getting the following error on Splunk dashboard when calling this command. Btw, it worked when I hardcoded instead of loading the model and asking model to generate responses.
<Error in 'userquery' command: External search command exited unexpectedly with non-zero error code 1.>
Am I following the correct approach to integrate LLM to Splunk? I checked my splunkd.logs, it shows some disk space issue.
Can you someone please save me from this, Thanks in advance!
