Any news here? I'm also struggling. When I enter the url to my ollama, it does "load" the model automatically from the drop down, suggesting I do have a connection, even though when I run the connection test or click save, it tells me "liteLLM library not available. Install with: pip install litellm". grep -ri "LiteLLM library not available" /opt/splunk/etc/apps gives /opt/splunk/etc/apps/Splunk_ML_Toolkit/bin/util/psc_boto_funcs.py. That suggests this code is atleast responsible for that error msg. _internal reports something like: ERROR PersistentScript [2226 PersistentScriptIo] - From {/opt/splunk/bin/python3.13 /opt/splunk/lib/python3.13/site-packages/splunk/persistentconn/appserver.py}: Connecton test failed for connection="somename", provider='Ollama', model='qwen2.5-coder:3b': LiteLLM library not available. Install with: pip install litellm. I've been trying to install the liteLLM package into each "apps" directory and globally etc, but I think I've always had it available, so duno whats going on.
... View more