Splunk Dev

How to run python custom commands with cython dependencies?

joshiro
Communicator

We are trying to run some custom commands that requires cython, but Splunk's python doesnt support it.
We tried creating an anaconda environment inside the app, just like MLTK and Python for Scientific Computing apps, but some issues appeared regarding anaconda symlinks. This is beign discussed in another thread: https://community.splunk.com/t5/Developing-for-Splunk-Enterprise/Why-when-installing-custom-made-app...

¿Anyone managed to run python custom commands that required cython?

Labels (2)
0 Karma
1 Solution

joshiro
Communicator

We finally made it work using the Python for Scientific Computing app custom python environment, and then changing to it in runtime. Then we added the cython libs required and it worked.

We copied the exec_anaconda.py script into our app and modified it according to our needs.
Then we use it a python custom command script to load the PSC environment.
Finally we added the cython libs with:

sys.path.insert(0, os.path.join(os.path.dirname(__file__), "..", "lib", <path_to_libs>))

View solution in original post

0 Karma

joshiro
Communicator

We finally made it work using the Python for Scientific Computing app custom python environment, and then changing to it in runtime. Then we added the cython libs required and it worked.

We copied the exec_anaconda.py script into our app and modified it according to our needs.
Then we use it a python custom command script to load the PSC environment.
Finally we added the cython libs with:

sys.path.insert(0, os.path.join(os.path.dirname(__file__), "..", "lib", <path_to_libs>))
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Persistent Queue at TcpOut — One of Splunk's Most Practical Features

Splunk introduced persistent queueing at the tcpout layer as one of the most practical resilience features in ...

Build resilience for the agentic era: Join us at Splunk Go San Jose

AI is changing how organizations build, operate, and secure digital services. As teams adopt AI agents and ...

Manage Edge Processor pipelines end to end with APIs

This guide uses the Data Management APIs to create an Edge Processor, onboard one instance, deploy a pipeline ...