Hi everyone! Here are a few questions from the session (get the full Q&A deck and live recording in the #office-hours Slack channel):

Q1: What is new in MLTK 5.6?

• LLM Integrations: New feature to allow customers to connect to external LLM models, from providers including OpenAI, Gemini, AWS Bedrock, Anthropic, Grok, Microsoft hosted OpenAI and Ollama
• Enhanced ONNX apply: ONNX apply now supports multi-variate outputs
• Upgrading OpenSSL to v3.4 to mitigate a critical vulnerability in PSC 4.2.3 and 3.2.3

Q2: Can I use indexed data to train the AI, if so how?

• Training models directly in MLTK/DSDL
  • Can index data and prepare it with SPL for fit/apply commands to implement on ML workload
  • Key to utilize summary index for better performance
• Using genAI via MLTK
  • Search command sends data to external LLM
• Vector databases & Splunk
  
  • Setup a LLM/RAG pattern to contextually pass documents from vector DB
  • Encode Data from Splunk (logs, documents, searches, etc.)

Q3: What are some common use cases to get started with the Machine Learning Toolkit (MLTK) app?

• There are a plethora of Use Cases whether specific to Security or Observability, or anything else. Some of the most common use cases are around malicious patterns of network traffic, threat hunting, forecasting resource utilization and predictive maintenance. But there is so much more…
• Additional resources:
  • MLTK Deep-dives: https://docs.splunk.com/Documentation/MLApp/5.5.0/User/Deepdivesoverview 
  • Use Cases for Observability: https://www.splunk.com/en_us/form/splunk-machine-learning-for-observability-use-case-guide.html 
  • Use Cases for Security: https://www.splunk.com/en_us/form/security-use-case-enhanced-by-ai-and-ml.html 

Other Questions (check the #office-hours Slack channel for responses):

• What’s Splunk doing around AI?
• What new in Splunk Data Science and Deep Learning 5.2?
• How does Splunk manage data privacy with the AI Assistant? What data is shared and how is it used?
• Is there a cost to use the AI assistant? And how does it impact my SVC utilization?
• Is the AI Assistant for SPL conversational?
• How can Splunk help me monitor and secure my generative AI applications?
• Is it possible to enable AI Assistant in Observability Cloud on certain services or certain roles/groups?