When discussing GenAI one concern that consistently comes up is a worry around using public models and what happens to my data – there are genuine concerns about data privacy and security when using public AI models. Luckily there are solutions that address these concerns that have been around for quite a while – Ollama , and Open WebUI – tools that empower organisations to run AI models on their own infrastructure.
Tag: SecureAI
Mitigating Risks in LLMs: How Observability Enhances AI Reliability
Agentic AI and LLM tools enable remarkable capabilities, from automating workflows to generating content and insights. As I spend more time in Langflow and really start to appreciate the power of the systems that can be developed I started wondering about how they could be monitored, how do we implement Observability – then a note about Datadog LLM Observability came across my feed and got me thinking that this is worth looking at more deeply.