When discussing GenAI one concern that consistently comes up is a worry around using public models and what happens to my data – there are genuine concerns about data privacy and security when using public AI models. Luckily there are solutions that address these concerns that have been around for quite a while – Ollama , and Open WebUI – tools that empower organisations to run AI models on their own infrastructure.
Tag: TechInnovation
Agentic AI Design: Balancing Autonomy and Control
Agentic AI seems to be talked about constantly and as I’ve talked about in previous articles design patterns matter – same thing applies to AI Agents, design matters. What design patterns, or a least design considerations are there for Agent AI design?
The Blueprint for GenAI Success: Why GenAI Architecture Frameworks and Design Patterns Matter
While mulling over what seemed to be a lack of GenAI frameworks and design patterns last week, this post from Debmalya Biswas dropped into my feed on A Comprehensive Guide to Agentic AI. This post and the accompanying slides are more than the title suggests – they are a great start on a set design patterns and reference architectures – something that we seem to be sorely missing.
Agentic AI – what would heading into 2025 be like without another article on Agentic AI.
We’ve been seeing Agentic AI hit the press a lot over the last while, especially as we head into 2025. I recently had the chance to build a PoC and find out what Agentic AI was all about and I think I get it now…
LLM Security – The OWASP Top 10 for LLMs & What You Need to Know
As AI continues to revolutionise industries, understanding and mitigating the security challenges around large language models (LLM’s) is critical. The OWASP Top 10 for LLM’s is a comprehensive guide to the most pressing risks faced by these models.
There is value in that unstructured data.
For quite some time I have been concerned about the unrealised value in unstructured data – the myriad of Word documents and PDF’s that contain everything from organisational policies to processes and reports (we aren’t talking about video, images and audio in this article). This increasing amount of unstructured data and the ability to absorb it is one of the things that increases the time that new hires take to become effective or means that a policy (if not encapsulated within a system) does not get adhered to.
Elevating Software Development with AI Companions: My Game-Changing Experience with Codeium
I needed a small utility to search using the Google custom search API and then submit the results to ChatGPT’s API for summarising; I leveraged the power of the AI coding companion, Codeium for the first time (in VSCode and Python). This combination truly improved my development experience, making it a lot more efficient and enjoyable, auto-completing code, generating explanations and providing in code documentation. Digging a little deeper …
AI’s Role in Reducing Risk in the SDLC (e.g. CrowdStrike)
In the wake of the recent CrowdStrike incident it’s easy to become an armchair critic. For those with experience in IT, isn’t it likely that such issues are multi-dimensional, spanning technical, managerial, cultural, and even simple human errors?
Deploying AI: What Somebody Seems to be Putting Together
After posting last weeks article (Deploying AI: What nobody seems to be putting together) where I suggested that we have fragmentation in approaches to AI deployment I saw a number of things come together. EY launched EY.ai (actually, back in Sept 2023), then a great post from Chris Howard at Gartner (Top of Mind – “Are 100% Accurate AI Language Models Even Useful?”) where Chris mentions ‘…as we hit the trough of disillusionment with generative AI…”.