Moving On-Prem Applications to the Cloud
One simple setting can change how your LLM responds We ve all witnessed the creativity of responses from ChatGPT and other chat LLM services. The responses to our questions are often unique; sometimes, they seem foolish and wrong. When we ask an open-ended question where the answer might not be a specific value, how is the...
For companies running IBM AIX who have yet to try running AIX in the cloud, I put together 3 steps that provide a path. This is based on my personal experience working on projects in this area.
Many of us face the crucial challenge of leveraging the power of AI while safeguarding sensitive or private data. The importance of this task cannot be overstated, as the consequences of data exposure can be severe. We ve all been warned not to send such data to an external LLM, yet most businesses do not have...
In your large company, every department wants its own LLM RAG. Do you create a giant monolith system to handle everything? A Prompt Router might help. As large companies increasingly adopt Language Model (LLM) Retrieval-Augmented Generation (RAG) chat systems to enhance their operations, a critical question arises: should they develop one monolithic system that indexes...
How will the application of AI change IT operations? Let s examine one example and make one prediction for the future. If IT Operations generally means this: Managing and maintaining the infrastructure, networks, applications, and services that support the organization s business functions. Then AIOps implies this: Using AI to assist with managing and maintaining the infrastructure,...
In the world of LLMs, someone eventually pays for tokens. But tokens are not necessarily equivalent to words. Understanding the relationship between words and tokens is critical to grasping how language models like GPT-4 process text. While a simple word like cat may be a single token, a more complex word like unbelievable might be...
Regression testing ensures that the answers obtained from tests align with the expected results. Whether it s a ChatBot or Copilot, regression testing is crucial for verifying the accuracy of responses. For instance, in a ChatBot designed for HR queries, consistency in answering questions like How do I change my withholding percentage on my 401K? is...
As professionals working on AI projects, you might find this example of LLM Prompt Injection particularly relevant to your work. I ve been involved in several AI projects, and I d like to share one specific instance of LLM Prompt Injection that you can experiment with right away. With the rapid deployment of AI features in the...
Theme: Use your Power9 IBM Power resources for AI data processing tasks By now, most have heard the saying: If you are not using AI, you are behind. For companies using IBM Power, especially Power9, which is commonplace throughout the industry, here is an idea of how you might use your existing or easily accessible...
This article was authored by me and posted on my company s website. Please read the full article there. MGM Resorts reported an active Ransomware incident starting on September 11th, and as of September 17th, it had not fully recovered. Rumors are that the company did not pay the ransom and is “recovering” its systems. It makes...