2023 has been the year of AI breaking through in the enterprise. But before your CIO gets fixated on ChatGPT, here are five things to know.If 2022 was the year when AI broke through to become a society-changing technology, 2023 has been the year of AI breaking through in the enterprise. Put it this way: generative AI and large language models (LLMs) have become a familiar part of the lexicon for IT departments the world over. Your CIO is now more likely to namecheck ChatGPT than Kubernetes.
Already, it’s been a year of giant strides forward for AI in the enterprise, so here are five things we’ve learned so far.
1. ChatGPT Isn’t the Only Option for Enterprises
In March, OpenAI announced an enterprise version of ChatGPT. But in this case, OpenAI was a fast follower — not the first-to-market. Cohere, a Toronto-based company with close ties to Google, was already selling generative AI to businesses, as I discovered when I spoke to them that month.“We’re working with developers in organizations, the AI/ML teams, to bring these capabilities into their organizations,” Cohere’s CEO Martin Kon told us. He added that its approach is fundamentally different from OpenAI’s. “OpenAI wants you to bring your data to their models, exclusive to Azure. Cohere wants to bring our models to your data, in whatever environment you feel comfortable in.”
So far, companies are mostly using generative AI to create semantic search engines for their own private data — whether for internal use or for external customers. A related use case is knowledge management (KM). Imagine an employee being able to have a conversation with an AI that was trained on large language models based on company data.
One of the many new AI companies trying to achieve KM in chatbot form is Vectara. Its CEO Amr Awadallah told me that “in five years, every single application — whether that be on the consumer side or in the business/enterprise side — will be re-architected in a way that is a lot more human in nature, in terms of how we express what we are trying to achieve and what we’re trying to do.”
2. The Big Tech Platforms Are Pushing Low-Code Tools
Last month, Google Cloud and Google’s Workspace division announced a raft of new AI functionality. These included Generative AI App Builder, “which allows organizations to build their own AI-powered chat interfaces and digital assistants,” and new generative AI features in Google Workspace.
Google has coined a typically awkward term for applications powered by generative AI: “gen apps.” It claims that gen apps will become a third major internet application category, after web apps and mobile apps.I’m willing to wager that gen apps as a term will never take off but, regardless, Google’s AI-powered tools will be well used within enterprise companies.Likewise, Microsoft has been releasing new AI tools, such as Semantic Kernel (SK), described as “an open-source project helping developers integrate cutting-edge AI models quickly and easily into their apps.” SK is in many ways a classic Microsoft low-code tool, only it focuses on helping users do “prompts” for AI chatbots.
3. LLMs Vary Greatly in Size, But Size Isn’t Everything
If you scan Stanford’s HELM website, which measures LLMs in a variety of ways, you’ll see that these models vary greatly in size. There are, simply put, tradeoffs between model size and the speed it can work at.OpenAI has several models, ranging in size from 1.3 billion parameters (its Babbage model) to 175B parameters (its DaVinci model).Cohere goes as far as differentiating its model sizes as if they were Starbucks cups: small, medium, large, and extra large.
4. Tools Like Ray Are Helping to Scale AI
In this new era of generative AI, frameworks like Ray are now just as important as Kubernetes in creating modern applications at scale. An open source platform called Ray offers a distributed machine-learning framework. It’s being used by both OpenAI and Cohere to help train their models. It’s also used in other highly-scaled products, such as Uber.
5. Business Intelligence is Being Reinvented in the AI Age
Just as cloud computing ushered in a raft of “big data” solutions, generative AI is a catalyst for a new wave of data intelligence companies.I recently spoke to Aaron Kalb, a co-founder of Alation, which styles itself as a “data intelligence” platform and promotes a concept it calls the “data catalog.” This combines “machine learning with human curation” to create a custom store of data for enterprise companies.
