Free Preview

What AI Actually Is (And What It Isn't)

Chapter 1 of More Than Parrots, Less Than Gods

← Back to Home
1 / 3 free preview chapters
Next →

Chapter 1. What AI Actually Is (And What It Isn't)

The Elevator Pitch

If you leave this chapter with only one idea, let it be this: artificial intelligence is pattern recognition at scale. Nothing more — and, in the domains where it matters, nothing less.

That second half matters as much as the first. Pattern recognition at scale is an extraordinarily powerful thing. It is how your brain recognizes faces, how doctors spot tumors in scans, how chess engines evaluate positions, and how your phone predicts the next word in your text message. Modern AI can recognize patterns across trillions of data points, finding connections no human could ever see.

It has solved protein-folding problems that stumped biologists for fifty years. It detects skin cancer more accurately than dermatologists. It optimizes supply chains across continents in seconds. It plays games at levels no human has ever achieved. These are not tricks. They are genuine capabilities that exceed human performance in specific, bounded domains.

But it is still just pattern recognition. It does not think. It does not understand. It does not want. It does not know. It finds statistical regularities in data and uses them to make predictions. The predictions can be astonishingly useful. They can also be astonishingly wrong. And the gap between those two outcomes — the moments when AI is brilliant and the moments when it is confidently, catastrophically incorrect — is the single most important thing to understand about this technology.

The future belongs not to AI alone, and not to humans alone, but to the marriage between them: each compensating for the other's flaws, each amplifying the other's strengths. That marriage is what this book is about.


The Five Things People Wrongly Believe About AI

Before we talk about what AI is, let me clear away five misconceptions that dominate public discourse. Each of these is wrong in a specific way, and each wrong belief leads to bad decisions.

1. AI Thinks

It does not.

When ChatGPT writes you an essay, it is not thinking about the topic the way you would. It is not considering arguments, weighing evidence, and reaching a conclusion. It is calculating probabilities. Specifically, it is calculating which word is most likely to come next, given all the words that came before, based on patterns it learned from trillions of words written by humans.

Imagine a parrot that has listened to every conversation ever recorded. It does not understand what it is saying, but it has heard enough to produce responses that sound appropriate to the context. Modern AI is more sophisticated than a parrot — it generalizes patterns, combines concepts in novel ways, and adapts to new contexts — but the fundamental mechanism is the same. It predicts. It does not think.

The philosopher Daniel Dennett calls this "competence without comprehension."¹ An AI can display remarkable competence — writing poetry, passing exams, generating code — without any comprehension of what it is doing. This is not a philosophical quibble. It has practical consequences. A thinking mind can notice when something does not make sense. A statistical prediction engine cannot. It will confidently generate nonsense if the nonsense is statistically plausible.

2. AI Understands

It does not.

This is a subtler point. When an AI translates a sentence from English to French, it looks like understanding. When it summarizes a legal document, it looks like understanding. When it answers a medical question, it really looks like understanding. But what it is actually doing is mapping patterns from one statistical space to another.

Here is a simple test. Ask a human and an AI the same question: "If I put a cake in the oven and then go to the store, will the cake burn?"

The human understands ovens, heat, time, and causation. They know the cake will burn because they understand what baking is. The AI, if trained on enough text about baking, might give the correct answer. But it "knows" this the same way a magic 8-ball "knows" your future — by having seen enough similar questions to generate the statistically likely response.

The AI has no model of the physical world. It has never touched an oven. It does not know what heat feels like. It does not understand causation in any meaningful sense. It has seen the words "cake," "oven," "burn," and "time" appear together in particular ways, and it generates text consistent with those patterns.

As the AI researcher Emily Bender and her colleagues put it in their influential 2021 paper: these systems are "stochastic parrots" — they regurgitate patterns without grounding in reality.² Other researchers argue this understates their capabilities. The truth is somewhere in the middle: they are more than parrots, but far less than understanders. And knowing where on that spectrum a particular task falls is the whole game.

3. AI Is Conscious

It is not. Not even close.

Consciousness — the subjective experience of being alive, of feeling, of having a self — is one of the deepest mysteries in science. We do not know how it arises in biological brains. We certainly do not know how to create it in silicon. And nothing about current AI technology suggests we are anywhere near doing so.

The confusion arises because AI can simulate the output of conscious thought. It can say "I feel happy" or "I am thinking about your question." But these are word patterns. The system has no internal experience. There is no "someone" in there having thoughts. There is a mathematical function processing numbers.

Some philosophers argue that we cannot be sure AI is not conscious. This is technically true in the same way we cannot be sure a rock is not conscious. But in both cases, there is absolutely no evidence suggesting consciousness and overwhelming evidence suggesting its absence. The burden of proof lies with those claiming consciousness, not with those doubting it.

4. AI Is Infallible

It is embarrassingly fallible.

AI systems make mistakes constantly. They "hallucinate" facts that do not exist. They generate plausible-sounding but completely wrong answers. They reproduce biases from their training data. They fail at basic reasoning tasks that a child could handle.

In 2023, the AI company Vectara began systematically measuring how often major LLMs hallucinate when summarizing documents. Even the best models were wrong roughly 3% of the time.³ That may sound small, but in high-stakes domains — medicine, law, engineering — a 3% error rate is catastrophic. Would you take a drug that had a 3% chance of being the wrong drug entirely?

The fallibility is not a bug that will be fixed in the next version. It is a fundamental feature of how these systems work. Because they predict rather than know, they will always have a non-zero probability of generating incorrect outputs. The question is not whether AI will be wrong, but whether we have built systems to catch the errors before they cause harm.

5. AI Is Coming for Everything

It is not.

AI is transformative. It will reshape industries, eliminate some jobs, create others, and change how we work in ways we are only beginning to understand. But it is not universal magic. There are vast domains where AI is currently useless or nearly so: genuine creative originality, high-stakes physical dexterity, complex ethical reasoning, deep human relationships, and strategic decisions with no historical precedent.

The narrative that "AI will replace all jobs" or "AI will solve all problems" is marketing, not reality. AI is a tool. It is an extraordinarily powerful tool, but it is still a tool. It amplifies human capability in some domains and is irrelevant in others. The art of navigating this revolution is learning to tell the difference.


What AI Actually Is: A Plain-English Explanation

Now that we have cleared away the myths, let me tell you what AI actually is.

At the most fundamental level, modern AI — the kind that powers ChatGPT, Google Search, facial recognition, and self-driving cars — is a mathematical function with a lot of adjustable parameters. Think of it like an incredibly complex equation with billions of variables. You feed data into one side, and predictions come out the other.

Here is the metaphor I use with non-technical friends. Imagine you are trying to predict house prices in a neighborhood. You might start with a simple formula: price = (size × rate per square foot) + (location bonus). This has two parameters: the rate per square foot and the location bonus. You adjust these by looking at actual sales data until your formula predicts prices reasonably well.

Modern AI does the same thing, but with billions of parameters and trillions of data points. Instead of predicting house prices from two variables, it predicts the next word in a sentence from thousands of preceding words. Or it predicts whether an image contains a cat from millions of pixel values. Or it predicts the best chess move from the current board position.

The "intelligence" is not in the system. It is in the data. The AI learns statistical patterns from vast amounts of human-generated text, images, or game positions. It encodes those patterns into its billions of parameters. When you ask it a question, it is not reasoning — it is retrieving and combining patterns it has seen before.

An LLM — a Large Language Model like GPT-5, Claude 4, or Gemini 3 — is effectively a structural equation model with weights representing the most likely answer based on a large sample of data. That is not an insult. It is a description. The power comes from the scale: trillions of words, billions of parameters, and a training process that would cost hundreds of millions of dollars to replicate.

But the mechanism is not magic. It is statistics. Very, very large statistics.


What AI Does Better Than Humans

So far I have spent a lot of time telling you what AI cannot do. Let me balance the ledger. Because in the domains where AI excels, it does not just match human performance — it often surpasses it by margins that would have seemed impossible a decade ago.

These are not parlor tricks. They are genuine advances that are changing medicine, science, engineering, and industry.

Protein Folding and Genomics

In 2022, DeepMind's AlphaFold solved a problem that had stumped biologists for half a century: predicting the three-dimensional structure of proteins from their amino acid sequences.⁴ This matters because a protein's shape determines its function, and knowing that shape is essential for understanding disease and developing drugs.

Before AlphaFold, determining a protein's structure required years of painstaking laboratory work — X-ray crystallography, cryo-electron microscopy, nuclear magnetic resonance. Scientists had mapped roughly 200,000 protein structures over six decades. AlphaFold predicted the structure of nearly every known protein in the human genome — approximately 200 million structures — in a matter of months.

This is not marketing hype. In 2024, AlphaFold's predictions were used by researchers to identify a new class of antibiotics that could combat drug-resistant bacteria. The model predicted which chemical structures would bind to bacterial proteins in ways that existing drugs could not. Human researchers designed the experiments and interpreted the results. The AI found the pattern.

By 2026, AlphaFold 3 had extended these capabilities to predict interactions between proteins and other biomolecules — DNA, RNA, small molecules, antibodies — opening new frontiers in drug design and molecular biology.

In genomics, AI is accelerating everything from gene sequencing to the identification of disease-causing mutations. Machine learning models can now identify patterns in DNA that predict disease risk with accuracy that exceeds traditional statistical methods. They can analyze whole genomes in hours rather than weeks. They can spot epigenetic modifications — chemical changes to DNA that regulate gene expression — that human researchers would never have thought to look for.

The pattern here is consistent: AI excels when the problem involves finding subtle statistical relationships in massive, high-dimensional datasets. A human researcher might test a hundred hypotheses in a career. An AI can test a billion.

Medical Imaging

In 2017, a team at Stanford University trained a deep learning model to classify skin lesions as benign or malignant. When tested against a dataset of biopsy-proven images, the model matched the accuracy of twenty-one board-certified dermatologists. In some categories, it exceeded them.⁵

Since then, AI has been approved for clinical use in detecting diabetic retinopathy (eye damage), breast cancer in mammograms, lung nodules in CT scans, and heart arrhythmias in ECGs. These are not experimental toys. They are FDA-approved medical devices being used in hospitals right now.

The reason AI excels here is straightforward: medical images are pattern-recognition problems at massive scale. A radiologist might see ten thousand chest X-rays in a career. An AI can train on ten million. It learns to recognize subtle textures, densities, and shapes that human eyes — even expert human eyes — simply cannot distinguish.

But here is the crucial caveat: the AI does not know why the pattern indicates cancer. It does not understand oncology. It recognizes a statistical correlation. The diagnosis still requires a human physician to interpret the result, consider the patient's history, and make the final call. The AI finds the needle. The human decides what to do with it.

Games and Optimization

In 2016, DeepMind's AlphaGo defeated Lee Sedol, one of the world's top Go players, four games to one.⁶ Go was supposed to be too complex for AI — more possible board positions than atoms in the universe, relying heavily on intuition and pattern recognition rather than brute-force calculation. AlphaGo won by combining deep neural networks with Monte Carlo tree search, learning strategies from millions of human games and then discovering new ones through self-play.

A year later, AlphaZero surpassed AlphaGo — and not just at Go. The same algorithm, given only the rules of chess, taught itself to play at superhuman level in four hours. It then did the same for shogi (Japanese chess). It played moves that human grandmasters initially dismissed as mistakes, only to realize later that the machine had discovered strategies humans had never conceived.

These game-playing systems are narrow AI in its purest form. They cannot drive a car, write a poem, or hold a conversation. But within their domain, they operate at a level that redefines what is possible. The techniques they pioneered — reinforcement learning, self-play, neural network evaluation — are now being applied to logistics, chip design, materials science, and drug discovery.

The Pattern

What do protein folding, medical imaging, and game playing have in common? They are all problems with three characteristics:

  1. Massive search spaces: Too many possibilities for a human to exhaustively evaluate.
  2. Clear success criteria: A right answer exists and can be verified.
  3. Abundant training data: Enough examples exist for the AI to learn the patterns.

When these three conditions are met, AI often exceeds human performance. When any of them is missing — when the problem is ambiguous, when success is hard to define, when data is scarce — AI struggles. Understanding this distinction is the key to knowing where to deploy AI and where to rely on human judgment.


Beyond LLMs: The Many Faces of AI

When most people hear "AI" in 2026, they think of ChatGPT. But large language models are only one branch of a much larger tree. Understanding the other branches matters because they have different capabilities, different limitations, and different implications for your business and your life.

Computer Vision

Computer vision — teaching machines to interpret images and video — powers facial recognition, autonomous vehicles, quality control in manufacturing, and the medical imaging systems I described above. It relies on convolutional neural networks (CNNs) that learn to detect edges, textures, and shapes at increasing levels of abstraction.

The technology is mature enough to be deployed at scale, but it carries risks that LLMs do not. Facial recognition systems have been shown to have higher error rates for darker-skinned faces. Autonomous vehicles still struggle with edge cases — a plastic bag blowing across the road looks different to a camera than it does to a human driver. These are not theoretical concerns. They are engineering realities that determine whether a system is safe to deploy.

Recommendation Systems

Every time Netflix suggests a show, Amazon recommends a product, or Spotify creates a playlist, you are interacting with AI. Recommendation systems are among the most economically significant AI applications in existence. They shape what billions of people watch, buy, and listen to.

These systems are not LLMs. They are typically collaborative filtering or content-based models that learn from behavior: people who bought X also bought Y; people who watched A also watched B. They are powerful, profitable, and largely invisible — which makes them dangerous in their own way. When an algorithm decides what news you see or what products you discover, it shapes your worldview without your awareness.

Robotics and Embodied AI

Robotics is the hardest frontier in AI because it requires intelligence to interact with the physical world. A robot must perceive its environment (computer vision), plan actions (decision-making), execute movements (control systems), and adapt when things go wrong — all in real time, with physical consequences.

Progress has been slower here than in pure software AI. Boston Dynamics produces astonishing demonstrations of robot agility, but these machines are still far from general-purpose utility. Warehouse robots operate in highly controlled environments. Surgical robots assist human surgeons but do not operate autonomously. The gap between "looks impressive on YouTube" and "works reliably in an uncontrolled environment" remains large.

Optimization and Operations Research

Some of the most valuable AI systems are also the least glamorous. Airlines use AI to optimize flight schedules and crew assignments. Delivery companies use it to route vehicles across cities. Power grids use it to balance load and predict failures. These systems do not generate poetry or pass the bar exam, but they save billions of dollars and reduce carbon emissions.

The point is this: AI is not one thing. It is a collection of techniques applied to different problem types. LLMs get the headlines because they are accessible and impressive. But the quiet AI — the optimization engines, the recommendation systems, the computer vision pipelines — may be doing more to reshape the economy.


AI Agents: From Prediction to Action

In late 2022, the world met ChatGPT. In 2025 and 2026, the conversation shifted from "chatbots" to "agents." Understanding the difference is essential because it represents the most significant change in how AI interacts with the world since the transformer architecture was introduced.

What Is an Agent?

A chatbot responds to prompts. An agent acts on goals.

A chatbot answers your question about the weather. An agent checks your calendar, sees you have an outdoor meeting tomorrow, checks the forecast, and emails you a suggestion to reschedule if rain is predicted.

A chatbot writes Python code. An agent writes the code, runs it, sees that it produced an error, debugs the error, runs it again, and repeats until the task is complete.

A chatbot tells you about restaurants in Paris. An agent searches for flights, checks your dietary preferences, reads restaurant reviews, makes a reservation, and adds it to your calendar — all in response to a single instruction like "Plan my anniversary dinner in Paris."

The key difference is tool use and autonomy. Agents can call external tools — search engines, calculators, APIs, code interpreters — and chain multiple actions together to accomplish a goal. They do not just generate text. They perform tasks.

The Current State of Agents

In 2026, agentic AI is somewhere between "promising prototype" and "reliable tool." The demos are impressive. A well-designed agent can book travel, conduct research, generate reports, and write code. But the gap between a controlled demo and real-world deployment is enormous.

The ecosystem is evolving so rapidly that anything written about specific platforms risks being outdated before it is published. Frameworks like Hermes (the agent system I use for my own work) and OpenClaw represent the current generation of tools that allow AI systems to run terminal commands, edit files, search the web, and coordinate multi-step workflows. These are not theoretical constructs. They are real systems being used by real developers right now.

But the capabilities are narrow and brittle. An agent might successfully write a Python script on Monday and fail on the same task Tuesday because a library version changed or the API response format shifted. The field is changing weekly, if not daily.

Agents fail in ways that chatbots do not. A chatbot that gives a wrong answer is annoying. An agent that books the wrong flight, sends an email to the wrong person, or deletes the wrong file can cause real damage. The more autonomy you give an AI, the more robust its reasoning needs to be — and current LLMs are not robust enough for high-stakes autonomous action.

Multi-agent systems — networks of specialized AI agents that collaborate on complex tasks — are an active area of research and development. One agent researches. Another writes. A third fact-checks. A fourth formats. In theory, this division of labor produces better results than a single generalist agent. In practice, coordination errors compound quickly, and the systems are still experimental.

My assessment: agents are the next frontier, but we are in the very early innings. The companies that claim their AI can "run your business autonomously" are selling science fiction. The companies that use agents for bounded, verifiable tasks — with human oversight — are using them appropriately.


The Human-AI Partnership

I want to leave this chapter with a framework I have found useful: the idea that humans and AI are not competitors but partners, each with distinct strengths and distinct weaknesses. The organizations and individuals who thrive will be the ones who learn to pair the two intelligently.

Where AI Excels

  • Scale: Processing millions of documents, images, or data points without fatigue
  • Speed: Analyzing in seconds what would take a human hours or days
  • Consistency: Applying the same criteria every time, without mood, bias, or Monday mornings
  • Pattern detection in high dimensions: Finding correlations in datasets with thousands of variables that human intuition cannot perceive
  • Memory: Recalling exactly what it was trained on, without the distortions of human memory

Where Humans Excel

  • Judgment under uncertainty: Making decisions when data is ambiguous, contradictory, or incomplete
  • Ethical reasoning: Navigating situations where the right answer depends on values, not facts
  • Creative originality: Generating genuinely novel ideas, not just recombinations of existing ones
  • Physical-world understanding: Reasoning about causation, physics, and social dynamics from lived experience
  • Accountability: Standing behind a decision, explaining it, and accepting responsibility for its consequences
  • Relationships: Building trust, reading emotion, and navigating social complexity

The Marriage

The most productive model is not AI replacing humans or humans ignoring AI. It is what researchers call human-in-the-loop or human-on-the-loop systems: AI handles the scale, speed, and pattern detection; humans provide judgment, verification, and ethical oversight.

A radiologist who uses AI to flag suspicious scans can review more cases, more accurately, than one working alone. A lawyer who uses AI to draft contracts can spend more time on strategy and negotiation. A scientist who uses AI to analyze genomic data can test hypotheses that would have been computationally impossible a decade ago.

But the opposite is also true. A radiologist who trusts AI without reviewing the scans will eventually miss something critical. A lawyer who delegates legal reasoning to an LLM will file briefs with fabricated citations. A scientist who lets AI generate hypotheses without understanding the biology will pursue dead ends.

The pattern is consistent: AI amplifies human capability when used as a tool, and degrades it when used as a substitute. The difference is not in the technology. It is in how the human chooses to use it.


The Three Types of AI You Will Encounter

Not all AI is the same. Understanding the distinctions matters because the capabilities, limitations, and risks differ dramatically.

Narrow AI (What We Have Now)

Narrow AI — also called "weak AI" or "specialized AI" — is AI designed for a specific task. Chess engines. Spam filters. Facial recognition. Language translation. Medical image analysis. Self-driving cars. Every AI system in existence today is narrow AI.

Narrow AI can be superhuman within its domain — AlphaZero plays chess better than any human who has ever lived — but it is helpless outside that domain. AlphaZero cannot drive a car. A medical imaging AI cannot write poetry. ChatGPT cannot see or physically interact with the world.

The narrowness is a feature, not a bug. It means these systems are bounded. We know more or less what they can and cannot do. The danger comes when we forget the boundaries and treat narrow AI as if it were general.

Artificial General Intelligence (AGI) (What People Argue About)

AGI — artificial general intelligence — is the hypothetical ability of an AI to understand, learn, and perform any intellectual task that a human can. It is the science-fiction version of AI: a system that can reason, plan, solve problems, think abstractly, learn from experience, and transfer knowledge across domains.

Does AGI exist? No. Will it exist? Nobody knows. Some researchers think it is decades away. Some think it is years away. Some think it is impossible. We will discuss this in detail in Chapter 16, but for now, the key point is: AGI does not exist, and every claim you hear about its imminent arrival should be treated with extreme skepticism.

Artificial Superintelligence (What the Doomers Worry About)

Artificial superintelligence (ASI) is AI that surpasses human intelligence in every domain — scientific creativity, general wisdom, social skills, everything. This is the Skynet scenario, the paperclip maximizer, the singularity. It is, by definition, beyond our ability to understand or control.

Does ASI exist? No. Will it exist? Again, nobody knows. The probability is non-zero — if AGI is possible, superintelligence might follow — but it is so speculative that worrying about it at the expense of current problems is, in my view, a category error. We will discuss this more in Chapter 17.


Why the Language We Use Matters

The words we use to describe AI shape how we think about it. And how we think about it shapes what we do with it. This is not abstract philosophy. It has real consequences.

When an AI generates a false fact, the industry calls this a "hallucination." This is a terrible word. Hallucination implies perception without external stimulus — a human brain malfunctioning, seeing things that are not there. But AI does not perceive. It does not have a sensory apparatus that can malfunction. When an LLM generates a false citation or a made-up statistic, it is not hallucinating. It is making a prediction error. It is generating text that is statistically plausible but factually wrong.

Better terms exist. "Confabulation" — filling in gaps with invented details — is closer. "Pattern completion error" is more technical but more accurate. I prefer simply "wrong." When an AI states something false, it is wrong. Calling it a "hallucination" anthropomorphizes a statistical mistake and makes it sound like a quirk of an otherwise reliable mind rather than a fundamental feature of a prediction system.

Similarly, when companies say their AI "learns," "understands," or "reasons," they are using human cognitive verbs to describe mechanical processes. This is not innocent imprecision. It is marketing. It makes their products sound more capable than they are. And it leads users to trust AI in situations where they should not.

I am not suggesting we need a completely new vocabulary. Language evolves, and metaphors are useful. But I am asking you to be conscious of the metaphors. When someone says an AI "understands" your business, ask yourself: does it understand, or does it recognize patterns in text about businesses like yours? When someone says an AI "reasons" through a problem, ask: does it reason, or does it generate a sequence of words that looks like reasoning?

The gap between those two descriptions is where most AI failures live.


What This Means for You

If you take nothing else from this chapter, take these three principles:

One: AI is a tool, not a colleague — but it is an extraordinary tool. Treat it like a very capable, very fast, occasionally brilliant, occasionally idiotic partner. Give it clear instructions. Check its work. But do not dismiss its capabilities because of its limitations. The protein structures it finds, the scans it flags, the patterns it detects — these are real contributions.

Two: The most dangerous AI is the one you trust too much. AI failures are rarely dramatic. They are quiet. A wrong number in a financial report. A misdiagnosed scan that looked fine at first glance. A legal brief with a fabricated citation. The danger is not that AI will rebel. It is that humans will stop verifying.

Three: The people who thrive will be the ones who understand both the power and the limitations. AI is not magic. It is not worthless. It is a powerful, flawed, evolving tool. Understanding what it can do, what it cannot, and when the difference matters is the single most valuable skill you can develop in the coming decade. And the best results will come not from humans alone or AI alone, but from the two working together — each doing what the other cannot.


Key Takeaway

AI is pattern recognition at scale — extraordinarily powerful in bounded domains, fundamentally limited in open-ended ones, and most valuable when paired with human judgment that understands both its brilliance and its blind spots.


Endnotes

¹ Daniel C. Dennett, "Darwin's Strange Inversion of Reasoning," Proceedings of the National Academy of Sciences, 2009. Dennett developed the phrase "competence without comprehension" to describe how evolu...[truncated]


Want the Rest?

This was Chapter 1 of 19. Get the complete book — ebook, paperback, or hardcover.

Buy the Book