Skip to main content
note
This page was translated from the German original, partly by machine. Some passages may read awkwardly or contain inaccuracies. When in doubt, please read the original.

Artificial Intelligence

A few surprising facts

First: "artificial intelligence" does not denote a thing but a boundary that keeps moving. Chess computers counted as AI until they started winning. Speech recognition counted as AI until it ended up in the telephone. As soon as something works reliably, it is suddenly just software. The computer scientist Larry Tesler put it in a formula: AI is whatever hasn't been done yet.1

Second: the AI that actually shapes your life is inconspicuous. It decides on creditworthiness, pre-sorts job applications, plans your route, suggests the next video and helps read your X-rays. Chatbots are the visible part, but by no means the most consequential one.

Third: the basic idea of neural networks dates from the 1940s, the decisive learning method from the 1980s. What is new is not the theory. What is new is the volume of data and the computing power.

What all belongs to it?

AI is an umbrella covering very different tools.

Symbolic AI works with explicitly formulated rules and logic. The expert systems of the 1980s belong here, but so do today's planning and theorem-proving systems. They are transparent and rigid.

Machine learning derives patterns from data instead of prescribing rules, as described in the previous chapter.

Neural networks and deep learning are a particularly successful family within machine learning: many layers of simple computing units that together capture complicated relationships.

Cutting across these are fields of work such as image processing, language processing, robotics and search. When somebody says "the AI", it is worth asking which of these things they mean.

The question: what does it mean for a machine to learn?

Learning sounds like understanding. What is meant is something more sober: a program has many adjusting screws, set at random to begin with, and it keeps turning them until its outputs fit the examples better. There are three ways of giving it feedback while it does so.

Supervised learning is learning with an answer sheet. You show examples with the correct answer: this image shows a tumour, that one does not. It is the most common and the most data-hungry form. Somebody has to supply the answers, usually underpaid people.

Unsupervised learning is learning without an answer sheet. The program is given only data and looks for structure itself, for instance groups of customers with similar behaviour. It finds patterns, but nobody has told it which ones matter.

Reinforcement learning is learning through reward. The program tries things out, receives points for good outcomes and adapts its behaviour. This is how systems learn games and robots learn to grasp. The catch: they optimise exactly the score, not what you meant.

Theory and practice: the business with the reward

That last warning is not theory. A video platform system optimised for time spent reliably learns that outrage holds attention longer than sobriety. It has no political intention. It has an objective function, and it fulfils it perfectly.

That is exactly the practical lesson of the notion of learning: a learning system never does what is wanted, always what is measurable. Anyone who wants to know how an AI will behave has to ask what it was optimised for and who picked that quantity.

The same holds for data. An application filter that learns from past hiring decisions inherits their prejudices, now wrapped in the aura of mathematical objectivity.

Where the field is heading

Four developments shape the present:

  • Multimodality: one model processes text, image, sound and video together rather than separately.
  • Agents: systems carry out multi-step tasks, call tools and act instead of merely answering.
  • Small models: alongside the giants, compact models are emerging that run locally on your own device, without sending data into somebody else's cloud.
  • Regulation: with the European AI Act, a distinction is drawn for the first time by risk rather than by technology.

What remains unchanged through all of it: these are automata estimating probabilities. The capabilities are growing astonishingly fast, the basic mode of operation is not.

Footnotes

  1. Attributed after Douglas R. Hofstadter: Gödel, Escher, Bach, Basic Books, 1979, where the formula is quoted as "Tesler's Theorem".