A new AI chip developed at the Technical University of Munich (TUM) works without the cloud server or internet connections needed by existing chips. The AI Pro, designed by Prof Hussam Amrouch, is modelled on the human brain. Its innovative neuromorphic architecture enables it to perform calculations on the spot, ensuring full cyber security. It is also up to ten times more energy efficient.

The professor of AI processor design at TUM has already had the first prototypes produced by semiconductor manufacturer Global Foundries in Dresden. Unlike conventional chips, the computing and memory units of the AI Pro are located together. This is possible because the chip applies the principle of ‘hyperdimensional computing’: This means that it recognizes similarities and patterns, but does not require millions of data records to learn.

Instead of being shown countless images of cars, as with the deep learning method used in conventional AI chips, this chip combines various pieces of information, such as the fact that a car has four wheels, usually drives on the road, and can have different shapes. Like the new chip, explains Prof. Amrouch, ‘humans also draw inferences and learn through similarities.’

An important advantage of brain-like thinking: it saves energy. For the training of a sample task, the new chip consumed 24 microjoules, while comparable chips required ten to a hundred times more energy – ‘a record value,’ notes Prof. Amrouch. ‘This mix of modern processor architecture, algorithm specialization and innovative data processing makes the AI chip something special.’

This also sets it apart from all-rounders like the chips from industry giant NVIDIA. ‘While NVIDIA has built a platform that relies on cloud data and promises to solve every problem, we have developed an AI chip that enables customized solutions. There is a huge market there.’