Newswise — Traditionally, artificial intelligence derives from the dynamics of the human brain. However, brain learning is limited in many important aspects compared to deep learning (DL). First, an efficient DL wiring structure (architecture) consists of dozens of feedforward (successive) layers, whereas the dynamics of the brain consists of a few feedforward layers. Second, DL architectures typically consist of many successive filter layers essential for identifying one of the input classes. For example, if the input is a car, the first filter identifies wheels, the second identifies doors, the third identifies lights, and adding more filters will ensure that the input object is actually It turns out to be a car. Conversely, brain dynamics includes only one filter, which is located near the retina. The final required component is a mathematically complex DL training procedure. This is clearly far beyond biological realization.
Can a brain with its limited ability to perform precise mathematical operations compete with advanced artificial intelligence systems implemented on fast parallel computers? Our everyday experience suggests that for many tasks the answer is yes. We know it is! Why is this, and given this affirmative answer, can we build a new type of efficient artificial intelligence inspired by the brain? In the article, scientific reportresearchers from Bal-Ilan University in Israel solve this puzzle.
“We showed artificially efficient learning wood An architecture in which each weight has a single route to the output unit can achieve higher classification success rates than previously achieved by DL architectures composed of more layers and filters. This discovery paves the way for new efficient, biologically-inspired AI hardware and algorithms,” says Bar-Ilan’s Department of Physics and Gonda (Goldschmied Brain) Multidisciplinary Brain, who led the research. His Professor Ido Kanter of the Research Center said.
“Highly pruned tree architectures represent a step towards a plausible biological realization of efficient dendritic tree learning by single or multiple neurons, reducing complexity and energy consumption, and are currently central to AI. It biologically realizes the backpropagation mechanism, which is a powerful technology,” he added. Yuval Meir, PhD student and his contributor to this research.
Efficient dendritic tree learning builds on previous work by Kanter and his experimental research team and was performed by Dr. Roni Vardi. This, along with other anisotropic properties of neurons such as different spike waveforms, provides evidence for subdendritic adaptation using neuronal cultures. , refractory period and maximum infection rate.
Efficient implementation of highly pruned tree training requires new types of hardware, different from new GPUs, which are better suited to current DL strategies. Efficient mimicking of brain dynamics requires the emergence of new hardware.
Video on dendrite learning: https://vimeo.com/702894966
