SCARY, DARPA SUPPORTED>Stanford engineers build a nanoscale device for brain-inspired computing

BY ANDREW MYERS

Researchers at the Stanford School of Engineering have delivered a nanoelectronic synapse that might drive a new class of microchips that can learn, adapt and make probability-based decisions in complex environments. Their work might one day lead to real-time brain simulators that enhance our understanding of neuroscience.

 

If you doubt the power of the human brain, ponder this for a moment: It takes today's state-of-the-art supercomputer eight-and-a-half minutes to simulate just five seconds of normal human brain activity. Meanwhile, that supercomputer will consume 140,000 times as much electricity as the brain – 1.4 million watts to ten to be exact – to do the work. For sheer processing power and efficiency, nothing quite compares to the human brain.

In a recent paper in the online edition of the journal Nano Letters, a team of Stanford engineers has demonstrated a new nanoelectronic device that emulates human synapses, the brain's computing mechanism.  It is a breakthrough that might one day lead to portable, energy-efficient, adaptable and interactive computer systems that can learn rather than merely respond to given programs. 

The Stanford team, led by Professor H.-S. Philip Wong, post-doctoral scholar Duygu Kuzum and graduate students Rakesh Jeyasingh and Byoungil Lee, has been working in a new field known as "brain-inspired computing," which seeks to mimic in computer chips the neurological signaling mechanism of the human synapse.

The researchers are not the first to venture down this path, but they are the first to succeed at creating synaptic devices small enough, with a low-enough energy consumption, and created with a mature technology so as to anticipate commercial viability down the road.

"This development could lead to electronic devices that are so small and so energy efficient that we might be able to make nanoelectronic versions of certain parts of the brain to study how they work," said Wong, a professor of electrical engineering. "While you can't alter a biological brain, a synthetic device such as this would allow researchers to change the device parameters to reveal how real brains function."

How computers work

To understand why this device is such a departure from what went before, it is necessary to understand how computer systems store and compute information. Within the nano-scale circuitry of today's computer chips are billions of tiny electrical components – transistors – that convey information using binary logic. That is, their logic is based on two numbers, either 1 or 0. In electrical terms, a transistor is either "on" or "off."

With enough transistors packed into each chip, programmers can manipulate electrical circuits, turning the billions of transistors on or off as necessary to store and process information – to "compute." The speed and size of computer chips has largely been determined by our ability to create faster transistors and to pack them into smaller spaces.

Synapses are the smallest computational units in the brain, but different from transistors in at least two very important ways. First, they can vary in strength. In other words, synapses can convey far more information than a transistor. Second, synapses can change over time.

"Synapses change based on learning," said Jeyasingh, "something conventional computers cannot do. Once most computer chips are made, you cannot change them easily."

Practice makes perfect 

In neuroscience, these two advantages are combined in a concept known as "synaptic plasticity," one of the leading theoretical foundations for how our brains learn, remember and compute.

Like transistor circuits, neurons and synapses are small and packed tightly together, but their circuitry is based on the varying strength of the synapses. The repetition of electrochemical signals traveling the same path will reinforce the synapses in the path and make them more or less likely to fire in the future. As neuroscientists like to say, "Neurons that fire together, wire together."

Synaptic plasticity explains why practice makes perfect. Repeating an electrical pattern through practice strengthens the pattern; therefore, the brain  "learns."

"The brain is an amazing machine. Its circuits are far more complex, far more capable, far more energy-efficient and far more powerful for performing certain tasks than even the very best computer chips based on binary logic," said Kuzum.

The Stanford team's device emulates synaptic plasticity using a technology known as "phase-change material," the same technology that allows DVDs and CDs to store information. When juiced with electricity, these materials change their physical characteristics and therefore their electrical conductivity in tiny increments – more electricity, more change.

Rather than the two states of a transistor, however, the Stanford team has demonstrated an ability to control the synaptic device in 1 percent increments – like a lightbulb on a dimmer – meaning each phase-change synapse can convey at least 100 values.

The device can be manufactured using existing commercial equipment with readily available materials.

"Using well-understood manufacturing processes, we can construct a cross-point architecture allowing three-dimensional stacking of layers that could one day approach the density, compactness and massive parallelism of the human brain," said Kuzum.

The researchers do not, however, foresee their new chips replacing existing ones. Instead, they say, they will lead in promising and exciting new directions that are currently out of reach.

"Our long-term goal is not to replace existing chips, but to define a fundamentally distinct form of computational devices and architectures. These new devices and architectures will excel at distributed, data-intensive algorithms that a complex, real-world environment requires, the sort of algorithms that struggle through today's processing bottlenecks," said Kuzum. 

Thinking in parallel

Among the most intriguing possibilities of these synaptic devices is greater parallelism. The brain is very good at juggling many types of sensory information simultaneously, something computers do very poorly. A supercomputer, by comparison, does not owe its great power to the speed of its processors so much as to splitting up big problems among many processors, each working on a small part of the problem. A more brain-like architecture might allow much smaller chips to think in parallel on many things at the same time.

And where might this lead us? It could lead to real-time brain simulations for use in neuroscience that may augment our understanding acquired from biological measurements. Brain-inspired computers may prove particularly adept at making decisions based on probability, as well.

"This work is a promising step forward in our ability to emulate brain functions using nanoelectronic devices and circuits. We can now contemplate a new direction of research which utilizes nanoelectronics for the study of neuroscience," said Wong.

"Beyond neuroscience, more brain-like systems could find use at the intersection of sensing and computation," said Kuzum. "Such applications would be able to process huge amounts of sensory data in parallel, meaning computers that can process visual information, recognize images or aid in navigation."

On a more fundamental level, the work is likely to produce a deeper understanding of the physics of gradual control of phase-change materials, allowing for additional fine tuning of the synaptic devices and even greater processing ability.

"This is a significant development," said Wong. "And we are excited to see where it leads."

This work is supported by DARPA SyNAPSE through a collaboration with IBM Research, the National Science Foundation and the Nanoelectronics Research Initiative of the Semiconductor Research Corporation.

Andrew Myers is associate director of communications at the Stanford School of Engineering.

Views: 78

Comment

You need to be a member of 12160 Social Network to add comments!

Join 12160 Social Network

"Destroying the New World Order"

TOP CONTENT THIS WEEK

THANK YOU FOR SUPPORTING THE SITE!

mobile page

12160.info/m

12160 Administrators

 

Latest Activity

tjdavis posted a video
8 hours ago
Burbia replied to Burbia's discussion Trump Receives Marching Orders
14 hours ago
Less Prone favorited Burbia's video
23 hours ago
Less Prone replied to Burbia's discussion Trump Receives Marching Orders
"Bullets can be effective in reinforcing ownership."
yesterday
Burbia posted a discussion

Trump Receives Marching Orders

Netanyahu has made 3 visits to the White house since Trump's second term as President of the United…See More
yesterday
Burbia commented on Burbia's video
Thumbnail

Ben Shapiro Just LOST HIS MIND — There's No Coming Back From This

"Omg. The Ben Shapiro voice that Luke is imitating here couldn't be any more comedic to…"
yesterday
Burbia posted a video

Ben Shapiro Just LOST HIS MIND — There's No Coming Back From This

Get the magnesium your body needs - https://wearechange.shop/product/magnesium-glycinate/Ben Shapiro Just LOST HIS MIND — There's No Coming Back From ThisHig...
yesterday
cheeki kea posted photos
Tuesday
Doc Vega posted blog posts
Monday
Burbia posted a video

A few reasons I don’t like jews. It’s not complicated.

These are the reasons I became antisemitic. It’s not complicated. Sure, I could go on for days, weeks, months outlining everything, but I don’t need to. This...
Monday
Doc Vega commented on Doc Vega's blog post Unusual Discoveries and Headlines
"Less Prone, Thanks Buddy! I'd like to volunteer as a historical reconstructionist! "
Sunday
Less Prone left a comment for t.me/TheIntelligenceLibrary
"Welcome to a revolutionary concept in public communication, the truth."
Sunday
pohonemas33 team is now a member of 12160 Social Network
Sunday
Less Prone favorited cheeki kea's discussion Tartaria
Sunday
tjdavis's 2 blog posts were featured
Sunday
Doc Vega's 7 blog posts were featured
Sunday
Less Prone commented on Doc Vega's blog post Unusual Discoveries and Headlines
"Some incredible pieces of history!"
Sunday
Less Prone favorited Doc Vega's blog post Unusual Discoveries and Headlines
Sunday
tjdavis posted a blog post
Sunday
Doc Vega posted a blog post

First Week of July 1947 an Inflexion Point for Humanity!

The year is 1947 and sometime around July 4th the anniversary of the birth our nation, when a…See More
Saturday

© 2025   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2019 - all rights reserved. unless otherwise noted