Echoes Seen in Early Visual Brain Regions Play Role in Working Memory

The researchers made the discovery using a new technique for decoding data from functional magnetic resonance imaging (fMRI) scanning. The findings are a key step forward in understanding how individuals perceive, process, and remember visual data.

The study's results were published February 18, 2009, online in the journal Nature. "We discovered that early visual areas play an important role in visual working memory,” Frank Tong, coauthor of the research and an associate professor of psychology at Vanderbilt University (Nashville, TN, USA), said. "How do people maintain an active representation of what they have just seen moments ago? This has long been a conundrum in the literature. Before, we knew that early visual areas of the cerebral cortex that are the first to receive visual information were exquisitely tuned to process incoming visual signals from the eye, but not to store this information.”

According to Dr. Tong, scientists have known that the higher-order brain areas responsible for memory lack the visual sensitivity of early brain areas, but one way or another humans are able to remember a visual pattern with extraordinary precision for many seconds, in fact, for as long as they keep thinking about that pattern. The question should be, according to Dr. Tong, where is this precise data being stored in the brain?

"Using a new technique to analyze fMRI data, we've found that the fine-scale activity patterns in early visual areas reveal a trace or something like an echo of the stimulus that the person is actively retaining, even though the overall activity in these areas is really weak after the stimulus is removed,” Dr. Tong continued.

"Visual cortex has always been thought to be more stimulus driven and has not been implicated in cognitive processes such as memory or active maintenance of information,” Dr. Stephenie Harrison, lead author of the research and a graduate student in the Vanderbilt psychology department, said. "By using a neural decoding technique, we were able to read out what people were holding in their visual memory. We believe this sustained visual information could be useful when people must perform complex visual tasks in everyday life.”

Research participants were shown two examples of simple striped patterns at different orientations. They were then told to hold either one or the other of the orientations in their mind while being scanned using fMRI scanning. Orientation has long been known to be one of the first and most basic pieces of visual information coded and processed by the brain.

"Through both evolution and learning, the visual system has developed the most efficient ways to code our natural environment, and the most efficient way to code any basic shape or contour is orientation,” Dr. Tong said. "We used a decoding method to see if the activity patterns contained information about the remembered orientation, and we found that they do. By analyzing responses over several trials, we were able to accurately read out which of the two orientation patterns a subject was holding in his or her mind over 80% of the time.”

The researchers discovered that these predictions were accurate even when the overall level of activity in these visual areas was very weak, no different than looking at a blank screen. This suggests that the act of remembering an image leaves some sort of faint echo or trace in these brain areas. These activity traces are weak but are quite detailed and rich in information.

"By doing these pattern analyses, we were able to find information that was hidden before. We do not know for sure, but it's possible that a lot of information in the brain might be hidden in such activity patterns,” Dr. Tong said. "Using this decoding technique and others, neuroscientists might get a better understanding of how the brain represents specific cognitive states involving memory, reminiscing, or other visual experiences that do not obviously lead to a huge amount of activity in the visual areas.”

Related Links:
Vanderbilt University