O'Reilly Hacks
oreilly.comO'Reilly NetworkSafari BookshelfConferences Sign In/My Account | View Cart   
Book List Learning Lab PDFs O'Reilly Gear Newsletters Press Room Jobs  


 
Buy the book!
Mind Hacks
By Tom Stafford, Matt Webb
November 2004
More Info

HACK
#24
Create Illusionary Depth with Sunglasses
We can use a little-known illusion called the Pulfrich Effect to hack the brain's computation of motion, depth, and brightness—all it takes is a pair of shades and a pendulum.
[Discuss (0) | Link to this hack]

This is a journey into the code the visual system uses to work out how far away things are and how fast they are moving. Both of the variables—depth and velocity—can be calculated by comparing measurements of object position over time. Rather than have separate neural modules to figure out each variable, performing the same fundamental processing, the brain combines the two pieces of work and uses some of the same cells in calculating both measures. Because depth and motion are jointly encoded in these cells, it's possible (under the right circumstances) to convert changes in one into changes in another. An example is the Pulfrich Effect, in which a moving pendulum and some sunglasses create an illusion of the pendulum swinging in ellipses rather than in straight lines. It works because the sunglasses create an erroneous velocity perception, which gets converted into a depth change by the time it reaches your perception. It's what we'll be trying out here.

How It Works

The classic explanation for the Pulfrich is this: the shading slows down the processing of the image of the object in one eye (lower brightness means the neurons are less stimulated and pass on the signal at a slower rate [Hack #11]); in effect, the image reaches one eye at a delay compared to when it reaches the other eye. Because the object is moving, this means the position of the image on the retina is slightly shifted. The difference in image perception between the two retinas is used by the visual system to compute depth [Hack #22]. The slight displacement of the image on the retina of the shaded eye is interpreted as an indication of depth, as in Figure 2.

Figure 2. The geometry of the Pulfrich Effect: although the pendulum is, in reality, at point 1, the delay in processing makes it appear to be at point 2 to the shaded eye. When the eyes are taken together, the pendulum therefore appears to be at point 3, at a different length.

This explanation puts the confounding of depth and motion on the geometry of the situation—the point of confusion lies in the world, not in the brain.

Taking recordings of the responses of individual brain cells, Akiyuki Anzai and colleagues have shown that this isn't the whole story. The confounding of motion and depth goes deeper than a mathematical ambiguity that arises from computing real-world interpretations from the visual images on the retinas.

It seems that most of the neurons in the primary visual cortex are sensitive to motion and depth in combination. These neurons are optimally responsive to some combination of motion and depth; what makes up that optimum combination can be varying amounts of motion and depth. This means you when you see something and judge its distance your brain always also makes a judgment about its velocity, and vice versa. From the first point in your primary visual cortex where information from the two eyes is combined (i.e., very early in visual processing), motion and depth are coupled. You don't get a sense of one without getting a sense of the other.

This may result from the use of motion parallax to detect depth [Hack #22] . Moving your head is one of the basic ways of telling how far away something is (you can see spitting cobras using motion parallax by shifting their heads from side to side to work out how far to spit). It works even if you have the use only of one eye.

The joint encoding theory explains why you can get Pulfrich-like effects in situations with less obvious geometry. If you watch television snow with one eye shaded, you will see two sheets of dots, one in front of the other and one moving to the left and one moving to the right. The reasons for this are complex but rest on the way our eyes try and match dots in the images for both eyes and use this matching to calculate depth (stereoscopic vision). Adding a shade to the image in one eye creates a bias so that instead of perceiving all the dots at a single average depth we see two sets of skewed averages, and because depth and motion are jointly encoded, these two planes move as well (in opposite directions).

See also:

  • Anzai, A., Ohzawa, I., & Freeman, R. D. (2001). Joint-encoding of
    motion and depth by visual cortical neurons: Neural basis of the
    Pulfrich Effect. Nature Neuroscience, 4,
    513-518.

  • The Psychology Department at Southern Illinois University
    Carbondale's Pulfrich Effect page (http://www.siu.edu/~pulfrich) has many links
    for further information.



O'Reilly Home | Privacy Policy

© 2007 O'Reilly Media, Inc.
Website: | Customer Service: | Book issues:

All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners.