Stereoscopic imaging Technology (I)

Michael Starks
3DTV Corporation
1863 Pioneer Parkway East #303
Springfield, Oregon 97477


ABSTRACT

Following some comments on the nature of stereo perception as it relates to stereo video displays, a number of areas of interest are briefly reviewed and accompanied by extensive citations from the patent and technical literature. These include single camera(70 refs.) and dual camera(100 refs) stereoscopy, compatible 3D recording and transmission(57 refs.), head mounted displays(85 refs.), field sequential stereo(285 refs.), and autostereoscopic systems including lenticular(64 refs.), parallax barrier(22 refs.), stereoptiplexer(17 refs.), integral imaging(24 refs.), direction selective mirrors, lenses or screens(26 refs.), volumetric displays(133 refs.), holovision(13 refs.), stereoendoscopy(14 refs.),and stereosculpting(15 refs.). Interfaces for stereo graphics and the interaction of stereo video and stereo graphics are also discussed.


HISTORY

Stereoscopic television was a goal of the earliest experimenters with this new medium. Electronics pioneers such as Hammond, Logie Baird, Lee DeForest, Zworykin and others described 3DTV devices in their early patents(U.S. 1,725,710, 2,107,464, 2,163,749, British 266564, 292365, 321441, 552582, 557837, 562168, 573008 ). Logie Baird seems to have been the first to actually build working devices. The first commercial device may have been Dumont's dual CRT system that appears to have been sold in the 50's. Experiments with anaglyph(colored eyeglasses) video were numerous and broadcasts were done at least as early as 1953. Anaglyph broadcasts continue to be made sporadically and anaglyph cassettes and videodiscs appear occasionally but this technique, like those employing Pulfrich or prism glasses is hopeless for high quality or comfortable viewing with video, but is better with computer displays. James Butterfield broadcasted side by side stereo images for viewing with prism glasses in Mexico in the 50's. He was one of many to make stereo systems with dual cameras viewed through a binocular stereoscope. He was also one of the first to use polarized glasses to view anaglyphs by placing dichroic polarizers on the face of the CRT, an idea later refined by Benton(U.S. 4,431,265). Polarized glasses for use with dual cross polarized CRTs as well as, interdigitated images on a single display covered with crossed polarizers were proposed many times in the patent literature but the problem of manufacture prevented commercialization until Faris applied lithography to create the micropolarizer arrays(Faris). This may be a viable alternative to field sequential techniques where flat screens or projection are involved, but for CRT's it has the same problem of aligning pixels with the optical elements through a thick glass surface as the lenticular technique. Field sequential devices were described in the patent literature many times without a commercially viable product appearing until the 1980's.

Shmakov, working in St. Petersburg, Russia, devoted much time to this field during the 40's and 50's and wrote the first text on the subject in 1953 but it only appeared in 1958(Shmakov). The proceedings of the SPIE(Merritt and Fisher) and several symposia(Hamasaki-1992) are the best recent sources. The literature on stereoscopic video is large and the patent literature vast. The present review will concentrate on the field sequential technique since it is currently dominant and is likely to remain so well into the 21st century.


STEREOVISION AND ELECTRONIC DISPLAYS

Stereo vision evolved hundreds of millions of years ago in invertebrates as a critical survival mechanism. The first definitive demonstration of stereovision in insects was recently accomplished by a Swiss researcher who glued tiny prisms to the eyes of a praying mantis, which then missed its prey by precisely the calculated amount. Humans have become so genetically degenerate that serious visual problems including loss of stereo perception are common. The vast majority have good depth perception but sophisticated tests show wide variations. The individual variations in stereovision should be of vital concern in the creation and use of stereo systems but are usually completely ignored. As with all other physiological systems, stereovision may improve rapidly with use, both short term and long term. Repeated use of a stereo display can lead to more rapid fusion and greater comfort. Except for a few persons who practice frequently with a wide variety of stereo displays and images, it is not possible to evaluate a stereo display system or image by casual examination. As with any other parameter, a randomly selected individual may be several standard deviations from the mean in either direction including perhaps 10% who have severe problems with stereo under any conditions and 10% who qualify as stereo prodigies due to their rapid, prolonged and comfortable fusion of images which may be unpleasant or impossible for the average person, or to their other abilities such as making very fine depth determinations. Variation with age is to be expected as is a circadian rhythm. Evaluation by a battery of users with known stereovision abilities using the hardware and software exactly as it will be employed by the end user is essential. This should include frequency and duration of use, similar imagery, ambient illumination, viewing distance and exactly the same monitor. The latter is necessary since in the dominant field sequential technique the exact hues and saturations of the images, contrast and brightness and the different persistences of various phosphors are very important. Also, the same hardware and software may yield dramatically different results if the color of figure and background are altered. Long persistence green phosphors are a common problem. Screen size and viewing distance, horizontal and vertical parallax, binocular asymmetries(illumination etc.) and nonstereo depth cues are critical. Most stereo displays and images are created and used with little attention to these factors even when highly skilled personnel are involved. A vital component of a stereo project should be a stereoscopist having extensive experience with many systems and images. This is seldom considered necessary, resulting in defects in hardware, software , viewing conditions and viewers and less than optimal images that are regarded as natural limitations of electronic stereoscopy or of field sequential input or head mounted displays.

It is even said that these are unnatural ways to look at images(as though 2D CRT'S, photos, and books grew on trees). This brings to mind the classic experiments with prism glasses performed three generations ago. When one first puts on glasses which turn the visual world upside down, it is nearly impossible to function. After a few days subjects learn to navigate and the world gradually appears more or less normal. The key phrase in the evolution of most organic systems is "plasticity equals survival". There is even some recent evidence that many strabismic (cross eyed) subjects have some depth perception due to a type of field sequential activation of the optic pathways by the reticular activating system in the brain stem.


FLICKER AND ASYMMETRICAL ILLUMINATION

Another common scapegoat for inadequate hardware, software and lack of stereo training is flicker most noticeable in standard frequency(e.g., 60Hz) field sequential systems. Flicker has been the subject of a great deal of research, nearly all of it monoscopic. It varies with many factors, especially screen brightness and screen size. We must distinguish the flicker due to ambient illumination("room flicker") from the flicker due to the display("image flicker"). In addition, the image may flicker due to high luminosity areas or to low rates of update. The image may still flicker even at 120Hz screen refresh if the image is not updated in the proper way(Woods). Decreasing the level of ambient illumination in the room can reduce the room flicker to imperceptible levels while reducing screen luminosity with brightness and contrast controls will reduce image flicker to low or imperceptible levels. This may reduce the contrast excessively and some level of image flicker is usual in 60Hz displays. A white wall will have a noticeable flicker which is exacerbated if a man in a dark shirt is in front of it and even more noticeable if he has a lot of horizontal parallax. The same conditions will tend to give considerable crosstalk with passive glasses or even autostereoscopic systems. However, when the image lacks high luminosity areas flicker and crosstalk may be nearly imperceptible even at fairly high brightness. This condition occurs frequently in natural subjects and can be avoided much of the time if one has the field sequential display in mind.

It occurred to me a decade ago that one could eliminate flicker by color coding the two images in every field and viewing them with field sequential anaglyphic shutters. Field or frame one would contain the right image on the green phosphor and the left on the blue and red, field two the reverse and the viewer would wear dichroic LCD shutters which would filter out the other eyes image. Each eye would get 60 images a second. The coding could also be done with 3 color dichroic shutters and 3 field or frame encoding. A color flicker would then replace the brightness flicker but since the visual system is less sensitive to color flicker this should not be bothersome. British inventor Graham Street patented this approach and actually tested it with rotating color wheels. He maintains that the resulting image was entirely satisfactory and flickerless. The Liquid Crystal Color Shutter invented by Tektronix and now marketed by several companies would probably be suitable for this use.

A related approach would work with three tube video projectors. An LCD polarizing plate is placed over the each of the three tubes. Field one could have the right image on the red tube and the left on the blue and green and field two the reverse. The polarizing plates would switch their polarizing angle by 90 degrees each field so as to images so as to always permit the right eye image to pass the right eye polarizer of the viewer wearing passive standard polarizing glasses. Again, each eye would get 60 images a second. Both these systems would work best with RGB input from video or computer systems.

An entirely different approach has been taken recently by Sadig Faris of VREX Inc. who has used lithographlic techniques to interdigitate orthogonal polarizers. Alternate strips of such a polarizing sheet can be aligned with LCD projection panels, LCD projectors or LCD, electroluminescent, or plasma screens to give flickerless stereo viewable with standard passive polarizing glasses. In some cases, such as the common LCD projection panels, the NTSC to VGA conversion gives perfect stereo from interlaced field sequential stereo with standard equipment retrofitted with a VREX polarizer. Other advantages are low cost, nonintrusiveness and retrofitability.

LCD displays could be engineered from the beginning to give cross polarized stereo pairs but except for a pair of $100,000 custom LCD projectors demonstrated by Sanyo in 1995, no such product has appeared, in spite of its description by various Japanese researchers.

Asymmetrical illumination of all or part of the image in stereo or autostereo systems will exacerbate the flicker even if the difference is only in a small area and even though it may be only a few percent off. Beldie and Kost, studying an autostereo display, found that asymmetries in the range of 3 to 6dB were noticeable and that for moving objects, even a small area of the image with 0.2dB difference was perceived. In a field sequential system Diner found that he had to take special measures to match the camera illuminations and when they were brought to within a few percent, there was a dramatic reduction in flicker. Perhaps as little as 3% difference in transmission of the right and left lenses of LCD glasses may be too much and none of the glasses manufacturers to date seem to have controlled for this. Once again, one is reminded that a great many stereo projects yield modest results which are blamed on hardware, software, or difficulties with stereo perception, but are really due to poor technique. A high degree of stereoscopic literacy is still a rare commodity.

A useful device to have would be an intelligent white gamma reducer which monitored the video pixel by pixel and automatically turned down the brightness of high luminosity areas. Such devices have been discussed in various contexts, but only Stephens(U.S. 4979033) seems to have specifically addressed stereo. I did an experiment with an expensive digital video device called a DA Vinci and found that turning down whites about 10 IRE units and turning up greys and blacks reduced flicker while retaining contrast.

With stereo graphics, it is even easier to avoid serious flicker by avoiding high luminosity areas. A black wireframe figure on a white field at 60Hz will have a serious flicker while the reverse can have no perceptible flicker provided ambient illumination is modest. This does not mean the room has to be movie theater dark, but just lacking in direct outdoor or nearby overhead lights. It is usually easy to turn up the frequency of PC video cards to decrease flicker and 3DTV Corp. was the first to include an automatic FlickerFixer™ in its software. Most television sets can be driven at higher frequencies than the normal 50 Hz (PAL) or 60 Hz (NTSC). One of the many capabilities of the SpaceStation™ (marketed by 3DTV Corp.) is the production of variable frequency field sequential stereoscopic NTSC or VGA out put from 60Hz NTSC input. Of course, as frequency increases, the number of lines per field eventually decreases. At 72Hz on a Sony TV, there was about 1/4 inch of black at the top and bottom of the screen. Experiments show that most TV’s can run at 66 to 70 Hz NTSC and flicker drops off noticeably even at the lower rate (33 Hz/eye). A variable frequency external FlickerFixer box could be built for about $200 as a consumer item, but a custom LSI chip could reduce cost to $20. Broadcast of higher field frequency signal for stereoscopic programs is also a possibility.


BANDWIDTH, INFORMATION AND STEREO

It is frequently stated that stereo images will be of inferior quality to mono images on the same system since each eye is getting half the bandwidth. With graphics, it is often hard to tell since there is usually no clear reference but with standard video camera imagery, the subjective resolution is often strikingly superior. Ordinary consumer NTSC tv's with well done VHS stereoscopic tapes look equal or superior to any HDTV I've seen. One reason is that stereoscopic acuity(resolving ability) is superior to monoscopic acuity. This is due to the fact that that stereo will usually have a greater information content than mono and the highly sophisticated image processing systems in the brain have been evolved to take advantage of this.

In the extreme case, two views having a million pixels each, taken respectively from the right and left sides of the head will present a richer image processing potential than a single two million pixel image taken from directly in front. Of course, there are a wide variety of possibilities and the relative 2D vs 3D vividness, usefulness and information content will depend on precisely how the images are captured, processed, stored, displayed and used.

There are probably neural hardware functions for edge enhancement, shadow detail, perspective, texture, glitter, sparkle, feature extraction etc. which work only (or best) when the stereo systems in the optic cortex are activated. It is to be expected that these will interact in complex ways. The effects of training, fatigue, motivation, drugs and other factors on perception suggest that these functions are programmable to varying degrees(again, this will vary greatly with the individual). This is fertile ground for research, especially with the recent availability of low cost means for field sequential generation and presentation of stereo images. The SpaceStation™ from 3DTV Corp. and the Tiga Stereoscope from Vision Research Graphics are unique devices for such studies.


SINGLE CAMERA STEREOSCOPIC VIDEO

There are several approaches for creating stereo images with a single camera. One of the simplest and most frequently used has been to place an optical adapter in front of the existing lens. A lens of this type employing liquid crystal shutters was briefly marketed by Azden Corporation in 1990. These lenses have many limitations such as the need to operate at telephoto, ghosting, and lack of control over interaxial, though a recent design minimizes some of these (JAP-1-147444).

Alternatively, various types of mechanical or electrooptic devices can block the light through parts of the optical path to create field sequential stereo pairs (USSR-138273, 369732, 568220, 1125783, 1109959, US-2508920, 4486076, 4943852, 4281341, 5028994, JAP-57-5490 to 5493, 57-14268 and 14269, 57-25783, 59-225692, 62-98895, 63-227192, 1-22187, 1-55998, 1-41397, 1-41398, 1-47192, 1-47193, 1-132294, 57-72134, 63-237687, 57-14268, 57-14269, 57-75089, 57-62686, 56-158590, 56-83193, 83194, 83195, 83196, EP-269075, GER, 3214021, 2032977). The fact that a small interaxial (stereo base) results from dividing the lens into right and left halves means this technology is only good for close-ups. Stereoendoscopes using internal liquid crystal shutters have recently been created by several companies (SOCS, International Telepresence, OLYMPUS).

An interesting variation is offered by cameras which translate in the Z-axis or have elements which cyclically change their index of refraction to give depth information (JAP-61-80992).Limitations of sensors have led to somewhat complicated line scanning arrangements for single sensor infrared stereocameras (4574197, 4682029), but recent advances in sensors and image intensification may make these obsolete. Alternatively, mechanical, optical or electrooptic barriers can divide up the frame or interdigitate the stereo pair on the image surface every field (USSR-510,812,1107344, JAP-51-958, Masters, US-2317875, GER-3205483). Palmer devised a method for getting an over/under wide aspect ratio stereo pair with one or two cameras in 1951 (US-2786096-cf US-4583117, 5049988). Anamorphic fiber optics which could be useful in this application are now feasible(U.S. 5015065). Many of these approaches using single sensors have had as their object the input for an autostereoscopic display (GB-1401003, EP-335282, 4943860, FRE-1362617, US-4945407, 3932699).

If the subject or camera are moving, stereo pairs can be created by various optical, electrooptic, mechanical or electronic means (JAP-1114293, GB-2180719, US-4231642, 5014126). This approach has been the subject of a great deal of interest in recent research in robotics, stereophotogrammetry and pattern recognition. Light can be scanned over the surface of an object from one or more locations and its spatial location, frequency, time of flight or polarization can be analyzed by the multiple elements of a single sensor to yield positional information (US-4945408, 5018854, 5024529, JAP-56-34289). In some cases this technique can replace the lens and camera with photodiodes. Also, two images can be passed through colored filters, completely overlapped every field and separated at a subsequent stage with colored filters or electronically (USSR-873464, 291376). An inexpensive lens of this type is available from Spondon Film Services in Derby, England. Phillips' method of underscanning the raster on tube cameras could give field sequential stereo suitable for closeup work (US-4740839).

Finally, much effort is being expended in pattern recognition on extracting depth information from a single point of view combined with other information about the scene (US-4754327, Lippert, Alvertos). Any of these imaging techniques with one or more cameras can be combined with a wide variety of display modalities including stereoscopes, polarized, prismatic, anaglyphic, mechanical or electrooptic spectacles, or autostereoscopic (no spectacles) means including lenticular, louvered, or parallax barrier screens as well as large diameter mirrors or lenses or a wide variety of volumetric displays.


DOUBLE CAMERA STEREOSCOPIC VIDEO

Hundreds of researchers have created mechanisms for controlling various parameters of a stereocamera pair. Though much of the work on stereophotography and stereo motion pictures is relevant, we will limit the discussion to some of the more recent efforts with video. The two cameras need to be kept aligned within close tolerances in all three axes. Most recent work has taken this for granted and Toshiba's patent on it's three axis adjustment means for the two lenses of it's stereocamcorder is one of the few to describe this mechanical setup in detail (JAP-177530, cf. JAP-63-164596, 63-164597, 1-89796). There is a need to control the zoom, focus, interaxial (distance between the cameras) and the convergence point of the two optical axes. Since there are fairly precise relationships between these parameters, much work has been directed at interlocking several functions. The older literature described mechanisms for manual interlock of focus and convergence (USSR-506,953, 506954, 527030, 803128, 902323, 918926, 849547, 720819,506954, 228069, 471689, 1053329, 445175 , JAP-51-142218, 60-216205, 62-100095, 63-228141, 1-11254, FRE-1251830), or of zoom and focus (JAP-57-62687), or for manual adjustment of one parameter at a time for both cameras (JAP-59-192239, 1-225936, 1-212079, 1-11490). Some altered convergence by changing the scanning position on the image pickup surface (JAP-57-109492, cf. US-4740839,5049988, 5063441).

More recent efforts have usually attempted to automate these functions with application specific circuits or with programs written into a dedicated microprocessor or general purpose computer (JAP-56-106490,61-101882, 61-101883, 62-21396, 62-122493,62-266534, 62-266535, 63-228141, 63-164594, 63-153987, 1-212976, 1-93983, 1-93984, 1-251990, GB-2168565, USSR-873458, 552729, 1,148128, 1095454, EP-332403, 146476, US-4819064, 4818858, 4881122, cf. 5020878). Some have relied on digital storage and image processing to compensate for binocular asymmetries from zooming (JAP-1-231590), to reduce excessive horizontal parallax (US-4677468, 4723159 and many others), to effect simultaneous image capture (JAP-1-86692, 1-68192, 1-93977, 1-93978, US 4772944) or to eliminate camera shake (JAP-1-228392. Morishita of NEC has suggested (US-4677468) increasing aperture to blur objects with excessive parallax and automatic locking of the video levels of the two cameras-the latter also described in Japanese patents 63-158993 and 1-177795. Kinoshita also dealt with luminance matching and convergence (JAP-63-7094). A clever Japanese patent shows how to automatically adjust image size during zooms to size of the display to avoid image cutoff and miniaturization (63-296489). We are clearly entering the era of the "smart" stereocamera. Several companies have offered prototypes for sale including Ikegami's system with broadcast cameras and 120Hz scan converter for about $140,000, and one from 3DTV Corp. using for $10,000 which has microprocessor controlled synced zooms. Stereoscopic video is most conveniently and inexpensively created with a pair of genlocked cameras and the Model 100(composite) or Model 200(component) StereoMultiplexer available from 3DTV Corp. These units are battery powered and about the size of a VHS cassette.(Starks, 1990) Stereo video can be genlocked to stereo graphics easily, but one has to be alert to match up the right eye pairs. The same comments on flicker apply as for graphics with the addition that cameras should be very closely matched for luminance(Starks, 1992). The multiplexers give field sequential stereo for recording and for aligning cameras and viewing stereo with any CRT. Hardware for converting 50 or 60Hz stereo to higher frequencies is available from 3DTV Corp.

Demultiplexing of the field sequential image can be done by the Model A StereoDemultiplexer from 3DTV Corp. which separates out the R and L images for dual videoprojection viewed with passive polarized glasses. Flicker is a problem with tube projectors but LCD projectors give little flicker. LCD projectors may require orientation of polarizers different from the movie standard, but this is easily corrected with half wave plates. The Model A takes in composite field sequential video and puts out 30Hz right eye fields alternating with 30Hz black from one BNC and 30 Hz left eye alternating with 30Hz black from the other. The Model B does the same thing with composite or two or three component video. The SpaceStation marketed by 3DTV Corp. in 1994 adds back the missing fields to give the 60Hz right and left fields. To eliminate the trouble of dual VCR record and playback systems, the SpaceStation also permits the two fields to be record on one tape in a side by side or above/below compressed format. This will again give dual 60Hz output on playback.

Timecoding of tapes and playback with dual computer controlled VTR’s permits cheap flickerless high quality stereo. It is also useful to have separate R and L tapes when doing standards conversion since standards converters will destroy field sequential stereo. The R and L tapes can be separately converted and then mixed into stereo in the new standard with the StereoMultiplexers. However this is likely to produce serious artefacts. 3DTV Corp. markets a unique standard converter, that is compatible with field sequential stereo.

Other techniques have been proposed and occasionally marketed, but they involve use of expensive, bulky, nonstandard equipment for recording and display. A sensible approach is to begin with the StereoMultiplexer at 60Hz and move to the dual 60 Hz if desired.

Others have devised new techniques to improve camera performance. Karibe of Sharp Corp. described an automatic camera tilt detector (JAP-62-276987, 62-266533). Many have described camera switching, digital storage and/or processing or novel display techniques to improve the actual or apparent vertical resolution since there is often a decrement in this parameter (JAP-63-164598 and other cited later). Shimada of SONY mixes arbitrary numbers of left and right eye fields (JAP-1-202985). Osawa uses two cameras with electrooptic shutters and a single common optical element to facilitate synchronous zooming (JAP-1-54438). It has occurred to several researchers that one or more high resolution black and white cameras can be combined with a low resolution color camera to give a high resolution stereo image that would be otherwise unobtainable or very expensive (JAP-62-73896, 63-177690, 1-177292). A Mitsubishi patent employs an ultrasonic sensor on the monitor to automatically adjust the camera parallax to a viewers position (JAP-60-236391). Yatagai shows how to transfer charges between two CCD cameras to obtain low light stereo (JAP-1-93982). One of Maezawa's many stereo patents for Sharp describes a simple optical device for matching stereo camera pairs (JAP-63-143524).

Many designs have been directed at robotics, photogrammetry or pattern recognition applications (JAP-60-140113, 60-27085, 60-119191, 60-119192, Schenk and Toth). Hitachi engineers have created sophisticated automatic stereocamera controls for incorporation in a robot used in nuclear facilities (JAP-62-115989, 62-21396, 62-122493). The Harwell nuclear plant has an elegant system (Dumbreck et al., Scheiwiller et al.) which uses computer control to couple focus and convergence but they note that cases arise when the operator should be able to decouple these parameters. This system has also been installed in plants in Korea and elsewhere. Suzuki's stereocamera automatically tracks objects and adjusts the zoom to keep them centered (JAP-60-152193). Multiple fiber optic bundles coupled to sensors have been used as stereo pickups (JAP-60-58789). It is also feasible to use three or more cameras with rapid updating to obtain the best stereo pair or to extract depth information with algorithms that combine all viewpoints (JAP-61-125685, EP-0199269, Cheung, and Brown, Dhond and Aggarwal, Stewart, Wilcox et al.). Copeland suggests using wing mounted cameras as a navigational aid to increase interaxial from the normal 65mm to 65m (U.S.-4805015). Simulator experiments on terrain following with stereo video were carried out in the 1970's (Bruns).


FIELD SEQUENTIAL STEREOSCOPIC VIDEO

Much of the early research on color television involved field sequential color systems and many of these workers described means for using their devices in a stereo mode. Baird's efforts (GB-321441) are well known but others were even earlier. Hammond's patent, filed in 1923, described sequential color and stereo (US-1725710). Interestingly, a toy company briefly marketed a field sequential stereo, field sequential color vector graphics system sixty years later. Many subsequent efforts used mechanical shutters for projection and or viewing of stereo slides, motion pictures or television (US-2362030, 2,384259, 2384260, 2408115, 2825,263) and patents on such devices continue to appear (GER-3303739, W0 79/01035) but very few resulted in a commercial product. Knauf's "rotating beer can" (US-3464766) is now obsolete as is the Matsushita viewer for the Sega Subroc 3D arcade game (JAP-56-69985, 56-155917, 56-156079, 57-5490, 57-5491, 57-5492, 57-5493, 57-14269, 57-25783, 59-171392, 60-7291).

Kerr cells and related electroopic polarization rotating devices were employed from the earliest days of television, mostly as a means for obtaining color in field sequential or line sequential schemes and stereo means were often described (US-2002515, 2118160, 2417446, 2616962, 2638816, 2665,335, 3358079, GER-736457, 2055935, 2140944). When the transparent PLZT ceramics became available in the 1970's, they were quickly put into service but were soon supplanted by liquid crystals. The amount of research as evidenced in the technical literature has become staggering. Japanese patent applications on field sequential stereo have exceeded 400 in the last decade alone. A few of the earlier non-Japanese patents to specifically mention LC shutters are those of Varga (Romania-58504), Schieckel (GER-2111067, Hossmann (Swiss-534365), Kratomi (US-3737567), Roese (US-4021846) and Mears (GB-1523436).

The availability of low cost LC shutters greatly stimulated research and means were described to permit video field recognition to ensure the right eye image getting to the right eye (US-4145713, 4387396, JAP-63-164788,1-245693,1-86693), to sync the glasses via a photodiode on the monitor screen (JAP-62-209994, 63-214095, 63-294096, 1-248796,1-68191), via a magnetic pickup on the monitor (JAP-63-248294), or without wires via infrared, radio or ultrasonic transmission (JAP-58-62995, 62-91095, 62-239784, 63-1286, 63-64016, 63-59089, 63-117596, 63-64016, 1-67095, 1-68191, 1-17590, 1-206798, US-2388170, 3621127, 4286286, 4424529, 4562463, 4732457, 4979033, 4967268, FRE-2334255, 2399173, GER 3214021). Many patents contained variations on LC driving circuitry, often with the aim of decreasing the flicker of 60Hz systems (JAP-61-227498, 61-277918, 62-166314, 62-204226, 62-242914, 62-254118, 62-266996, 63-31393, 63-31394, 63-158994, 63-43621, 63-205641, 63-213821, 63-290485, 63-314991, 1-44421, 1-51789, 1-51790, 1-86694, 1-103394, 1-149590, GER-3413211), others were concerned with keeping the shutters transparent when the viewer looked away from the display (JAP-63-212290, 62-231578), when the viewer was looking at the camera of a videoconferencing system (JAP-63-194497), or when viewing a 2D part of the display (JAP-63-215195). One NTT researcher even devised means to remove the glasses entirely by using stored images of the viewers (JAP-1-251989). Some work has been directed at improving performance by novel methods of constructing the shutters (JAP-62-89925, 62-71395, 62-156619, 62-166314, US-4884876). Only a few of these designs ever were marketed. Four types were available from 3DTV Corp. in 1990 for prices ranging from $50 to $200 with a variety of drivers able to accept video or TTL input. These all work well at 60Hz and several perform well at 120Hz, particularly if the background and foreground hue and saturation are adjusted to minimize flicker and crosstalk. By 1992, four different companies had marketed wireless LCD shuttering glasses.

All the above work applied to twisted nematic LC shutters (and in a few cases to PLZT ceramics) incorporating crossed polarizers. Many have suggested using ferroelectric LC shutters (JAP-63-30088, 63-64016, US-4772943) because of their fast switching times. Vision Research Graphics introduced a commercial product in 1992. When used in conjunction with a special amber-green monochrome phosphor, there is virtually no crosstalk(ghosting). Some effort was made to develop cholesteric LC shutters for stereo viewing by scattering without polarizers by various Japanese scientists, and by Milgram in Canada (US-4698668), and Noble and McSherry in California. They seem to offer no advantage since they appear not to decrease flicker and give a milky look to the image, but Noble suggests using a black matrix to reduce scattering. Milgram markets them for use by perceptual psychologists.

Tapes in the field sequential format are compatible with all standard NTSC and monitors except some of the IDTV products and LCD TV's or LCD projectors which mix fields. Some VCR’s by Instant Replay (Miami, Fl. U.S.A.) or the Akai(now Mitsubishi) VSR19EMb, will play NTSC at 60Hz on PAL TV's, but none appear to be 3D compatible. This works with most PAL and SECAM monitors and receivers because they lack vertical countdown circuits and will sync to 60Hz. In some PAL countries(e.g., Sweden) nearly all the TV's accept 443MHz 60Hz NTSC. NTSC and PAL-M (Brazil) VCR's should play 3D NTSC tapes on PAL and SECAM TV's but without color. This trick of driving consumer televisions at higher frequencies should also work for 3D videogame systems and computer graphics and is employed in 3DTV Corp’s FlickerFixer device (SpaceCard).

The 60Hz flicker can be virtually undetectable if the ambient light is low, monitor brightness is adjusted and images avoid large light areas. Acceptance by consumers and professionals has been excellent. Sega sold over 100,000 of their 60Hz home 3D game systems, mostly in the U.S. and Japan and perhaps 40,000 50Hz systems in Europe and elsewhere and Nintendo sold some 80,000 of their 60Hz units in Japan in the late 1980’s. Systems operating at 60Hz have been successfully marketed for the Atari, Amiga, and recently for PC's. Nevertheless, there has been much effort directed at methods of reducing flicker. Some have processed the video to reduce areas of high luminosity (U.S. 4979033). Many workers have suggested eliminating flicker entirely by doubling the field rate to 120Hz. Some have created a four fold interlace by inserting extra vertical sync pulses with standard monitors (US-2696523, 4523226, 4583117, 4517592, cf. US-2389646) while many others used field stores and broad bandwidth monitors to eliminate flicker and perform other image manipulations (JAP-54-30716, 56-168484, 57-87290, 57-119584, 57-138285, 58-139589, 60-100894, 60-203095, 60-223282, 60-263594, 61-113389, 61-273094, 61-293093, 62-86997, 62-132491, 62-133891, 62-136194, 62-145993, 62-150591, 62-265886, 62-278889, 63-30088, 63-31295, 63-46091, 63-88994, 63-95795, 63-116593, 63-131685, 63-131686, 63-133791, 63-164598, 63-181593, 63-219293, 63-224495, 63-231590, 63-232790, 63-245091, 63-258187, 63-266980, 1-27390, 1-39187, 1-47194, 1-47195, 1-47196, 1-54886, 1-61192, 1-61193, 1-69196, 1-93988, 1-93989, 1-93993, 1-93994, 1-212091, 1-252093, US-4,393400, 4672434, 4772944, USSR-1166344) and many others. Siemens, Philips, Sony, Metz and Grundig have marketed limited numbers of tv sets with field doublers, at least some of which can be modified to be stereo compatible(Woods et al.). The 3DTV Spacecard is unique in its ability to give continuously variable frame rates for NTSC or VGA, stereo output from field sequential NTSC 60Hz input. Ikegami Sony-Tek and 3DTV Corp. have introduced units to double the field rate of standard field sequential 3D video. Cahen in his French application of 1948 (US-2665335) and many subsequent researchers (US-3358079, 4772943, JAP-63-46410, 63-116591, 63-116592, 63-245091), noted that one can switch at line rate. Like 120Hz switching, this will eliminate flicker of ambient light, but will not eliminate image flicker unless each eye is given about 45 or more new images each second.

The use of two videoprojectors with crossed polarizers and a front or rear projection polarization preserving screen gives a large screen and allows the use of cheap, standard polarized glasses. In general, it will also give less ghosting than with a single field sequential display whether projected or direct view with active glasses or with passive glasses and screen polarization modulators. This is due to phosphor persistence in the active glasses case and phosphor persistence combined with scattering by LCD modulator in the passive glasses case, since these problems are absent with the cross polarized dual projector system. Two genlocked computers can generate the images or two video players can be run in sync with right eye and left eye time coded tapes and a suitable edit controller. A single field sequential source input to the StereoDemultiplexers. will output two separate signals of about 30Hz(depending on input frequency) alternating with video black. This will flicker most with 50Hz PAL input and CRT projectors and least with 60Hz NTSC input and LCD projectors. The LCD projectors are slower and flicker may be almost undetectable even when each projector is input with 30Hz NTSC. Some LCD projectors(e.g. Eiki, GE models available in 1992) require the use of polarizers at a nonstandard angle(45 degrees to right and left is standard for polarized glasses) but others such as some from Sharp work at the standard angle. A half wave plate will rotate the polarization place if needed.

The following table may be useful to those trying to decide which display option will best suit their needs. It is highly subjective, being based on my own judgment, and image quality will also vary with subject matter, quality of stereo, monitor or projector model, ambient illumination and other factors. Active glasses are LCD shuttering glasses. Passive glasses are circular or linear polarized glasses with polarized images created with an active LCD plate(StereoPlate) on the single monitor or projector or with polarized sheets placed over the lenses of the double projectors. The Model A Demux sold by 3D TV Corp. separates field sequential composite video into separate right and left channels with 30Hz images alternating with 30Hz black fields. The Model B Demux does the same with composite or component input. HighVision™ is the smart line doubler marketed by 3DTV Corp.

Volver