Stereoscopic imaging technology (II)

Michael Starks
3DTV Corporation
1863 Pioneer Parkway East #303
Springfield, Oregon 97477

The Space Station(TM) introduced by 3DTV Corp. in 1993 has both demultiplexing and field doubling and will give two fields out for each field input. Thus, each projector will have the full number of fields and will give completely flickerless 3D It also will shift either field horizontally or vertically to correct parallax errors or create real time stereo image manipulations. Various models will permit composite, YC, RGB or VGA input, and above/below or side by side compression and/or decompression of stereo pairs. It also performs many other unique stereo image manipulations.

The use of Kerr cells at the CRT with viewers wearing passive polarizing glasses likewise grew out of the early work with sequential color schemes and is mentioned in many of the above citations. Many other references specifically describe screen switching (GB-1448520, JAP-50-75720, 52-110516, 54-101689, 60-153694, 60-203095, 61-9618, 61-203794, 62-71394, 62-81620, 62-299932, 63-85717, 63-182991, 63-203088, 1-128039, EP-0136696, 0223636, 0264927, USSR-544183, 642884, 657673, 1166344, Neth. Appl. 7807206, US-3858001, 4719482, 4719507, 4792850,4870486, 4879603, 4877307). 3DTV Corp. sells a StereoPlate for polarized projection with a single videoprojector.

Much attention has also been directed to adapting existing tape and disc systems for high quality 3D recording and playback. An obvious route is use of a dual head VCR and/or double speed rotation (U.S. 5050010, JAP-62-102679, 62-165488, 62-166669, 62-245784, GER-3234846). David Burder and his colleagues in England have modified an old quad VCR for multichannel 3D. The new JVC digital VCR (1995) is capable of recording two full bandwidth composite signals. Work on 3D discs has included Sanyo's dual system with right and left images on separate discs, Hitachi's machine with the two images on opposite side of a disc (JAP-276393), Pioneer's optical disc recorders (JAP-63-266980), Alps' magnetic disc recording on two adjacent tracks (JAP-1-109892), and numerous others with field sequential or dual track systems usually with 2D compatibility (JAP-55-50638, 55-50639, 61-212192, 61-252778, 62-91095, 62-128294, 62-176394, 62-260496, 62-266995, 62-276989, 62-285595, 62-295594, 62-295595, 63-6992, 63-116590, 63-151293, 63-227296, 63-228895, 63-229994, 63-232789, 63-276393, 63-316981, 1-49396, 1-94794, 1-109989, 1-109990, 1-177294, 1-183993, 1-206798, US-4739418). A field sequential 2D-3D compatible system was offered for a brief period by several Japanese companies in the now defunct VHD system.

Much thought has gone into means of interlacing fields and/or doubling lines (US-3991266, 4736246, 4772943, JAP-61-212191, 61-212192, 61-280193, 62-145993, 62-154894, 62-210797, 62-230292, 63-94794, 63-164598, 1-24693, 1-55999, 1-225295) or otherwise processing video (JAP-61-24393, 1-272286, 63-84292, 63-84393, 63-84394, 63-84395, USSR-303736, 1188910, Woods et al., and many others referenced above) for improving the resolution in field sequential systems. Lowell Noble and Ed Sandberg of SOCS Research in Saratoga, Ca. have developed a stereo compatible board which line doubles and image enhances to give superb 2D or 3D on any VGA or other multisync monitor or projector. Two different groups applied ghost canceling techniques for eliminating crosstalk due to slow phosphor decay (JAP-55-85181, 56-106491). Some workers have described means to compensate for subject motion (JAP-1-165293, 1-171389) while many others have devices for parallax reduction for reduced ghosting and visual fatigue or to manipulate the stereo window (JAP-57-21194, 63-62485, 63-86691, 63-142794, 63-176081, 63-227193, 63-245090, 63-306795, 63-314990, 1-265798, US-4399456).


INTERFACES FOR STEREOSCOPIC COMPUTER GRAPHICS

Until recently, those who wished to work with stereo graphics have had to spend many thousands of dollars for cards, multisync monitors and LCD glasses and have then had to write their own software systems. Gloves or 6D mice have cost thousands more. Beginning in 1990, 3DTV Corp. began introducing low cost system including universal interfaces, several models of StereoVisors(LCD viewing glasses) and stereoscopic computer sofeware. Several of these interfaces have ports for gloves and related devices. In 1994 and 1995, many other companies began using this technology and complete systems for interactive stereo imaging became available for nearly any computer for less than a tenth the previous cost.

One of the most useful of these devices is the Model 3000 StereoDriver from 3DTV Corp.. It has a cable which replaces or adds on to the end of the VGA cable between the monitor and the PC. It is a high density(15 pin) cable with a D9 size plug. It has an extra wire which takes vertical sync from the PC . This wire terminates in an RCA plug which is attached to either RCA jack of the Model 3000 StereoDriver. The StereoVisors(LCD glasses) plugged into the Driver will now cycle in sync with the right and left eye images. On starting up, there is a 50% chance that the right eye image will go to the left eye. To be certain when this happens, it is advisable to put an R on the right frame and an L on the left frame when creating the software so one can tell immediately which field is being viewed by closing one eye. If the left eye field is being seen by the right eye(pseudoscopic image), flipping the polarity reversal will correct the polarity. It will follow sync to at least 120Hz and can also be used for viewing stereoscopic videotapes, discs, CD ROMS etc. in any format(NTSC, PAL, SECAM, etc.). If the right eye image is always recorded on field one, the field recognition circuit will automatically route the right eye image to the right eye. It has two standard stereo headphone mini jacks, can be used with all commonly available wired LCD glasses, and with use of stereo splitters will drive up to 8 pairs of Visors. Similar cables can be supplied to adapt the StereoDriver to any computer having external access to video sync(usually on the green pin for RGB monitors).

A second stereoscopic interface marketed briefly was the Model RF StereoVisor and Model RF StereoDriver. This driver contains a magnetic pickup which obtains sync for the glasses from the magnetic flux of the monitor. The driver is plugged into AC power and laid on top of the monitor . It will drive the Model RF wireless glasses or most models of wired LCD glasses via two jacks on the rear of the driver. Wired and wireless Visors may be used simultaneously. As with the 3D Cable, there is a 50% chance of a pseudoscopic image on startup. Switching the driver power on and off or moving it a few times will result in a stereoscopic image. Again, the optimal situation will be to have the R and L frames identified in software and with driver will work with monitors, tv's and videoprojectors with the exception of some which are too well shielded. The RF Driver should work will all video and computer systems to at least 80 Hz and perhaps higher and can drive any number of RF Visors and at least 4 pairs of wired Visors. Since it depends only on the monitor flux, the RF system should work with nearly any platform without the need for any connection. At least one other company marketed a magnetic pickup but this method is unreliable and has been discontinued.

A third device is the PCVR. This will interface with parallel or serial ports by flipping a dip switch to the appropriate position. Another dip switch permits line selection when changing from one type of serial port to another and a switch to select polarity of LCD glasses. It will drive the glasses and the Power Glove (marketed as a low cost game device by Mattel in 1990), or other interface devices and has an additional port for the printer which is put on or off-line by turning a knob. Pseudoscopic images are not a problem since the computer now has complete control over the right and left lenses of the LCD glasses, but a switch is provided to reverse the lens polarity. It is probably still a good idea to put R and L indicia in the lower right of the right and left frames respectively, at least when programs are being written. The indicia or any other graphics should not be put at the very top of the screen because hardware and/or software problems producing distortions at the top have arisen in many systems from various sources.

Model O driver uses an optical pickup on the CRT which is triggered by alternate white and black screen indicia created in software.

The Model IR Driver takes sync from VGA like the Model 3000 but transmits the sync via infrared to wireless glasses.

Another device similar to the PCVR is the PGSI, produced as a class project by a group of college students in 1993. This interface plugs into serial ports and drives the glasses and the Power Glove. It contains a microprocessor and has software which allows more sophisticated control of the Power Glove.

The PCS and PCP are the most compact and least expensive of the interfaces, being small enough to fit inside a gender changer and taking power from the serial port or parallel port respectively.

Flicker with these low cost computer systems can be small or even imperceptible if the problem is understood and all parameters are controlled, as discussed above. Most of the LCD glasses that have been marketed have incorporated a layer of black plastic in front of the LCD to reduce room brightness. If the room lighting is reduced and monitor brightness decreased, even field sequential video displayed in the European 50Hz PAL system can be quite acceptable. Most PC graphics cards run at 72 Hz in VGA which much reduces flicker even in bright environments. Any card can have its frequency increased by using its menu. Some 3DTV Corp. software contains an automatic flicker fixer which works with most cards in 320 x 200 mode.


STEREO EYE AND HEADTRACKING

Starks(91) surveys the available eye and head tracking techniques. Though most of the work to date has been monoscopic, most of the hardware can be used stereoscopically and applications are appearing (G.B.-2,201069, Yamada et al). An obvious use is to couple such a device to a stereocamera for totally automated socs and 3D videotaping (JAP-62-115989). An interesting device from NEC anticipated virtual reality research by using eye movements to alter images in a helmet mounted stereo display (JAP-61-198892). Deering (1992) notes that stereo eyetracking will be necessary for highly accurate interactive stereo.


HEAD MOUNTED DISPLAYS

Head mounted displays have a long history. McCollum described a field sequential, head mounted system with dual CRT's and wireless transmission in 1943 (U.S. 2388170). Science fiction pioneer Hugo Gernsbach modeled a prototype of unknown origin in the early 1960's. They have been the subject of extensive R&D in many countries, mostly for avionics but more recently for tanks (Brooks, Rallison and Schicker), foot soldiers (Varo Inc.), vision aids(U.S. 5060062), surgery (GER-3532730, U.S.-4737972, 5039198, Pieper et al.), computer workstations (Teitel) and entertainment (U.S.4982278, 5034809). Varo Inc. has a series of intriguing patents describing wireless infrared transmission of video from gunsight to helmet and to other soldiers (U.S.-4884137, 4970589). Another patent uses a head mounted camera for simulator purposes (U.S.-4398799) and Thompson-CSF inputs stereocameras through fiber optics (FRE-2517916). The SPIE volumes series Helmet Mounted Displays, Display System Optics, Large Screen Projection- Avionic and Helmet Mounted Displays, Cockpit Displays and Visual Simulation, etc., the SID Digests of Technical Papers and the NTIS searches on HMD's (PB89-872105/CBY), etc., provide good surveys. Most of these devices have aimed to provide a head up display of flight information or other data with the pilot having his normal view of the cockpit with the data displayed on a semisilvered mirror or holographic optical element (Amitai et al., U.S. 5035474, 5040058). For many other purposes, it is unnecessary or even undesirable to see the real world and the helmet displays all the information. Telepresence and robotics have been mainly concerned with displaying video, while virtual reality research has so far used such systems for computer graphics. One Air Force project developed "hands off binoculars" (U.S.-4465347).

Earlier work used miniature CRT's (U.S.-3614314, 3059519, 2955156) but LCD's and lasers are now frequently used. Most devices have required complicated optical trains to get the CRT image in front of the eyes (U.S.-4859030, 4269476, 4322135, 4761056, 4969724, 4902116, 4468101, 4775217, 4968123, 4961626, 4969714), but recently fiber optics has been employed (Thomas et al., Webster, FRE-2517916, CAE Electronics). Most of the recent systems incorporate head and/or eyetracking (U.S.-4897715, 4028725, East Ger-224691, Arbak). The Eyephone (TM) from VPL Research was marketed in the late 1980's followed closely by the Cyberface(TM) of Pop Optics Labs and the elegantly designed Virtual Research Flight Helmet(TM) in 1991. An ultracompact design by William Johnson of England used his GRIN optics. Some of the more expensive avionics devices such as the Agile Eye from Kaiser Electronics (Arbak) are available to defense contractors and possibly others. Dual LCD systems from three companies entered the personal computer and toy markets in 1995.

There have been many descriptions of dual LCD devices intended to display video for low cost applications (JAP-63-82192, 63-177689,59-117889, 59-219092, 62-272698, 1-61723WO 84/01680, GER-3628458, 3532730, U.S.-4571628, 4982278, 4933755, 4952024, 4805988). The Litton magnetooptic chip has also been used, but it cannot display blue, so full color is not possible (U.S.-4575722).

Another group of lightweight displays intended for helmet or eyeglass mounting has recently appeared (U.S.-4311999, 4902083, 4934773, 4753514, 4867551, Upton and Goodman, Pausch et al.). These involve vibrating optical elements such as mirrors or fiber optics to scan the image onto a mirror. Though these have been monochrome data displays, color and full video would be possible. A device of this kind called The Private Eye has been marketed by Reflection Technology of Waltham, Ma. and Peli has published a careful evaluation of it. British stereographer David Burder has created a stereo HMD using two of these devices which gave a reasonable stereo effect. Nintendo licensed this technology and introduced the Virtual Boy Game System in 1995.

Much of the recent work with HMD's has emphasized wide angle viewing (Howlett, Howlett et al, Fisher, Robinett, Robinett and Rolland, Teitel). Wide angle stereo has a long history in photography and Harvey Ratliff deserves mention as a pioneer in this area and as the father of wide angle stereoscopic video. He built several devices and proposed others in a series of patents in the 1960's (U.S.-3511928, 3504122, 3376381, 3293358,3291204). Ratliff used conventional lenses, while more recent patents on panoramic HMD's have proposed more exotic optical techniques (U.S.-4385803, 4853764, 4874235). It is not clear that wide angle optics give sufficient advantage to justify the trouble and expense nor do there appear to be enough data to tell whether most people will find them comfortable with prolonged or repeated use.

The psychophysics of depth perception in head mounted displays has been the subject of many recent investigations. Uchida and Miyashita were particularly concerned with eyeglass mounted LCD's, Gibson with head up displays and Kruk and Longridge with a fiber optic design. Rebo's thesis is the most extensive published work to date and includes a very detailed analysis of the Polhemus headtracker. The study by Setterholm et al. is also very useful. Many systems have been investigated by the German aerospace company MBB (Bohm et al.). Other workers have been especially concerned with determining the optimal amount of binocular overlap and related parameters (Moffitt, Warren et al., Melzer and Moffitt, Self). Numerous studies have been done in the last three years.

My experiences with a wide variety of stereo displays has been that the greatest problems are usually with inadequate software (Starks). In examining some of these HMD's, it has become obvious that the stereo images need much improvement and with the computer generated images, it is often difficult to tell whether one is seeing stereo or pseudostereo (right and left eye images reversed). This is evident on some of the images presented in the stereoscopic virtual reality tape sold by 3DTV Corp. (Cyberthon in 3D) which are direct video feed from the computer and are not subject to any of the limitations of the HMD. More recently, wider experience with stereo has resulted in much excellent work.


COMPATIBLE TRANSMISSION OF STEREOSCOPIC VIDEO

One of the most sought after goals in 3D video has been a means for recording and /or transmission compatible with 2D reception by ordinary receivers. The 3D receiver would decode the signal to display a stereoscopic picture and in some schemes 2D receivers could be retrofitted with decoders to display 3D. Most of these subtract the two channels to obtain a difference signal which modulates some component of one channel for transmission. The great advances in video bandwidth compression in recent years should render many of these schemes more feasible. Such schemes have been described for many years (Brit- 706182) but it is getting more serious since some recent contributors to this field have been IBM (U.S.-4884131, E.P.-306448), CBS (US-4027333), the BBC (U.S.-4905081, E.P.-267000), NHK (U.S.-4704627, 4743965, WO-86-03924, 86-06914, JAP-59-265798, 60-46402, 60-96285,61-253993, 1-202093), Hitachi (63-256091, 63-100898, 63-217793,63-217794, 63-164593, 62-236294, 62-235896, 62-272697, 63-56089), NTT (Gomi et al.), Sony (52-9317), NEC (1-5291, 1-5292, 1-67094) Seiko (61-251396), Sharp (63-82191, 62-283792, 62-283793), Ricoh (62-150991), Thomson (U.S. 5055927), Telediffusion (U.S. 5043806), Toshiba (63-294090, 1-179593, 63-74292), Matsushita (63-1192),Canon (1-54992), Clarion (63-38386, 61-253992, 61-293094), ATR (1-114294, 1-64489) and others (JAP-51-142212, 59-86383, W0-84-00866, 83-00975, 88-01464, US-4266240,4287528, 4517592, Hudgins, Tamtoui and Labit, Chaissang et al). There has also been considerable work in the USSR by Dzhakoniya and others (USSR-128049). For an introduction to the vast amount of related work on video compression see JAP-63-294087, 52-72117, 62-245784, 62-165488, 62-166669, 63-201878.

Recent advances in hardware and software probably obsolete most of the above work.


AUTOSTEREOSCOPIC DISPLAYS USING LENTICULAR SCREENS

Autostereoscopic displays are those which do not require the user to wear viewing aids. Displays using lenticular screens have been the subject of intensive research for nearly 80 years. The two Ives laid the foundations (US 666424, 725567, 771824, 1262954, 1814701, 1882424, 1883290, 1883291, 1905469, 1905716, 1916320, 1918705, 1937118, 1960011, 1970311, 1987443, 2002090, 2011932, 2012995, 2039648). Hundreds of researchers followed and there are perhaps 2000 patents and several hundred technical papers on the use of lenticular screens and related means for photography, motion pictures and television. It is impossible to cover more than a few of the more prominent or recent which relate most directly to video. Photographic systems have become common with both professional and consumer lenticular cameras. Motion picture applications have been rare with only the Russian lenticular glass screen being publicly shown in the USSR and at the Osaka Expo in 1970. Eight years before his invention of Holography in 1948, Gabor filed three patents on lenticular methods for movie projection(US 2351032,2351033,2351034) and in 1953 he filed what is probably the longest and most detailed patent ever granted on autostereo projection(GB 750911). Remarkably, later researchers seem to have almost completely ignored this work and even Gabor in his 1969 patent on holographic movie projection(US 3479111) fails to reference his last and most complete patent on this topic.

Lenticular television devices have been prototyped many times but whether the screens were inside the CRT( Wallman, JAP 58-38093) or on the front of the faceplate or projection screen(e.g., Yanagisawa), alignment of pixels with lenslets was a major problem. Makoto Kikuchi of Sony pursued this approach vigorously during the 80's(JAP 53-20347, 56-126235, 56-126236, 56-128085, 56-128086, 56-132752, 56-134895, 56-168326, 57-3487, 57-11592, 57-13886, 57-14270, 57-17546, 57-18189, 57-26983, 57-27544, 57-27545, 57-27546, 57-67393, 57-72250, 57-75090, 57-83990, 57-83991, 57-87291, 57-106291, 57-123787, 58-29283, 58-31692, 58-103285, 58-115737). Tripp(US 3932699) was probably the first to build an adequate system, solving the alignment problem with a 13 inch diagonal fiber optic faceplate with a vertical lenticular screen. The input was a one inch camera tube covered with a specially made lenticular screen having 525 lenticulations per inch. This was made from a metal master hand engraved with the aid of a microscope(the same technique used to engrave dollar bills). This was perhaps the best autostereo CRT based system to date, but it was never duplicated and was soon cannibalized for the expensive fiber optics. Tripp however is a very flexible and ingenious man(one of his early inventions was the escalator) and he claims to have recently invented an extremely high resolution(2000 line pairs/mm) "spatial hologram without lasers" intended for use with his high resolution low dose x-ray system.

The advent of flat panel displays, which do not have the problem of aligning pixels and lenticules through an intervening layer of glass is resulting in renewed interest in this approach(Ichinose). Work is ongoing in France(US4584604), England(Sheat) and Japan(Tetsutani et al.) on a system for a 3D picturephone.

Another problem is that it is desirable to have a large number of these laterally multiplexed stereo pairs to minimize image "flipping" and give a "look around" capability(Schwartz). However, with most of these autostereo techniques, resolution and number of views are inversely related. With a 0.5mm lens size and 50 views, one needs a resolution of 10 microns, near that used for holographic plates and certainly beyond that of any available video display(with the possible exception of some of Tripp's prototypes). When it becomes possible to interpolate many views from a stereo pair, it will stimulate the whole field of autostereoscopy. Scene interpolation has been the subject of much research for robotics and pattern recognition but only a few workers have attempted to apply this directly to autostereoscopic display(Oshima and Okoshi).

Front or rear projection of stereo with lenticular screens has been investigated by many but has rarely resulted in commercial product. Sanyo Corp. has shown large rear projection lenticular systems in 1994 and offered a 50 inch diagonal model for $50,000. Image quality was modest and restriction on head position severe. Joji Hamasaki in Tokyo has been one of the most persistent and successful in this work with multiple video projection and large diameter screens as well as with the Sony beam index CRT(JAP 61-77839, Hamasaki). NHK and other has an active program with multiple LCD rear projection on a Toppan Corp. plastic lenticular screen(Isono). Viewing distance is limited to about 3 meters plus or minus 10cm and careful head positioning is necessary to avoid pseudoscopic zones(problems for all lenticular systems). Hamasaki's efforts and those of NHK are shown on the 3D videotapes "3D TV Technology Vols 1 and 2" marketed by 3D TV Corp. A vigorous program was conducted at the Heinrich Herz Institute in Berlin with front and rear projection on lenticular screens custom made by Philips in Eindhoven(Borner). Philips has extremely high precision computer controlled diamond milling equipment for making lenticular screens for their videoprojectors. A 1500 line screen can be milled in a plastic master in about 2 hours and the poured acrylic screen rapidly cured with uv . Minute corrections in the screen can be reliably programmed, engraved, cured and ready to test in one day for a one time set up fee of about $25,000 and a cost of about $20,000 for a 1M by 1M pair of screens in prototype quantities. This process used to take months and was not very accurate. The final screen is accurate and repeatable to one micron. Dr. Schmitz demonstrated this by making a screen which copied the eye of a bee and proved its extreme accuracy with electron microscope photos. This may result in commercial lenticular systems in the next few years.


AUTOSTEREOSCOPIC DISPLAYS USING PARALLAX BARRIERS

Optically analagous to lenticular screens, parallax barriers consisting of thin vertical opaque strips seem to have been invented in the 17th century by G.A. Bois-Clair. The Frenchman Berthier revived it in 1896 and it has been the subject of hundreds of patents(GB 514426). 3D movies for viewing without glasses were shown commercially in Moscow in the 40's with a conical screen constructed by Ivanov from over 30,000 white enameled wires weighing six tons. The floor was slanted to accommodate an audience of about 250. For a period, the films were also projected with cross polarization so that those not located in the right viewing zones could see the films with polarized glasses. Autostereoscopic projection was apparently discontinued by the early 70's due to customer preference for the glasses.

The simplicity of barrier systems has continued to create interest both for still(US 4927238, Sandin, Myers et al) and moving images(Sexton, Johnson et al.). Eichenlaub has marketed an autostereoscopic workstation employing an LCD in a manner analagous to the barrier(US 5036385, 4717949,4829365, Eichenlaub). In 1995, Sanyo showed several small LCD based systems like this with an 8 inch diagonal model priced at $3000. Image quality was good but head position was critical.


DYNAMIC PARALLAX BARRIERS

In this technique, one or more vertical slits are rapidly scanned in the horizontal direction and the appearance of the image points on the screen behind are timed precisely so that a viewer at any position will see a stereo image. Noaillon(US1772782, 2198678) created a device composed of a conical arrangement of slats which was rotated rapidly between the viewers and the screen on which were projected 3D movies. Subsequent improvements were made by Savoye(US 2421393) and others(Jennings and Vanet) and Savoye's version was shown to audiences of 90 persons at Luna Park in Paris after WWII. A smaller system was sold by A. Mattey of Paris for home use. Versions of this "cyclostereoscope" were recently reconstructed by Australian enthusiast R. Blum(Blum) and by French stereo equipment designer Claude Tailleur.

For many years, Homer Tilton has promoted a unique version of this technique using a single mechanically scanned slit called the "Parallactiscope" and has even written a book about it(Tilton). Meacham has built a vibrating multislit device(EP 0114406 A1, US 4740073, Meacham)and Noble has made a version with an LCD slit replacing Tilton's mechanical one. Travis has suggested a laser addressed LCD with a large lens to overcome the low light emission common to most of these approaches(Travis ). Hattori has a system with multiple crt's, and a large diameter lens with an LCD slit scanning inside the lens(Hattori). Kollin's rotating louvers are another approach(Kollin), but any device that uses mechanical moving parts appears unlikely of success. The devices of Tilton, Noble and Meacham are shown and commented on in the 3D videotape "3D TV Technology Vol.


THE STEREOPTIPLEXER

In the early 60's, Robert Collender invented a dynamic parallax barrier system which had many intriguing features(US 3178720, 3324760), but his most interesting insight was embodied in his next application in 1973(US 3815979). He realized that if one used a screen that was very direction selective horizontally(i.e., diffused normally in the vertical direction but was retroreflective horizontally) he could replace the physical slit between the observer and the screen with a virtual slit. Along with his mechanisms for scanning multiple images on the screen, this made it possible to create a practical system for any size audience with no pseudoscopic or bad viewing zones. In subsequent patents he has extended his ideas considerably to flat screen video displays with few or no(US 4676613)moving parts(US 4089597, 4158487, 4176923, 4231642, 4290083, 4323920, 4349252, 4547050, GB 2076611, GB 2095068, JAP 56-31579, 57-11591, 57-162898). I have seen his simple prototype working with 16mm film and it is exactly as expected-one sees a nice 3D image without glasses from anywhere in the room. Collender thinks it would require about $10 million to build a video prototype of his invention. As an engineer with 30 years experience in high tech design, he is probably not too far off.


INTEGRAL PHOTOGRAPHY

Invented by Gabriel Lippmann in 1908(Lippmann) this autostereo technique is often called "fly's eye lens photography" because of it's use of an array of tiny lenses for taking and displaying the image. As a result it possesses both horizontal and vertical parallax as do most types of holograms. Leslie Dudley was one of the more zealous researchers(US 3613539, 3683773, 3734618, 3675553) followed by Roger de Montebello(US 4732453). De Montebello's recent passing left his work in the hands of panoramic camera inventor Ron Globus of New York City. For video or computer graphics the images may be created by other means and displayed integrally. In spite of substantial problems in fabricating the multiple lens array and in reversing the pseudoscopic image, integral photography has continued to attract attention both for still photography(Shang, McCormick et al., Okoshi(71), JAP 1-154437, WO 89/06818, US 5040871, Ueda and Nakayama, Chutjian and Collier, Burckhardt et al. Burckhardt, McCrickerd) and video(US 3852524, 3878329, 5036385, FR 2014676, WO 88/05554, Igarashi et al,). W. Hickox of Airometric Systems Corp. in Glen Cove, N.Y. and Dave Roberts of Robert Engineering have also made integrams. Recent work with the fabrication of integral lenses holographically may further stimulate research(Hutley). Many other companies including Rank Pneumo, United Technologies, Adapative Optics Associates and Corning have begun fabricating microlens arrays.

The fact that the vertical parallax provided by the integram is usually unnecessary, coupled with the need to reverse the pseudoscopic image and the problems of lens manufacture, make it likely that the integram will see only very limited application in the foreseeable future.


LARGE MIRRORS, LENSES and RETROREFLECTIVE SCREENS

It is common knowledge that when stereopairs are properly projected on suitably curved mirrors, lenses or screens, an observer in the appropriate viewing zones will see a stereo image. Hundreds of patents and dozens of prototypes attest to the simplicity and popularity of this approach to autostereo(US 3096389, 4062045,4315240, 4315241, 4509835, 4623223). A new type of retroreflector from Precision Lapping and Optical Co. of Valley Stream, N.Y. may make some new designs possible.

Ketchpel has proposed electronic modulation of a large diameter LCD for autostereo projection(Ketchpel, Williams et al.). Though large diameter glass lenses are impractical, the advent of high quality plastic fresnel lenses led to much many attempts to create autostereo systems, usually with rear projection of a stereo pair. A few such systems were created by Northrup for the military about 1980. The images came from a pair of high resolution black and white crt's projected through a custom fresnel about 30cm wide. I saw an excellent stereo image as long as I kept my head within an approximately basketball sized viewing zone. A similar system was built by Martin Marietta Corp. twenty years ago(Tewell et al.). Zehnpfennig has provided a detailed report on the construction of a smaller version (Zehnpfennig et al., US 3711188) and a very small version is commercially available in microscopes marketed by Vision Engineering and other companies.

It has long been recognized that a large diameter curved mirror will project a 3D image of an object suitably placed and illuminated. With appropriate masking of the mirror and object, the viewer sees an image floating in space. George Ploetz invented a clamshell arrangement of two mirrors that has been marketed in the US by Edmund Scientific and others(Ploetz, Coffey). Recently, Steve Welck of Grand Mirage Corp. in California has made large size plastic mirrors(US 4802750) which have begun appearing in advertising displays and even a video game from Sega. Though they could easily be in true 3D, so far all the devices using Welck's mirrors have used a single CRT to project a flat 2D image. Paul Kempf of Metron Optics in California has created a similar but smaller system with input from a stereo pair of cameras(US 4623223, 4840455). An interesting variant was created by Michiel Kassies of Amsterdam who encased millions of tiny mirrored balls between two sheets of plastic.


OTHER TYPES OF AUTOSTEREO SCREENS

A number of investigators have realized that a properly designed holographic screen would be able to fulfill the functions of a lenticular or parallax barrier screen(US 3479111, Umstatter and Trollinger) or even of the camera pickup for an autostereo system(Kopylov). In his US patent(3479111) Dennis Gabor described the design of a holographic screen for the projection of stereo movies by two or more projectors. The book by Hutley has several papers on the fabrication of holographic integral lens arrays. The screen would direct multiple images, projected by conventional means or by laser, to multiple viewing zones. A few experiments have been done for autostereo projection, but the largest such screens are 24 inch by 30 inch created by Komar and his colleagues at NIKFI in Moscow for projection of their holographic movies with four viewing zones for one person each(Komar, Komar and Serov.

Various proposals have been made to use the birefringent properties of liquid crystals to create stereo screens(e.g. Sirat and Charlot).

Okoshi has championed a type of direction device called the curved triple mirror screen(Okoshi et al, Okoshi). Efforts to make such a screen were abandoned due to cost and complexity but with advances in manufacturing since the early 70's, it is undoubtedly worth another look. Many have proposed variants on the standard lenticular screen(Dultz, JAP 59-33449, 60-244943, US 4871233).


VOLUMETRIC DISPLAYS

Volumetric displays are those in which the image points originate in a three dimensional space. There have been an amazing variety of volumetric display devices proposed and built(Balasubramonian, Williams) including dynamic ones having rotating or oscillating screens or lenses or mirrors(Withey, Muirhead, Jansson, Harris and Mathisen, Lazik, Yamada et al., Gregory, Szilard, Fajans{cf.Naegele},US 2330225, 2637023, 2967905, 2979561, 3077816, 3079585, 3097261, 3123711 3140415, 3154636, 3177486, 3202985, 3204238 3212084, 3258766, 3300779, 3316803, 3323126, 3335217, 3371155, 3428393, 3462213, 3493290, 3555505, 3604780, 3682553, 3976837, 4160973, 4294523, 4435053, 4315281, JAP 52-11533, 56-69612, 56-71387, 56-72595, 5674219,56-102822, 56-104316, 56-106215, 56-161788, 56-161789, 57-62020, 57-171313, WO80/02218, 82/01259) which may be light emitting(Matsumoto) or upon which the images are projected by CRTs, light valves or lasers(Pressel, Ketchpel, Brinkmann, Matsushita, Tamura and Tanaka, Soltan). A number of these displays make clever use of fiber optics(US 4173391, Kapany, Martin).

Other approaches have used 3D arrays of components which emit or valve light when addressed electronically(Alburger, Nithiyanandam, Hattori, US 2361390, 2543793, 2749480, 2762031, 2806216, 3005196, 3138796, 3501220, 3536921, 3555349, 3605594, 3636551, 3682553,3891305, 3912856, 4134104, 4173391, 4294516, 4333715, 4391499, 4472737, 4629288, GB 1513719, 1601607, JAP 52-68310, 54-32224, 54-143041,56-125720, 56-162714) or by electron or laser beams. In recent years, many have suggested stacking LCD's(Alampiev et al.) and one of the earliest of these remains the most detailed published account(Reiche et al., cf. Cole et al.).

Another common technique addresses a volume of gas, liquid or solid with one or more laser or electron beam to give potentially very high resolution displays(US 1813559, 2604607, 3474248, 3609706,3609707,3829838, 4023158, 4063233, JAP 55-92090, FRE 461600, 733118, GB 1245783). The reports by Hassfurther et al. and Flackbert et al. are the most detailed published studies on a laser addressed display(rare earth doped calcium fluoride crystals).

The only volumetric display that has had any commercial success is the varifocal mirror(Harris, Huggins and Getty, Harris et al., Sher, Fuchs, Mills, Stover, US 3493290, 3632184,3632866). A large diameter mylar mirror is vibrated with a loudspeaker while addressed with a crt or other light source. This display was developed by Bolt, Beroneck and Newman and marketed briefly by Genisco but the dozen or so units sold seem to see little use and given it's size, cost, image distortions, and the need for a high speed computer for processing, this technology is probably a dead end. Nevertheless, a few companies continue to research it as a display for medical images and graphics (US 4,462044, 4607255, 4639081,4674837, 4743748, Sher).


HOLOVISION

Okoshi has reviewed much of the work relevant to holographic television(Okoshi) It has been looked into by many since the earliest days of holography but progress has been slow. Until recently, most of the effort was by Kopylov and others in Russia(Shmakov and Kopylov). Progress in electronics, electrooptics and computers has recently renewed interest(Honda, Hashimoto, Katsuma, Sato, Fukushima, Benton, GER 3140418, Boudreaux and Lettieri, Hashimoto and Morokawa, Cheng and Lin, Shyyrap et al.) but a real time full color high resolution system still appears quite remote. The annual volumes on Holography published by the SPIE always have several papers on holomovies.


STEREOENDOSCOPY

There has been sporadic interest in stereoendoscopy, with Olympus Optical Co. most prominent(JAP 1-19319, 63-271493, 1-38811,1-38812,1-38813, US 4924853,4935810, 5039198). Recently, several other groups have developed prototypes with the idea of putting this instrument into clinical use(Jones, McLaurin, F. Oertmann of Aesculap A. G. in Tutlinger, Germany). One group developed techniques for digital image correlation of endoscopic stereopairs(Badique et al.). McKinley Optics of Southampton, Ma. has developed a stereoendoscope which was briefly marketed by American Surgical Technologies in 1993-1994. Lowell Noble of SOCS Research Inc. of Saratoga, California has applied the techniques for getting stereo with a single camera to create such instruments from single standard endoscopes with an internal LCD shutter, the image is superb and this product will be marketed by Smith and Nephew. The Canadian company International Telepresence has done similar work. The recent development of extremely high resolution quartz fiber endoscopes by Ultrafine Technology of North Brentford, England should further stimulate this research.

There has also been a steady trickle of papers on holographic endoscopy(Podbielska and Friesem, Friedman et al., Von Bally).


STEREOSCULPTING

Automatic creation of three dimensional objects from stereo information gathered by stereo cameras, lasers etc. or created in computers(stereolithography) has been researched for many years (Kelly Swainson of Omtec Replication in Berkeley, Calif. in the mid 70's) but is only recently coming into practical application(US 4752964,4931817,4935774, JAP 61-88106). A number of companies with devices for automatic acquisition of digital 3D information used for input to CAD-CAM systems now feed this information into computer controlled milling machines for rapid solid modelin.

Volver