Revision as of 06:17, 8 October 2007

Overview

A touchscreen interface that allows for multiple points of contact for uniquely manipulating objects and information on screen.

Status

Planning

Design concepts

• Ideally would be linked to screen resolution rather than physical size making it highly scalable.
• A transparent layer capable of being laid over any existing screen, projected or otherwise.
• System software would control generic interaction techniques that would work with all existing applications as well as newly developed ones.

Existing designs

• Jeff Han's: Acrylic sheet backed with a difuser(a solid surface to project on) and lined along the side with LEDs in a mobile frame capable of holding the projector and camera below the screen. A small solid lip surrounds the edge of the acrylic to prevent the light from escaping at acute angles causing the light to be reflected internally along the full length of the sheet. Placing a finger or other object on the surface causes light to scatter in a mostly perpendicular direction to the sheet making a bright spot on the difuser below which the camera then picks up and registers as a manipulation point. It is unknown that type LEDs Jeff Han uses, but other examples use infrared LEDs, which most digital cameras/webcams are capable of picking up. This is likely the cheapest way to produce large multitouch screens.

Preliminary notes

Working off the Jeff Han design, that is to say acrylic sheet with IR LEDs, projector from underneath, and IR sensitive camera, I'm going to see how shallow I can get the table by use of a concave mirror. The concave mirror should make the image larger, thereby decreasing the distance the projector needs to be from the projection surface, but will flip this image(easily corrected on the projector itself).

	Brimstone, I seriously need a blog like yours :)

Progress

• 05/13/2007: Obtained a dinner plate sized convex mirror. Testing on focal length distance and size increase can begin.
  • This type of mirror doesn't look like it's going to work out. Too much distortion around the edges. --strages 06:34, 31 May 2007 (CDT)
• 05/31/2007: Given the release of Microsoft's Surface it got me thinking. I can make a better multitouch surface....with blackjack and hookers. Haven't quite figured out how I'm going to do the hookers part just yet, but managed to come up with a reasonable enough blackjack solution(see notes above). Came up with an alternated design based on the desks we have at work after a discussion with a coworker trying to explain the flexibility of having a large multitouch surface(again see notes above). Also came up with an idea for doscument "scanning" based on what Nykodemus has been doing with his book "scanning" rig, which strangely isn't on the wiki(ahem!).
  • I'll be needing a basic physics engine, preferably one that runs on top of all the applications as opposed to a per application basis, that handles "throwing" of windows and basic collision between windows.
• 09/28/2007: Purchased a 32"x48" piece of lexan for $50. It should have the same properties as acrylic, not that it matters because I've decided to use the Diffused(shotgun) illumination method.
• 09/29/2007: The guys and I several tests with the lexan and a projector to determine optimal throw distance and all. Given the information we learn we panned out a design for the table that allows for it to tilt from flat to vertical without the need for recalibrating the setup.
• 09/30/2007: Purchased all the wood needed to build the frame for the table. Ran into some snags with cutting it all, but progress was made. There still needs to be an IR illuminator and mirror purchased.
• 10/02/2007: Went in search of IR LEDs at Mock Electronics, but they had none and recommended I go to W&W Electronic. It was too late to go there today. I went to the.narro.ws to get some help on making the table run on Linux, but it turned out the camera wouldn't support the resolution we needed it to in Linux to work well, so we're stuck using Windows.
• 10/03/2007: Went by W&W Electronics but alas they has no IR LEDs either. Later on I met up with Korc at his place and worked on the table some more. We got the frame cut that goes around the Lexan and realized we had to redesign the base as it was just going to be too low to be usable in a vertical mode. We opted to go with a 45 degree tilt "vertical" mode as a compromise. Tested the projector with a mirror to make sure it was going to do as expected, thankfully that worked out. Still need to purchase a mirror and IR Illuminator, but at least I got the software and camera working like we need.
• 10/04/2007: Managed to get the frame for the Lexan cut, sanded, and glued together. Did some tests on the amount of IR that comes from an incandescent bulb and determined it wasn't enough. Ordered 100 IR LEDs from Digikey.

10/05/2007: Korc finished building the table and tested out angles for the projector and mirror. Didn't have everything done in time for the meeting but we did show off the build pictures and a couple of videos we took messing with the software. Everyone seemed impressed with the progress we made.

• 10/06/2007: Bought a larger mirror for $10, got another webcam to try out and see if we can get it working in Linux, and put together a simple test circuit with 24 IR LEDs which seemed to work really well. We figured out that the plastic protective film on the Lexan was just too reflective and we'll have to go with something like tracing paper or something.
• 10/07/2007: Korc built the rest of the IR illuminators and all that remains is building the cross supports for the screen to prevent side to side movement, place the IR illuminators around under the screen, find a decent reflective surface that lets IR through, frame the mirror properly, and make a new mount for the projector.