Archive for November, 2009

Bamzooki – Augmented Reality TV Game Show

Robots battling it out for glory is nothing new.  Augmented reality robots racing around real streets and battling on rooftops is so 2010. 

The BBC show, Bamzooki, is an augmented reality TV game show in which autonomous creatures called Zooks are designed and then controlled by participants on the show by shouting instructions during the battles.  The game is run by:

The BBC’s Virtual Studiotechnology was used to enable realtime composition of the 3D rendered graphics with live camera feeds. Each studio camera has a dedicated render PC to render the virtual scene from that camera’s perspective. To know what a studio camera’s perspective is, each camera is fitted with a second ‘Free-D’ camera which points towards the ceiling. On the ceiling are reflective, circular bar codes. The 3-D camera data is fed to a computer system that identifies the targets on the ceiling and calculates that camera’s position and orientation, 50 times a second. Series 4 adopted vinten tracking peds instead of FREE-D as an alternative approach.

The contest runs in realtime on a networked PC. All the clients receive contest scene information and render their scene from their studio camera’s point of view. A bank of chromakey boxes then composite the virtual and the live feed together to provide a realtime composite. This video stream can be sent to the studio camera monitors so that camera operators can view the composite and hence follow the action in realtime.

The relaunch of the show began this November and the new season will run thirteen shows.  The Zook Toolkit comes with a simulator and a Motion Player to watch your Zook perform.  The Zooks can be run in an entirely VR environment, but the show uses AR to put the battles into the real world.  Some schools are using the Zook Toolkit to stage their own battles.

Popularity: 30% [?]

, , , , , , ,

8 Comments

HMD Augmented Reality Display with Vuzix CamAR

A workable HMD augmented reality unit is a major step forward for the technology.  Once a see-through model is available, we can break out of the “magic lens” smartphone.  However, a see-through HMD is still a couple of years away and until then we’ve got to make due with what’s currently available. 

Craig Kapp, a full time graduate student at the Interactive Telecommunications Program (ITP) at NYU, has put together a working HMD unit with the Vuzix VR920 model and the ARCam. 

image_camar_vr920

 

 

 

 

 

When I contacted Craig this is what he had to say:

Thanks for the message. I am using the Vuzix VR920 head mounted display in conjunction with their brand new “CamAR” attachment – it’s a snap-on webcam that fits snugly onto the front of the goggle. Here’s some more info on my blog about the project.

I’m working on a larger project that involves these goggles + a voice detection package to create a sonically controllable AR environment. Feel free to check back in a week or two for an update!

While a unit like this would never be usable by the masses, it could allow researchers and hard-core AR enthusiasts to create early full view games and apps.  I’m looking forward to hearing how Craig’s project turns out.  Maybe some of the other AR gear heads could lend a hand with making the project more immersive or porting it to a smartphone. 

 

Popularity: 15% [?]

, , , , , , , ,

3 Comments

Brief Video History of Augmented Reality

Nothing new for the initiated, but its a cute and pithy overview that gets points for presentation.  Useful if you have a friend or family member that still doesn’t know what augmented reality is. 

Popularity: 9% [?]

,

1 Comment

The Eye of the Machine

More video from Sensor Cast’s MobilHD system (see yesterday’s post for more details). 

MobilHD demonstrates the SPOT automatic object tracking system using a pan-tilt-zoom camera. Unlike simple motion detection, MobilHD employs sophisticated video signal processing to find, track, and predict moving objects within the field of view. First objects are detected as shown by tiny yellow crosses. Then, their size is estimated as shown by the white rectangle that encompasses the object. As the tracker develops increased confidence, the rectangle’s color changes to red. After the object is tracked for 10 seconds, the tracker breaks off and acquires a new object. Whenever the camera zooms or pans, the tracker is essentially blind and must therefore predict the objects trajectory and re-acquire.

Popularity: 6% [?]

, , , , , ,

1 Comment

Facial Recognition is the Future of Social Search

Nokia’s concept video shows what they think mobile computing will be in 2015.  The list rounds out the usual suspects of future-tech: cloud computing, geolocative services, service-anywhere and facial recognition, to name a few.  The last one tweaks my concerns about data harvesting and social stalking as presented the last two days (Thoughts on the OGI and Surveillance Society).  Seems like this is privacy week at the Future Digital Life. 

Nokia isn’t the only one delving into this aspect of computer vision as Qualcomm gave a sneak peak into their future products and facial recongition tied to social networking is one of them.  Ben Sillis from Electricpig reports what the Qualcomm European president presented:

the company’s European president, Andrew Gilbert, showed how you would soon be able to point your phone’s camera at a person, then instantly bring up their Facebook and Twitter profiles, along with recent updates and all the details said victim (Karmen, in the above picture) has chosen to make public about themselves.

 Gilbert admitted that the possibility raised serious privacy issues – you could theoretically pull up a person’s home address through automatic whois requests – but ethics aside, it’s an interesting next step for augmented reality apps, which layer data over the surroundings and have started to take off in a big way over the last year. As phones get faster and more powerful, what’s to stop people integrating this form of search?

Gilbert described a future where the “handheld device becomes the remote control of your life”. If you ask us, we’ve already reached that stage – would you take it to the next level like this?

 

Personally, I wouldn’t mind facial recognition tied to my social services as long as I controlled who had access to my face data.  Things get tricky when you have access to search anyone in your viewing distance.  Either way, facial recognition is sure to be part of the future of social search.

Popularity: 12% [?]

, , , , , , , ,

5 Comments

Surveillance Society – A Lesson for the OGI

On the heels of my post yesterday about the Outernet Guidance Initiative and the perils of data harvesting, I find this bit of flotsam foaming out of the datasphere.  Don’t be fooled by the lack of presentation fireworks or the bleary-eyed speaker reading his lines early in the morning without his cup of joe. 

The MobilHD system from Sensor Cast carpet-bombs an area with cameras for complete coverage.  The data is downloaded into a server that indexes the images into a dizzying array of statistics.  If you’re on the paranoid side of the data gathering scale, then this little piece of hardware will certainly set your sphincter to pucker. 

The specs on the system in question are gathering data in a generalized manner without attaching your personal ID, but with facial recognition software available it wouldn’t be hard to marry the two and create a gold mine of data harvesting. 

How much longer until we’re signing digital waiver forms when we enter the mall?  And Cory Doctorow’s gait-recognition hi-jinx for his protag from the book Little Brother don’t sound too far off.  

Popularity: 9% [?]

, , , , , , , , ,

2 Comments

Thoughts on the Outernet Guidelines Initiative

Ori Inbar (@comogard) tweeted an offer to join the discussion on the Outernet Guidelines Initative.  One particular point of their discussion piqued my interest and that’s the subject of privacy issues within the AR web (Outernet, ARNet, Digital Sea, etc., etc., ad infinity.)

John then hosted three panels, one at his office and two at the Web2Open (part of Web2.0) in New York City.  The focus was on how Augmented Reality would intersect with the Semantic Web.  John and Jack talked a lot about OGI (the Outernet Guidelines Initiative) and how things like AR would affect privacy issues (when image recognition comes into full fruition, is it okay for a stranger to map your face and locate your personal data?) business, (who has the air rights to the Outernet?) and how we think (if when I see you I can track your picture and know your details in the moment, do I even need to remember your name?)

The questions asked are important ones and they are absolutely right that we should be addressing them now before the potential use-cases of an Outernet become a legal squabble.  Who owns data is a tricky subject.  It will become more confusing when cameras and pachube items are harvesting information without anyone to decide if its acceptable. 

I believe we should have the following three rules about information harvesting:

1) Generalized information not tied to an individual is free to use.

2) Use of information tied to an individual must be opt-in.

3) Access to one’s own personal information is free. 

A simple rule-set to guide the use of information would help the creation of the Outernet.  Below are some use-cases of following the three rules of information and not following them. 

 

Ten Use-Cases for Following the 3 Rules

1) Rapid way to find lost children or lost dogs.  (no lost cats, when they leave it’s on purpose)

2) Worried parents can find out exactly where their teenagers went last night.

3) Teen-age girls can find out exactly what fashions are hawt.

4) Instant price comparision when shopping and would tell you where to find and if it was worth the gas to drive there.

5) Check if your favorite restaurant is busy. 

6) Business owners could figure out what everyone wanted and could carry less inventory which means less waste for society. 

7) Business owners could learn if people were happy with their experience in their stores. 

8 ) Shoppers know which stores have their particular item in stock. 

9) Drivers know the route to work with the least amount of traffic.

10) Grocery lists could be converted into maps to show you the fastest route through the grocery store.

 

Ten Use-Cases of Not Following the 3 Rules

1) Lift personal information and passwords when using kiosks (ATMs and credit cards).

2) Corporations can track individual tastes and spending habits to maximize profit on you, because they would know what you were willing to pay.

3) Government used data to decide if you might be about to perform a crime based on your facial expression (i.e. Minority Report or the TV series Lie To Me).

4) Estranged parents using the information trail to find the best place to snatch their children.

5) Churches checking up on their members to make sure they are not “sinning”.

6) Employers checking up on their employees to make sure they aren’t violating contracts.

7) Used to cheat in card games because “tells” could be identified by programs.

8 ) Stalk someone, and send them messages saying “I know you were <insert location>”. 

9) Health insurance keeping tabs on people for bad habits (smoking, eating fast food, etc) and increasing rates when found doing too many “bad” things.

10) Employers checking facial expressions for happiness quotient during customer interactions.  (ie – smiling)

Popularity: 8% [?]

, , , , , , , , ,

3 Comments

Virtual Sandbox (Sim City Meets Augmented Reality)

A group of students at the National University of Singapore has developed an AR game similar to Sim City using VRML and ARToolKit.

Virtual Sandbox is an educational software targeted at kids between the ages of 4-6. It provides children with an interactive learning environment for the learning of English vocabulary. By combining the concepts of Sim City, Flash Cards and Augmented Reality technology, we demonstrate how the bene?ts of both tangible and non-tangible interactions can be merged to create a fun, game-like learning experience for young children.

As a University project it gets high marks.  The controls wouldn’t be suitable for an older age group since using a PlayStation or Wii controller is more natural to kids these days.  But the younger crowd is more willing to move things around with their hands.  These types of games will need to move to gesture based controls like the EyePet  if they want to be commercialized. 

 

Popularity: 26% [?]

, , , , , , , , , , ,

1 Comment

Interactive Entertainment using Augmented Reality

The use of augmented reality in our daily lives is still a few years away.  The technology and business model hasn’t yet reached the point where it’s cheap enough for the masses. 

The entertainment business is a different story as they’ve been using augmented reality for some time now.  My eyes were opened during the keynote speech at ISMAR09 by Mark Mine, a Walt Disney Imagineering Director.  They use AR in a variety of interesting and imaginative ways (well duh! they are Disney afterall.)

Magic sand” interactive experience using projections on top of sand to create volcanos and playing with turtles.

 

 

KimPossible activity using hand-held comm units that led kids on a secret adventure through the park. 

 

Building sized projections of ghosts during holidays like this video of Space Mountain on Halloween.

 

Mark also showed us some great scenic illusions using projectors on a live scene, but unfortunately I couldn’t find a video.  What Mark showed us is how to use AR–right now–by concentrating on the user experience.  The Imagineers had over 144 different degrees in their group, but he said the key was to have an art and communications background to go with the engineering.  Keep that little factoid in mind all you wanna-be AR designers. 

A couple of his best lines were, “Seeing is believing, but touching is truth,” or “It’s about connecting with the user.”  The lesson I got from it for AR developers outside of the entertainment industry is to not forget the person using your new-fangled technology. 

Mark wasn’t the only keynote speaker from the entertainment industry.  Natasha Tsakos who plays Zero, a worker everyman stuck between dreams and reality, in her UP WAKE performance piece, also gave a keynote.  Similar lessons can be learned from her experience as with the Disney talk.

 

Disney and UP WAKE are both big budget productions, but can the little guy use augmented reality to entertain?  I don’t know much about the guy in this next video, but he’s giving it his best go.

 

Or if you’re looking for a company to develop a projection AR entertainment experience right now, then look no further than Globalzepp.

 

These days everyone is enamored of augmented reality on the smartphone, but we shouldn’t forget there are other ways of using the nascent technology in creative and innovative ways.  Projection based AR still has a lot going for it in situations where it can reach a large audience.

Popularity: 25% [?]

, , , , , , ,

9 Comments

Augmented Reality in Photo Booth

The interesting part of the video comes after the three minute mark.  It appears the software uses face tracking to achieve the special effects and it looks rather robust.  The kitty mask makes me wonder if furries are using these programs already in their video chats. 

And how long will it be until live feeds of celebrities are touched up with augmented reality to make them appear thinner?  Or fatter if they’re selling their gawker-snuff to TMZ?

Popularity: 12% [?]

, , , , , , ,

2 Comments