Archive for August, 2009
Proposal: Augmented Reality Scale
Posted by Tom Carpenter in augmented reality on August 30th, 2009
As we collectively disembark on a long journey to a future, hence unknown. We’ll want to mark our progress as it goes zipping by our technological car windows.
With augmented reality intruding into the general consciousness, we’re going to need ways to explain and document our progress and point to where we’re going. Currently, there are many ways to describe augmented reality: outdoor, paperless, papervision, marker based, reality browser, spatial computing, iPhone based, etc. These terms do describe a particular function of augmented reality, but they don’t give a generalized idea of where that description lies in the realm of AR in relation to everything else.
To help define the woof and warp of AR, I propose a simple scale called the Reality-Interface Matrix Scale or RIM Scale.
The RIM scale will be composed of two axis: Perceived Reality (PR) and Reality Recognition (RR). I chose two axis because AR exists through the mixing of reality and the virtual. First I’ll explain the two axis, then the interaction between them.
The Perceived Reality axis shows us how the graphics are indistinguishable from reality (on a scale from one to ten).
10 – Completely immersive; identical to reality in all aspects.
7 – Mostly immersive; most non-moving objects are difficult to discern; moving flexible objects are distinguishable.
4 – Mildly immersive; Graphics are used to overlay flat objects; textures mostly; poor occlusion.
2 – Mostly text based information; common boxes and other simple objects can be modified.
1 – Reality as it exists now (non-augmented).
The Reality Recognition axis explains how completely computers understand the world (on a scale of one to ten).
10 – Knows the location and manner of all objects, people and information in the world, completely; and changes as the world changes.
7 – Understands the location and manner of major objects; some minor objects and some people and information; object recognition is substantial; updates on frequent basis.
4 – Major objects, people and information are understood by location; any other characteristics are rare; minor object recognition. Updates occasionally.
2 – Most information updated manually or using simple markers; GPS used for locations; updates randomly.
1 – No understanding of the world.
A total score for an application of the augmented reality concept can be given by using the two numbers as a vector (#,#). Let’s use an example to illustrate the scale like the popular Augmented Reality Magic Trick from Marco Tempest. It has 228,495 views on YouTube so it should be a well known example.
On the PR (perceived reality) axis, I would give it a three because it uses graphics over flat objects and the immersion is limited (through a screen). On the RR (recognized reality) axis, it would be a two because the trick required a lot of “set up” and it uses basic markers to align reality. The RIM scale score would be a (3,2).
Since I’ve given Layar a lot of attention lately, I’ll use the Wikitude Drive as my next example.
The application scores a two on the PR axis because it only uses text and simple boxes for its graphics and a three on the RR axis because its using GPS data on a frequent basis along with other information from the data sphere. This puts it a RIM score (2,3) which is where most of our reality browsers will fall.
Next I’ll use the Japanese anime show Denno Coil as a third and more advanced version, since we don’t have anything else that actually exists this far up the scale.
In the world on the show, reality is pretty indistinguishable from the virtual, but it requires glasses. I’d give it an eight on the PR axis. But since the world isn’t completely “known” by the computers, I’d give it a slightly lower score of seven on the RR axis. With a score of (8,6), its easy to see that the world starts to get interesting at the upper part of the graph.
With the RIM Scale, any application can be shown in its relation others. We can also see if the application is stretching the current technology or just revisiting old ideas. A simple vector can be used to show progress between two applications.
In the graph below, I’ve added some examples and added another layer of information. The size of the circle shows the global impact of the application. For example, the Metaio prototyping software can “see” reality down to small dimensions, but its only used in applications for a few people. I also colored the circles into actual technologies (blue) and theoretical ones (green).
I hope the scale proves useful and helps distinguish one application from another. It can still use more clarification between the gradations on each axis, but I think it gives the basic idea. If you have suggestions on how to improve the scale or see problems with it, please leave your comments. Ideas are like programs, we can always update them to a newer and better version.
(Update – changed the multiplication to a vector score as suggested by David and Rouli, thanks guys!)
Popularity: 18% [?]
Don’t Mess With My Reality (Even If It’s Augmented)
Posted by Tom Carpenter in augmented reality on August 28th, 2009
Magic tricks are just scams that we clap and smile at when they’re over instead of wanting to choke someone.
Augmented reality is still a long way off to be able to used to fool people about the nature of reality, but given that photos are regularly photoshopped for profit, it’ll come sooner than we think. It’s such a big problem that a whole field called digital forensics has spawned from it.
And don’t think that it has to be done well to make an impact. Many of the world’s most infamous rulers have used these techniques to remove former friends or even a beer bottle from an offending picture. Stalin, Mao, Hitler, Mussolini and Castro to name a few. Even in the US these techniques have had an impact like this John Kerry and Jane Fonda picture that was later proved to be a hoax, but too late for the 2004 election (I’m not speculating that it had an effect on the election, only that it could have.)
Even now we’re dealing with birth certificate allegations with President Obama. Many doctored photos of the supposed certificate have appeared all over the Internet (they all can’t be right?)
Eventually we’ll see the same things happen to real-time videos, which by the nature of being real-time, will lead people to believe them. And many times, these techniques are only used to reinforce the will of the believers. Remember if there is a profit to be had by fooling people, then people will be fooled for profit.
Until such things come to pass. Enjoy your augmented reality magic coin trick.
Popularity: 5% [?]
Sing Along with Sean Kingston
Posted by Tom Carpenter in augmented reality on August 25th, 2009
Augmented reality will bring new and interesting ways to embarrass ourselves. Really.
The 19-year old reggae singer, Sean Kingston, has an upcoming album “Tomorrow,” due out September 22nd, that will include an AR marker in the CD case to be used for a karaoke session with Lil Sean. Fans will get to sing along on one song, “Fire Burning,” while Lil Sean (a miniature animated version of him shown on his CD cover) dances on screen with them. The news release claims fans can choreograph his dance moves. The idea behind the augmented reality project is to get fans to make videos with Lil Sean and send them in or to post them on YouTube.
I’ve spent my fair share of time in Japan making a fool of myself singing karaoke and if they can get people to post them to YouTube, it’ll drive the marketing through viral videos. Only if they’re particularly awkward though, which luckily for Sean, is the point of karaoke.
Epic’s executive vice president of marketing Lee Stimmel had this to say about the project:
It’s all about the one-to-one marketing that we as labels tend to lose. If I get a 10-year-old kid to get engaged with Sean Kingston by building a video and showing it to his buddies, I just turned on four more guys and gals to him. That has to resonate with entertainment going forward.
The reason I choose this to write about, even though its not even released, is it helps illustrate some of the points I made in the “10 Things Your AR App Must Have To Succeed” post from earlier this week. The technology is not the star. Instead, they’ve utilized it to help engage the fan in new and interesting ways.
This usage is not trying to directly increase click-through, or make immediate sales like a door-to-door salesman. Consumers are much too savvy to fall for these types of transparent attempts. Instead, they’re trying to elevate the fan’s experience by investing in making the fan happier. The service only happens after they buy a CD (granted you can surely copy it from somewhere), so they’re improving the fan’s experience after the purchase. They believe that excited fans will help generate the sales they want for them which makes sense. We take purchasing advice from people we trust, not from goofy technology-laden ads.
Will this campaign be a hit? Hard to tell. How easy it is to use and upload will also make a difference.
I liked the Cannonballz game from Zugara because it did all the uploading for me so I didn’t have to do anything other than jump around in my room like an idiot. If I’m forced to work too hard to look like an idiot in my own house, then I won’t bother.
[Via Reuters]
Popularity: 9% [?]
10 Things Your AR App Must Have to Succeed
Posted by Tom Carpenter in AR Games, Steal This AR Idea!, augmented reality on August 23rd, 2009
With the iPhone OS 3.1 launch set to debut next month, I wanted to explore the features that are going to help make some AR apps succeed over others. We’re going to be seeing a spike of releases since many have been working towards this moment waiting for the iPhone to become AR enabled, so its a good time to get those apps in tip-top shape.
And while I’m personally smartphone agnostic, these are features that should be present on any app, no matter what the platform. But the OS3.1 release will connect the hype of AR with the hype of the iPhone, so that’s why we need to talk about app features now. Call it Hype2.0 if you’d like.
And now for the features:
1 – Solutions Not Gimmicks
The best products and services are solutions to a problem. Going to your webcam to open up a 3D version of the product has lost its luster as a tired gimmick. Find a reason that augmented reality can be useful for your customers. And if you’re a car maker looking to use AR, listen to Rouli.
Don’t be like Always, the feminine hygiene company, please…
2 – Social Connections
The reason these social connectors like Twitter and Facebook work is because they allow us to be nosy neighbors seeing what next person is doing. The term “Keeping up with the Jonses” applies here. Give your app a way to connect other people in creative and interesting ways. Even if its seeing the high score along with a picture of you dodging a cannonball.
3 – App Search
Google dominates the search wars because they’re the best at it. Many functions of AR require pulling information from the data sphere and if it gets hijacked by spammers then the app will quickly lose its purpose. No one wants to pull up a restaurant layer to find a nice place to eat in a new town and get a porn layer instead while your three smiling children peer over your shoulder.
4 – Alacrity Wins
I could say apps need to be quick, but they need to be more than that. The Webster’s definition of alacrity is “promptness in response” or “cheerful readiness.” Apps should anticipate what the user wants and get it quickly. If it takes 10 seconds for the camera to identify where its at so you can decide which way to walk, no one is going to use it. If the processor is too slow, move your heavy lifting to servers off the smartphone. Life moves quickly, your app should move at the same pace.
5 – Unique Style
If you want your business to grow, your style should be tasteful and easily recognizable. When people see your products they should instantly know who created it. Already the Layar symbol has stuck into my head as a good product identifier.
6 – Not Another Vista!
If I let my kids cook dinner for themselves they make cereal. My wife will take six hours to make an exquisite dinner that uses every dish in the house, including a few of our neighbors. The kids eat cereal because its easy to do. My kids are your users. They’re not going to make Chateaubriand no matter how good it tastes. So make your apps simple to use.
7 - Save the Trees, Please
Please don’t make me print out another marker to see your version of augmented reality. We might be able to say that AR is a green product, but for all the papervision markers we’ve had to print out.
8 – Now With Less Spam
For the AR apps that allow user added content, we need to make sure we’re not besieged with spammers like the regular Internet. While this might be an impossible request, at least consider the spammers in your product design.
9 – Tell Me A Story
Augmented reality was built by programmers, but it needs artists to grow. Don’t forget to tell me a story and engage my emotions. AR is a wonderful new medium with potential to tell stories in ways never told before. The story can exist all around us or even in our living room.
10 – FUN!!!
Now matter what the purpose of your app, even if its a serious one like saving the rain forest. Don’t forget to make it fun (and maybe include a little magic).
Popularity: 58% [?]
UgoTrade Interview with Thomas Wrobel
Posted by Tom Carpenter in augmented reality, digital singularity on August 20th, 2009
Yesterday UgoTrade posted a discussion of Thomas Wrobel’s proposal called, “Everything Everywhere: A proposal for an Augmented Reality Network system based on existing protocols and infrastructure.” If you’ve been following along recent AR debates , you’ll know that Thomas is a frequent contributor to the discussion under his moniker – Darkflame.
Thomas has been offering his insight into the direction of AR in the form of IRC-like systems for some time so I wasn’t surprised at all when I saw the interview. I’m glad he took the time to put his thoughts down into a comprehensive paper to help guide the industry forward.
Personally, I find this discussion fascinating. Especially given the potential of augmented reality. It feels like sitting at the dawn of the Universe, at the original singularity, debating how quarks should interact to form atoms. Maybe my metaphor is a bit overdone, but future events hinge on these little details.
Back to Thomas’ paper, which Tish has covered quite nicely. I do want to try to answer a question he posed in the later half of the interview:
I think, that just like the remote channels, local software should also be blended into the same list of layers. People shouldn’t have to “Alt+Tab” out of one view of the world, to see another.
They should be able to see both at once, if they wish.For instance, if your playing a AR game, why shouldn’t your chat window be viewable at the same time?
If you have skinned your environment with a custom view of the world, why shouldn’t you also see mapping or restaurant recommendations?
So local data and remote data should be blended in the same view.
How can AR software – of which I hope, there will be thousands – seamlessly be expected to layer their graphics, not only with the real world, but with each other, and with online data too? Will games and software makers need to co-operate to allow their graphics to be integrated together with correct occlusion taken into account? A tall order, no?I must confess though, my technology knowledge fails me here.
I would offer that these types of applications have already been worked out in the modifiable user interfaces contained within many online games, and especially World of Warcraft. While this isn’t a true 3D environment, I believe that the way we interface with the AR world, can be customizable to suit our needs. We won’t be able to control occlusion between layers, but we can control the way our personal data looks in relation to that world. I explained as much in a post about the Human User Interface (HUI) a few months back, so hopefully it adds something to the discussion.
Overall, I think a lot of the ideas proposed by Thomas are valid discussion points to the unfolding AR world. The question is how do we move ideas like this from concept to reality? Hopefully, ISMAR and the AR Consortium will help facilitate this discussion, and when they do, I hope they include Thomas Wrobel.
Popularity: 10% [?]
Oh My Guide! AR Collaborative Guiding Service
Posted by Tom Carpenter in augmented reality on August 19th, 2009
Oh My Guide! is an AR service designed to match people who are needing directions or language services with people that can help them, instead of relying on a computer or smartphone. This adds a social element to AR tourism.
I’ve often found in my own travels that getting to know the locals is the best way to enjoy a new country, but often times its hard to overcome that initial apprehension to being a foreigner. This app facilitates the experience for the user by matching them with people who are eager to help, thus belaying any fears about interaction.
The system supports several modes of operation:
1) Default modality, which is guiding.
2) Game modality in which users or associations can set up some kind of urban games, like alternate reality games in the city.
3) Volunteer modality in which during the Expo the organization can spread volunteers around the city to help people in giving directions and talking in different languages, they can be highlighted with a distinct colour.
4) Bread crumbs modality: this is a modality in which users can leave messages around the city specific to the streets where the messages are left in. This feature is useful to know more about that particular street as people view it e.g. leaving suggestions about shortcut
I particularly like the concept of the app because its not trying to replace human interaction, but to enhance it. I think this is truly an exceptional idea that I hope works as well as it sounds.
And if you don’t quite understand the concept, they’ve made a couple of fun videos using hand puppets. Bravo!
1 – Allergy with Maps
2 – Lost in Translation
3 – When the city is boring
Popularity: 8% [?]
Layar 2.0 Walkthrough
Posted by Tom Carpenter in augmented reality on August 18th, 2009
Following up all the recent news from Layar reported on Games Alfresco – Raimo van der Klein, CEO of Layar, gives us a video tour of the new Layar 2.0 features. They’ve also released the Content Catalog listing the 87 (and counting) layars that are now live.
The video shows us the software which looks rather straightforward. Hard to tell how user friendly it is until you’re trying to use it.
One of those content layars is the EyeTour Tourist Guide for San Juan, Porto Rico.
I can’t wait for Layar to be released on the iPhone so I can actually try out the software. September looks to be a busy month for augmented reality news once Apple authorizes iPhone OS 3.1.
Popularity: 7% [?]
Metaio Unifeye Demo #3
Posted by Tom Carpenter in augmented reality on August 16th, 2009
In this third installment of the Unifeye Design Demo I go over: creating a marker out of any picture, how to use occlusion effectively and a demonstration of animation using Workflow.
Markerless Augmented Reality:
This function, Markerless Configuration, can be found under the Tools section. The name implies that you don’t use a marker, but in this case, you can apply your own self-created markers or use other visual images to orient the program to. A normal papervision marker in the software requires 100% of the picture to be viewed at all times, while these markerless creations only need 20%. This makes them a lot easier to work with. The regular markers are for industrial purposes so the extremely unforgiving camera pickup is needed.
To make this work, your markerless image must be a digital picture. I created mine in Excel then copied it into Paint to create my DigitalSea.bmp. Make your own marker then follow these steps to complete setting up the markerless image:
1. Click on Create Patch
2. Load in your picture
3. Click on Create Region
4. Define the area the program will check against
5. Close the Region (click the x in the corner)
6. Add the height and width (must be smaller than your picture, I used about 80% of actual)
7. Close the Patch
8. Add a COS and hit enter on the name
9. Add patch and hit enter (you can customize if you want)
10. Save the file
That’s all it takes to create your own markerless image. As I said in the video, you can use any picture to orient from, including a picture of your room or any everyday object.
Occlusion
Using occlusion is relatively simple. The hardest part, which isn’t that hard, is adjusting the size and location correctly to make the illusion work. Follow these steps to make a simple occlusion:
1. Set up your camera and COS (using your markerless if you want)
2. Add an object that has the same geometry as the real object you want to occlude.
3. Place overtop and resize until they are the same location and shape.
4. Under ‘General’ tab, change the view to Occlusion.
This creates an object overtop your real object giving it the illusion of space within the program. Now digital objects can interact with the real ones and give the illusion of reality.
Animation in Workflow
This technique requires a bit more work, so I’m going to show you the actual workflow. Copy the program and you can get your own knight to attack the dragon. Special thanks to Matthias from Metaio for teaching me how to do the animation.
These aspects of the software really begin to show the possibilities of the program within skilled hands. Admittedly, I’m quite the novice when it comes to augmented reality programming, but I was able to accomplish some amazing things in a short amount of time.
Overall, my respect for the software grew with each use. I could intuitively fumble my way through most of the software without any documentation and make it work. The more advanced stuff definitely required documentation, which Matthias was able to supply. I’m not sure what a more advanced AR programmer would think of the software, but as the technology gains more interest, I think it will be a huge boon for novices wanting to quickly get into the game.
Popularity: 20% [?]
TweetWorld from Gamaray
Posted by Tom Carpenter in augmented reality on August 15th, 2009
TweetWorld is an Android app from Gamaray that shows the twenty nearest geocoded tweets in the area. Touching the image on the screen will allow the user to access their webpage. Gamaray also explains they will soon allow custom 3D avatars to be associated with the tweets.
You might ask, how many geo-coded tweets are out there and how do I do that? TwitterMap and TwitterVision offer services to manually upload your location. But these services are clunky and force you to interact to make it work. In a digital world, we like to see these things happen seemlessly.
Back in May, Twitter explained that they might add location-based information to every tweet, but currently that feature is unavailable. Hopefully Gamaray will soon clarify the geo-coding so we can understand how this part of the service will work.
Popularity: 7% [?]
Recent Comments