Augmented reality has come a long way in a years time.  Last year I got excited by research projects and gimmicky AR webcam advertising, but that quickly faded on the tenth plus iteration.  It wasn’t until July that we starting having real AR products in the form of apps.  Nearly a year later and still early in the development of the AR ecosystem, we’re seeing a more diverse use of the technology and that has me excited again.  So I want to take a moment to go over ten cool things going on right now in augmented reality.

1. Battle of the AR Browsers

Wikitude, Layar, Tonchidot, Junaio, TagWhat and others hope to be the standard for the AR browser market.  Layar has recently upped the ante with an AR content store and TagWhat takes it in a new direction by combining lessons learned with Foursquare and Twitter.  I suspect one of the big boys like Google, Twitter or Facebook will eventually either create their own or co-opt the ideas from these early browsers into their current products.  I’m not sure which horse to bet on in this race, but in the end we customers are the winners.

2. DIY Portable Augmented Reality Headset

Using an Eye-Trek video headset, the guy at Tailormadetoys made a pair of AR glasses.  I love the DIY culture and while they’re not see-through, I think all the right parts to make one are out there.  This post from Team Hack-a-Day proves that the DIY makers are getting close, so why can’t one of the big makers get it done?

3. The AR phone – Ouidoo

The specs on this Ouidoo QderoPateo smartphone are in the WTF!? zone.  While the phone won’t be out until the fall, the company claims it’ll have a 26-core CPU capable of 8-gigaflop floating point operations and include  512MB RAM, 4GB ROM, 28GB of built-in storage, microSD expansion, Bluetooth, WiFi, GPS, built-in 3D map, accelerometer, digital compass, 5-megapixel camera with flash, 220 hours of standby battery life, and a sharp 3.5-inch 800 x 480 screen.  Whew.

While I’m not completely believing the hype, and it could end up being vaporware, it certainly looks promising.  Though it’ll have to work hard to compete with the likes of the iPhone and Droid.

4. Eyeborg

Bionic eyes and augmented reality.  It’s like peanut better and chocolate!  Rob Spence is putting a camera into his eye to make movies with (and because its just plain cool.)  And he’s also interested in combining augmented reality with his eye camera.  They’ve come up with a promotionalAR eyeborg t-shirt in the meantime.

Eyeborg’s New AR shirt in action! from eyeborg on Vimeo.

5. ARE2010

Bruce Sterling, Will Wright, Marco Tempest, and the list goes on.  It pains me to say that I won’t be able to make the inaugural event.  I had a work conflict with that week, so I have to bow out of hosting the panel on AR glasses.  But for the rest of you, I hope you’ll be able to make it.  With AR on the rise and viable business options a-plenty, it’s a good time to network and see what everyone is doing with the nascent technology.  This is the “can’t miss” AR event of the year.

6. ARWave

Our favorite interviewer Tish Shute and longtime commenter Thomas Wrobel have been sheparding the AR Wave project and collaborating with people all over the globe.  While it’s still too early to tell, this could end up being one of the most important AR developments out there if they can truly create an open source way of using AR.  As they’ve been telling everyone, they’re trying to make a system that:

* Anyone can make content

* Anyone can make a browser

* Anyone can run a server

7. iPhone OS4.0

It almost pains me to get excited about an iPhone update that promises video access to make real AR work on that smartphone.  We got fooled last September with the OS3.1.  I’m hoping we don’t get fooled again (unless you’re the Who.)

8. Haptic AR floors

I’m not even entirely sure if haptic floors fit into the augmented reality spectrum, but it’s so crazy weird and true, that I had to include it.  I seriously doubt we’ll be seeing a commercial product anytime soon though (or ever.)

9. AR Drone

While the news on the AR drone is a stale few months old, I still think it warrants inclusion because it was a great product.  The hovercraft alone was worth the price of admission, but the AR added a creative twist to it.  I have no idea if it sold well, but it sure did capture the imaginations of a lot of geeks.

10. You choose!

Let us know what you think is the coolest thing going in augmented reality right now.  Whether it’s a product only hinted at or one currently residing on your smartphone, we’d like to hear it.  So let us know over at Games Alfresco in the comment section (pointing the conversation over there to keep the comments together)!

The year 2009 has been an important milestone in the development of augmented reality as an important future technology.  While markers and marketing campaigns captured the early interest of the year, the bigger story was the porting of augmented reality to the various smartphones in the second half. 

But those two generalities aren’t the only thing that happened in 2009 in regards to augmented reality.  I’m going to take a look back at the year, month-by-month, to remember how the year unfolded, so we better understand the direction of the future. 

January

Back at the dawn of 2009, all the augmented reality news you needed to know was in one place – Games Alfresco.  Hope was high and all the pieces seemed to be clicking into place. 

Biggest News of the Month – Metaio releases its Lego AR boxes

   * By a long shot, Metaio’s release of the augmented reality Lego box was the biggest news of the month.  When you can get Angela Merkel and the Govenator to pose with your product, you’re doing well.

Coolest App/Video – iPhone App Helps Solve Rubix Cube

   * This app portents of things to come in the future as products like Google Goggles amp up the possibilities of reality-search.  Using specific algorithms (agents) for specific tasks, there will be an app for everything you want to do in the future.

Best Article / Interview – UgoTrade Interview with Robert Rice

   * Though Robert hasn’t delivered on his promise of a Neogence product by mid-year (though the Apple video API has stymied their progress), the rest of the interview is full of great quotes and nuggets about augmented reality.

   * Notable quotes from Robert that show how much he understands the industry:

But yes, I’d say that the next 18 months are going to be very interesting with a lot of money being thrown around, new ventures, and plenty of content/applications. I expect most of this will be centered on single user AR experienced through a mobile device with a screen (iPhone, android, etc.). I expect that there will be a significant boost after Vuzix releases some of their wearable *transparent* displays, putting Microvision back into the “has potential but is too quiet” position.

Remember, one of the biggest risks that AR has, is being branded as “novelty”, which means “cool for five minutes but ultimately a waste of time.” I think we have a ways to go before something is truly useful, but as 2009 progresses we should start seeing some effort here. I’d guess 2010 before something really useful comes out…at least something practical.

Now, having said that, I should say that I expect entertainment and games to take the lead (as usual), although there are a few companies really trying to leverage AR and video/graphics compositing for marketing (brochures) and location based methods (kiosks, large screen projections, etc.)

Other notable things that happened in January – The Augmented Times is born and Rouli Nir begins a great year of chronicling the happenings of AR. 

An auspicious quote from Rouli:

This blog is about Augmented Reality (AR). It is my firm belief that AR will be the next web revolution (the so called Web 3.0, and forget about that semantic web nonsense). In the next few years, stronger devices and better algorithms will enable us to merge the real world with cyberspace. Using your mobile phone (at first) or head up display (later on) every real object will be augmented and achieve a web presence. Tourism, shopping, advertisement, entertainment and education are only a few areas that will never be the same.

This blog mission is to document this revolution as it happens. We welcome you, and welcome our augmented future.

February

This month is relatively quiet due to it being handicapped by fewer days than the other months. 

Biggest News of the Month – Augmented Reality in Flash Now Commercially Available.

   *  Making the nuts-and-bolts tools of AR available for commercial use is always a good thing, especially when its paired with flash. 

Coolest App / Video – “Sixth Sense” MIT Device.

   * Patty Maes unleashed this phenomenon on the web early last year and it still gets links and mentions today.  While projection based AR is probably not medium that we’ll all eventually use, the video showed tangible use-cases that help the non-initiated understand the embryonic technology.

Best Article / Interview – This comic from the Abstruse Goose sums up a lot about the future of ubiquitous computing (via Augmented Blog.)

Other notable things that happened in February- I started the Future Digital Life blog, which upon reading my early posts, makes me cringe a little.  Oh well, nothing ventured, nothing gained.  Also, Rouli starts the Weekly Linkfest, the best place to find the round up of AR news each week.

March

In like a lion, out like a lamb.  Augmented reality starts to get rolling in March with lots of goodies and promises.

Biggest News of the Month – Metaio and Vuzix Team Up to Create AR Goggles.

   * While the year has been mostly disappointing regarding HMDs, this was the one tangible piece of progress in the bunch.  The video Ori captured at the GDC portends to greater things.  While no companies have released products for the Vuzix+ARCam, we’ve recently seen an impressive project from Craig Kapp with his Whisper Deck. 

Coolest App / Video – Blair MacIntryre’s GA Tech team – Zombie Attack and Pit Strategy.

   * The videos showed what polished AR games can look like. 

Best Article / Interview – I’m going for a two-fer on this one because its hard to choose between Ori’s talk at WARM09 and Robert’s Decade of Ubiquity post. 

   * If you haven’t watched Ori’s talk, I highly recommend it.  Even though I’d seen the video, I made a point of hearing him live at ISMAR09 because I think its such a well thought-out call for human-based technology.  Robert’s vision is a bit more expansive and covers the whole of augmented reality.  I’ll leave you with another Robert quote:

We will break away from the desk, we will throw away our monitors, and our children will laugh at how large our IPhones are. They will struggle with how we ever managed to get work done with “windows” “webpages” and keyboards. They will be unable to fathom the concept of vinyl disks, typewriters, and landlines. But it all starts, and accelerates, during this next decade. Imagine everything that happened in the last decade, and multiply it. You haven’t seen anything yet. The next decade will make the last one pale in comparison.

Other notable things that happened in March – Topps released augmented baseball cards and ISMAR09 begins calling for papers. 

April

Biggest News of the Month- Rouli and Ori team up on Games Alfresco to create the AR hub for all AR related news.   

   * The move allowed Ori to focus more on his company and gave Rouli the helm on the daily AR newscasting.  Looking back at the great job that GA has done, I’d say it was a good move.

Coolest App / Video – Marco Tempest’s AR card trick video.

   * The video hit the web in April and showed us how AR can change our perception of reality. 

Best Article / Interview – Tim O’Reilly talks Web 2.0

   * Augmented Times identified the best quote from the video:

RFID is an evolutionary dead-end … semantic web or RFID is things “wearing name-tags”, and web 2.0 is learning to recognize things … We’re getting to that kind of augmented reality, where our computers will have senses that are as good as ours or better … they are going to recognize faces, they are going to recognize objects, they gonna have immediate recall. If you ask me “what’s the UI in five years”, it’s a pair of glasses … I’m gonna have some kind of little heads up display because I’m gonna look at something, I’m gonna walk around at a meeting and it will go “that’s Joe, you met him three years ago”.

Other notable things that happened in April – Georgia Tech fear of heights video (another peak into the future of augmented reality as a perception changer), Rouli’s call for marketers to stop using AR to sell cars, Lester at the Augmented Planet gets his blog started, Nokia point and find is out and a couple of articles about brain-computer interfaces: Honda controls robot and the brain-twitter breakthrough. 

May

Biggest News of the Month – Metaio releases Unifeye design demo.

Coolest App / Video – Useful AR from the US Postal Service.

   * Using FLARToolkit, the US postal service shows us that not all AR applications have to be novelity ones. 

Best Article / Interview – Tish interviews Ori Inbar about mobile augmented reality. 

Ori: Just like with every emerging technology in history, people never bought the technology, they bought the content, the apps, the benefits that came on top of the technology. Whether it was VHS winning over Beta Max, or BluRay winning over HD. It’s always because of more/better content. Look at the video game console war: Xbox, and Nintendo did better than Sony just because they had more and better games. Even Windows was a success thanks to its applications. People bought it for the applications not the OS. The content is the first to drive demand.

Other notable things that happened in May – My post about the Path to Augmented Vision, Programmer Joe talks AR at LOGIN, and 11 Industries to be Reinvented with Augmented Reality. 

June

Biggest News of the Month – Layar is online. 

   * The biggest news of the month by far.  Layar was the first big product release that got a buzz bump. 

Coolest App / Video – Zugara Social Shopper.

   * The video showcased the use of motion capture to help eliminate the burdensome need for keyboards and mouses when you’re using augmented reality.  Zugara later put the technique into practice for their Cannonballz and Fashionista products.

Best Article / Interview – UgoTrade Interview with Blair MacIntyre

   * No surprise here.  Tish Shute continues to get great interviews with everyone important in the AR field. 

The problem with the mobile phone as a AR device is that problem of awareness. If I have a head mount on and I walk down the street and there is bunch of probably-not-useful-but-potentially-useful information floating by me, that’s a good thing, because I may see something that is useful or makes me think of something else.  But if I have to hold up my phone to see if something might be interesting nearby, I will never hold up my phone because at the time there is a high probability that there won’t be anything particularly important there.  You might imagine you can get around this by using alerts or something like that, but then you overload whatever alert channel you use.

Other notable things that happened in June- Ori asks us all about our favorite AR games of all time, Noah breaks onto the scene with his Touchless Glove Interface, and Goggle presents their paper on Computer Vision and Pattern Recognition (which later becomes Goggles). 

July

Biggest News of the Month – The AR Consortium Announced. 

   * While its still unknown if the consortium has accomplished anything through cooperation, the intention of cooperation is a start.  Here’s to hoping we’ll see more fruit from this vine in 2010.

Coolest App / Video – AcrossAir Tube Finder.

   * At the time it was released we weren’t sure if it was a real product, but eventually we learned the truth and for a time, AcrossAir became the top selling AR app on the iPhone appstore. 

Best Article / Interview – UgoTrade Interview with Ori Inbar “Reality Reinvented”

Ori:You are so right. It’s multiple elements in the industry that have to come together. You have the technology companies like Imagination and Metaio, then you have content companies like what we’re trying to do; the hardware vendors and the large content providers. Those brands that we’re trying to go after and educate them about the potential of AR. All these pieces need to come together for this market to ignite.

Other notable things that happened in July – James Alliban’s business card goes viral and AR Avatar toys are released at Comic Con.

August

Biggest News of the Month – Yelp Introduces AR Monocle via Easter Egg

Coolest App / Video – Bruce Sterling’s Layar Keynote – At the Dawn of the AR Industry

   * Bruce released an AR-infused novel Catyadids in 2009, so it was only natural that Layar asked him to speak about the fledgling industry.  The speech is memorable with too many great lines to pick from for quoting here. 

Best Article / Interview – Thomas Wrobel’s Proposal for an Open AR Network

   * Easily Tish’s best interview because it turned into more than a reflection of past events or hopes for the future.  Tish and Thomas have since rallied AR professionals and amateurs to join the AR Wave collaborative effort.  They seek to use Wave as the platform for an open AR network and have recently been testing code. 

Other notable things that happened in August – AR Strippers!

September

Biggest News of the Month – Vuzix 920Wrap Will Not be See-Through

   * The biggest disappointment of the year was the news from Vuzix.  Good see-through AR glasses are supposed to release us from the tyranny of the “magic lens”.  Hoping 2010 brings better news, but I’m really waiting until 2011. 

Coolest App / Video – Augmenting Aerial Maps with Dynamic Information

Best Article / Interview – Gene Becker’s Design Strategies for Magic Lens.

Other notable things that happened in September – No more Gamaray - Death of a Browser, Int13 and Total Immersion getting into bed, and the augmented reality reading list.

October

Biggest News of the Month – News from ISMAR09, News from ISMAR09 #2 and UgoTrade ISMAR09 Coverage.

   * I was lucky enough to attend and speak at ISMAR09.   The energy of the participants was exceptional and I came away from it more jazzed about AR than I was going in.  Hopefully the ISMAR committee will be releasing the videos from the event soon. 

Coolest App / Video -  2D sketches become 3D reality. 

Best Article / Interview – ISMAR09 HMD Review

   * I think I summed up the current state of HMDs for AR pretty well.  I’m hoping 2010 brings a suprise for AR HMDs.

Other notable things that happened in October – AR Wave discussion on UgoTrade, Wikitude for the iPhone first look and Giant Hand Torments City

November

Biggest News of the Month – Junaio hits the app store. 

Coolest App / Video – Interactive Entertainment Using AR

   * The videos about the Disney experiences were similar to what Mark Mine showed us at ISMAR.  They really show us how technology can transcend our perceptions of reality.

Best Article / Interview –  Augmented Planet’s Head-to-head browser test (and part 2)

   * Lester broke down the various browsers in this excellent hands-on challenge.  Read both parts to find out the winner.

Other notable things that happened in November – Business Week’s Article about: Getting Beyond the Hype and Robert Rice’s reply. 

December

Biggest News of the Month – Goggle Googles is released.

   * The giant has awoken.  Goggles has many implications for Googles ideas on the AR market.  This won’t be the last time we’ll hear from them about this technology.

Coolest App / Video – Layer 3.0. 

   * While Layar has since pulled the app from the app store and had to issue and apology, the version 3.0 still holds lots of promise. 

Best Article / Interview – Augmented Reality in 2010: Predictions (10 part series)

   * A wide swath of the AR blogosphere had the opportunity to participate in the predictions series from Games Alfresco run by Rouli Nir.  More interesting, snarky, and possibly-true predictions that you can shake an augmented stick at.

Other notable things that happened in December – AR Wave FAQ on UgoTrade, Enkin acquired by Google, ARDevCamp, Wikitude Teams Up with Lonely Planet, 10 Worse Uses of AR in 2009, and Nexus One News and Implications of AR. 

What It All Means

Whew.  After reviewing hundreds of articles and videos, I’m sure I’ve missed a number of important happenings from the year 2009.  If I have, please make sure to comment and I’ll add it if I have overlooked it. 

What does it all mean?  That is entirely up to you.  The year has brought many advances to augmented reality and the ceiling is sky-high for 2010.  There will be surprises, excuses, apologies, releases, re-releases and more.  Money will be pumped in, not all where it should go, and progress will be made.  We’ll laugh at the videos, smile at our favorite products and complain when it does work as expected.  Either way, it will be a year more interesting than the last and I’ll be here to watch it all unfold.

Reagan famously said, “Mr. Gorbechev, tear down this wall!”

While arguments can be made whether Reagan’s challenge had any affect on the end of the Soviet Union, it still marked an important time in history.  In that same speech, Reagan referenced some crudely spray painted words on the wall–”The wall will fall.  Beliefs become reality.”  These were probably the more important words that he said on that fateful day. 

These words hold true for the current problem facing augmented reality smartphone app developers.  Beliefs have become reality for the VCs that any important AR apps must be made for the iPhone.  As Robert Rice, CEO of Neogence Enterprises, paraphrased what he’s heard, “We are only interested in deals that are… running on the iPhone….” 

The problem with this is that Apple isn’t giving up access to the video stream from the camera.  Current AR apps are either using the non-visual sensors like the GPS and accelerometer, or using single frames as a reference which make apps laggy and unreliable.  Once again, Robert Rice opines about this problem in his post–The Candy Apple Conundrum:

But I am continually perplexed by Apple’s refusal to open up the undocumented APIs in their SDK to allow augmented reality researchers and developers access to the video stream from the camera. This is a critical element for any type of visual tracking (markers, feature tracking, and markerless tracking). Some people figured some work arounds to make it work with the 2.x version of the SDK which is nice, except that this automatically disqualifies any applications from distribution in the app store. What really kills me though, is that on one hand, Apple made a play for welcoming AR applications with the 3.x version of the SDK, but only provided access to the overlay, while at the same time completely changing where the undocumented API calls were located, further obfuscating things and handicapping all R&D.

It’s clear that there is a high level of frustration within developers and Robert’s not the only one to notice.  Kim-Mai Cutler from Venture Beat talks about how, “[apps are] still being held back because they don’t have the right application programming interfaces for manipulating live video.”  And back in July, Ori Inbar posted an Open Letter to Apple. 

Why isn’t Apple opening up the video stream to developers?  Is it for the Machiavellian reason that they are developing their own secret AR master take-over as hinted by their patent filings?  Does any of this matter?

If we look at the Q2 2009 smartphone sales by Canalys, we see that the iPhone only holds 13.7% of the market.  While Symbian dominates with a whopping 50.3%.  What gives? 

The iPhone has done a wonderful job of controlling the branding space of future smartphones, but the reality is that they are only number three.  In this case, beliefs have become reality.   While I’ll be the first person to crow about augmented reality on the iPhone if they do ever release the video stream, I also don’t think we should be holding our breath any longer.  I find it sadly ironic that their iconic TV commercial from 1984 can be applied to them now.

Mr. Jobs, I am a small press blogger, but I sense the slow churn of animosity towards the iPhone.  The apps are what make the iPhone sell, and if AR takes off while you’re still sitting behind your wall, hype will drive them to a Symbian or Android smartphone that does support augmented reality. 

So tear down that wall, Mr. Jobs.  Or we’ll find someplace else to go that doesn’t have any walls.

So it’s another augmented reality business card.  This time from the company Genuine Interactive.  The use of a 3D video landscape within the augment is cute, but there’s one major flaw with this application.  It requires the use of a PC. 

Don’t get me wrong.  I’m all for the AR business card.  I even requested one.  But I need to be able to see it with my smartphone so I can show it to someone on a business trip.  Requiring me to be near a PC to view the AR business card doesn’t mesh well with the social nature of business greetings. 

There are four or five different companies working on AR business cards right now.  They should band together and make iPhone and Android apps for seeing these cards and release the apps for free.  Let the content of their creation be the selling point.  Otherwise this concept will die to the friction of using it. 

The often maligned graffiti artist now has a new and pollution free way (ignoring the energy used by the smartphone) to tag the world.  The Andoidpit app developers have created an augmented reality graffiti Airpainter.  The app allows you to create airpaintings which are limited in creativity by the nimbleness of your touch-pad finger.  It also allows the user to view any nearby airpaintings. 

The video is in German but since they’re showing close-ups of the app, its easy to figure it out what’s going on. 

The app looks like an interesting way to experience augmented reality on the Android, but it probably isn’t that much fun unless a critical mass of people in an area are using it.  On the other hand, diabolical artists could certainly spice up the bathroom wall and I’m positive some of the earliest drawings will be overlarge genitalia floating into a doorways.

With the iPhone OS 3.1 launch set to debut next month, I wanted to explore the features that are going to help make some AR apps succeed over others.  We’re going to be seeing a spike of releases since many have been working towards this moment waiting for the iPhone to become AR enabled, so its a good time to get those apps in tip-top shape. 

And while I’m personally smartphone agnostic, these are features that should be present on any app, no matter what the platform.  But the OS3.1 release will connect the hype of AR with the hype of the iPhone, so that’s why we need to talk about app features now.  Call it Hype2.0 if you’d like.

And now for the features:

1 – Solutions Not Gimmicks

The best products and services are solutions to a problem.  Going to your webcam to open up a 3D version of the product has lost its luster as a tired gimmick.  Find a reason that augmented reality can be useful for your customers.  And if you’re a car maker looking to use AR, listen to Rouli. 

Don’t be like Always, the feminine hygiene company, please…

2 – Social Connections

The reason these social connectors like Twitter and Facebook work is because they allow us to be nosy neighbors seeing what next person is doing.  The term “Keeping up with the Jonses” applies here.  Give your app a way to connect other people in creative and interesting ways.  Even if its seeing the high score along with a picture of you dodging a cannonball.

 3 – App Search

Google dominates the search wars because they’re the best at it.  Many functions of AR require pulling information from the data sphere and if it gets hijacked by spammers then the app will quickly lose its purpose.  No one wants to pull up a restaurant layer to find a nice place to eat in a new town and get a porn layer instead while your three smiling children peer over your shoulder. 

4 – Alacrity Wins

I could say apps need to be quick, but they need to be more than that.  The Webster’s definition of alacrity is “promptness in response” or “cheerful readiness.”  Apps should anticipate what the user wants and get it quickly.  If it takes 10 seconds for the camera to identify where its at so you can decide which way to walk, no one is going to use it.  If the processor is too slow, move your heavy lifting to servers off the smartphone.  Life moves quickly, your app should move at the same pace.  

5 – Unique Style

If you want your business to grow, your style should be tasteful and easily recognizable.  When people see your products they should instantly know who created it.  Already the Layar symbol has stuck into my head as a good product identifier. 

6 – Not Another Vista!

If I let my kids cook dinner for themselves they make cereal.  My wife will take six hours to make an exquisite dinner that uses every dish in the house, including a few of our neighbors.  The kids eat cereal because its easy to do.  My kids are your users.  They’re not going to make Chateaubriand no matter how good it tastes.  So make your apps simple to use. 

7 - Save the Trees, Please

Please don’t make me print out another marker to see your version of augmented reality.  We might be able to say that AR is a green product, but for all the papervision markers we’ve had to print out.   

8 – Now With Less Spam

 For the AR apps that allow user added content, we need to make sure we’re not besieged with spammers like the regular Internet.  While this might be an impossible request, at least consider the spammers in your product design. 

9 – Tell Me A Story

Augmented reality was built by programmers, but it needs artists to grow.  Don’t forget to tell me a story and engage my emotions.  AR is a wonderful new medium with potential to tell stories in ways never told before.  The story can exist all around us or even in our living room. 

10 – FUN!!!

Now matter what the purpose of your app, even if its a serious one like saving the rain forest.  Don’t forget to make it fun (and maybe include a little magic).

With three smartphones on the market: iPhone, Android and Pre; the opportunities for augmented reality apps have opened up. 

I asked a couple of AR developers what they wanted from smartphones and I recieved some interesting answers.  I’ve summarized the information for easier digestion.

Processing Power:  Overall processing power is at a usable level, but more is always better.  With the ability to use cloud computing, the heavy lifting can be done by processors not in the phone.

Graphics: High quality graphics with acceleration to achieve good frames per second (fps) and resolution will be needed for real time image processing.  This will be especially important for AR smartphone game developers.

Integrated Camera: Most thought the cameras were fine, but like processing power, can always be better.

Other Hardware: GPS, compass, accelerometer and tilt sensors are all useful for direction finding. 

Software: Developing apps for multiple platforms (iPhone, Android and Pre) due to the varying nature of their specific phones (processor speed, camera functions, etc) is challenging.  So platform designers should make sure the SDK (Software Development Kit) are easy-to-use and have good APIs (Application Programming Interfaces) to access the video stream. 

Power: AR requires lots of graphics which is an energy-hog, so smartphones should be efficient. 

All these requested features aren’t yet available in total, but each smartphone is moving in the right direction.  For instance, the new iPhone 3GS and the Palm Pre both have cameras that don’t give fuzzy pictures like the initial iPhone release one year ago. 

While its easy to be a kid before Christmas and ask for lots of things you know you won’t get (yet).  I liked what Seinichi Kanemura from Sein Blog had to say about smartphone development:

So what is next step of AR application?
I do believe that it will be not full AR.
It would be something semi-AR application.
Otherwise, just limited users who have high literacy in IT will love it.
So I focus on easy & simple AR application.
Probably, I’ll write the entry on my blog within a few months.

Very much a pragmatist about the development of a technology still in its infancy.  Looking forward to his next blog entry. 

Special thanks to Farooq, Sein and Jan from Metaio for answering my questions.

A new Android program called Sky Map can tell you what stars you’re looking at in the sky by pointing your phone in the right direction.  Using the magnetometer, accelerometer, GPS and clock, the phone can tell what direction the phone is pointed in. 

I’m impressed by the designers ingenuity in developing the ability to tell absolute direction without using any visual clues. 

The program also gives you the ability to search for particular heavenly objects.  And because it doesn’t use object recognition (which would be impossible with most light flooded skies), it will work through walls, ceilings and even the earth (telling you what could be seen on the other side of the world). 

See the video.

I’d like to take a moment and review the AR happenings around the net in the last month about augmented reality.

* Not one, but two AR frameworks are being released – Layar and Gamaray; both for Google’s Android.  Augmented Times and Games Alfresco scooped both. 

* News on a number of handheld AR Games: Ghostwire and Invizimals.

* Lots of conference news in the last month.  Thankfully, the eyes on the scene, Ori Inbar, has brought back tons of interesting inside information: IGC East, E3 09, Where 2.0 and reflections on the GDC. 

* Interesting posts from a variety of blogs: AR Hype Cycle, Metaio’s AR Software Demo and High Visual Quality AR Demonstration.  I’m certain I’m missing lots of other good posts around the AR blogs.  If I missed you here, send me a line and I’ll add it.

* Many AR marketing campaigns (I’m not going to bother linking them): Papa Johns, Star Trek, Eminem, BMW, Toyota, Night at the Museum 2 and another half-dozen I’ve forgotten already.

* On my own site, my most popular posts have been: The Path To Augmented Vision, Creating the Cloud and How to Automate the Digitization of the World.  The last one is from March, but it still continues to be my top post. 

* Lastly, I’ve started a weekly AR comic called Augment This! and posted an AR short story called There Is No Truth In The Digital Sea.  The short story takes place about twenty years from now when augmented vision is commonplace.

Whew.  It certainly seems like activity in the AR world has been picking up.  I think the rest of 2009, AR will continue to grow and 2010 will be the real breakout year as good AR products will hit the market and start catching consumers eyes and wallets.

I’m not going to go into too much detail, because Rouli gives us an excellent run down on the Augmented Times, but I think this is an important step in “creating the cloud“.  Who knows, Layar could be the early version of Netscape, except for an AR world. 

Good job crew at SPRXMobile!