Reality is perception.  Perception is made from the sum of our experiences filtered through our current bodily state.  Augmented reality can change perception by showing you a different world than the one expected.  Yes, we can gorge ourselves on Disney escapes or fetish porn, but Michael Harboun takes us on a journey to the transcendent side of AR.

Transcendenz from Michaël Harboun on Vimeo.

This is Michael’s take on his video:

In a world in which we are constantly bombarded with injunctions to react or to distract ourselves it gets scarcely possible in our everyday life to dwell upon the essential, the existential, the metaphysical…

Transcendenz offers to connect our everyday life to an invisible reality, the one of ideas, concepts and philosophical questionings which the world is full of but that our eyes cant’ see. By bringing together the concepts of augmented/altered reality, Brain Computer Interface (BCI) and social networks, Transcendenz offers to live immersive philosophical experiences.

Through meditation, users access the world of Interconsciousness, a white and silent universe in which they can connect themselves to the metaphysical experiences. These experiences transform our perception of the world and reveal an unseen philosophy.

Transcendenz also enables us to access the knowledge of history’s great philosophers, who, since antiquity, try to answer the question: “Why is there something, if there could be nothing?”

The Dangers of Computer Vision.

(I thought about calling this article “The Passive and Insidious Collection of Data with Cameras” or “Should We Fear Facial Recognition?” but I think the current title gets the point across.)

Computer algrorithms have reached the point that facial recognition has become easy enough to become common place.  They can even recognize emotions and other bodily conditions.

This Brazilian police department is to use AR glasses to help them distiguish criminals.  Usage such as this seems innocuous and frankly, is an application that most of us would cheer.  Who doesn’t like the idea that our police officers could pick out the terrorist in the crowd just by scanning the faces.

And by now, most have heard of Google Goggles, the program that allows a computer to recognize everyday objects.  Right now it does better with artwork or specific objects, but they’re working towards a complete knowledge of any item or person.

Does this trend of more advanced computer vision put our privacies at risk?

Imagine a world in which everytime you go into a Starbucks to get your double-mocha latte, a camera hooked to a computer owned by Starbucks recognizes you and notes your time of arrival, your facial expressions, your clothing (which indicates your income status), who you talk to, what products your eyes linger over, do you sing to the music playing in the store and a host of other details.

Would you be worried about this collection of your personal data?  In some respects, the data is there to make my purchasing experience better.  Using advanced data mining techniques,  Store #452 knows that the collection of 54% female and 46% male with a median of $74,329 per year salary likes light jazz to be played and prefers more muffins than donuts to be displayed.

Most people probably wouldn’t notice, but your Starbucks experience at Store #452 would become slightly better.  Just enough to take the edge off your early morning commute.

What if instead, the local police department, through the use of their traffic light cameras, has determined that you speed down Hallmark Hill every afternoon at 4:50pm?  So their crime analyzer program suggests that Officer DeLoop wait at the bottom of Hallmark Hill and catch you speeding.  Technically, you were breaking the rules, but maybe it was only because the hill is steep and it’s hard to ride the break down the whole slope.  The other 99.8% of the time you’re a good drive and obey the traffic laws.  How would that ticket make you feel if you knew how they’d caught you?

Or what if a national network of cameras is used to catch terrorists?  The computers sift and sort through millions of faces to find matches with known terrorists from satellite training camp videos.  The computer thinks that you, based on similarities in heights, gait and facial characterists, have an 86% chance of being a Belgian terrorist.  After a few weeks of interrogation and background check, your name is cleared, but what about the cost to your life?

Even after the event is over, how likely would it be that all traces of your “terrorist” connection would be cleansed from all government records.  Even now the government is nortoriously bad about removing incorrect names from the No Fly List.

As computers can do more and more passive data collection, how do we protect ourselves from complete and total personal invasion?  How should data be allowed to be collected?  Should we know where cameras have been placed?  Can anyone collect data?  Can be individualized and who has rights to it?

Cameras

Cameras first and foremost should be obvious.  Both where they are and when they are on and collecting data.  It’s bad enough that websites collect our P’s and Q’s without our permission and sell them.

For commercial use, cameras should also have a range and that range should only be on the store property and signs should be well posted that computer vision is in action and what time of data is being collected and how it’s being used.  That way, we can decide if we are going to come in contact with their camera and computer vision system.

In the public arena, camera placement is trickier.  Governments will want them placed everywhere and without an obvious marker showing their location.  To them, catching us and collecting data unaware is the point.

Aggragate data versus Individualized Data

There are two general ways data can be collected.  The first is by aggregating the data, keeping it untethered to any individual.  Trends and tipping points can be understood, but no individual is pulled out for scrunity.

An example would be using crowd counters to help place police officers in a big city.  Cameras could tell HQ where crowds were proliferating and HQ, based on the data, could send officers to be ready in case of unplanned for crime.

Businesses like Walmart might track general habits of its customers, noting products they pick up and put down, much in the same way a website tracks click-throughs.

Individual data is the more insidious method.  Instead of optimizing the store based on the cross-section of customers that pass through its doors, individual data would allow businesses to know who was in the store and what their preferances were and how to micro-target them with in-store ads and coupons.

The worst part is that a business could then sell that data to another business, much in the same way they collect and resell website data.  In fact, it would be likely that speciality companies would step in and do the actual camera placement, computer vision and sifting and sorting and then feedback the data to the store, while selling the rest on the open data market.

For the government, lines become very blurry, very quickly, and the imparative buzzword is security.  If the One Percent Doctrine can make premptive war a priority, why not keep a tigher watch on our higher risk citizens.  All in the name of keeping the children safe.

The telecommunications business has been in bed with the government for quite some time, letting them syphon off information and access based on the needs of our security.  The government wouldn’t even have to get permission from the telecommunications industry with a good national web of cameras.  They would be pulling directly from the source.  Us.

If this seems implausible, just ask Britons who are already being watched by the largest closed circuit TV system in the world.  Currently, it’s estimated that the government has one CC TV for every fourteen of its citizens.  That’s even more than China.  They’d like to install them in private homes, too.

What can we do about it?

Right now, it’s hard to say how the whole process will play out.  While we know that cameras will have the possibility of performing this kind of insidious data collection, it’s not in wide use yet.  But I believe, as technology like augmented reality spread and cameras become smaller and more mobile (this TV show is putting cameras on police officers), this will become a concern, so it’s better for us to become educated to the dangers and voice our opinions early and often.

But what opinions should we voice?  To this question, I offer a few points of reason.

The Data Collecting Credo

• Data can be collected in the aggregate without permission
• Individual data cannot be collected or sold without permission
• Cameras must be obvious and indicate when they are collecting
• Data used should be for the benefit of both parties
• Commercial or government data collection ends at the private property line
• Cameras cannot collect data outside of private or commercial property lines

As always, leave a comment if you have something to say.

Life is random and full of amusement.

Had a busy, productive week for the current novel project about Alexandria.  Added a few posts to Games Alfresco–one about a new AR RPG called Traveller and another about an interactive billboard.  Also, The Digital Sea got a nice review from the Literary R&R.

And last, because I woke up with this song in my head (I have no idea why), I’m going to share it with you:

Kinect brings the Etch-A-Sketch to any available window surface.  Nothing like playful window glass to make you feel like a kid again (even if your first instinct is to write a dirty word.)

Read more at the Nordstrom blog.

Another Kinect-fueled innovation from CASALA.  Me wants.

Hook up a human-sized RPG and I can LARP in the safety of my own home (except for the mocking laughter of my children.)

I’ve been trying to get information from Laster Technologies on their AR glasses for about half a year.  Then today, a little video popped up on YouTube showcasing their glasses.  I don’t know much more about them other than what’s shown in the video, and I suspect the visuals we’re seeing on screen aren’t what you’d see through the glasses.

But it is the first sighting of them beyond product pages on the website, so I’m thrilled to pass it along.

The HMDs are here!

The HMDs are here!

Okay, maybe it’s not that exciting, especially when you realize that the Mirage from Arcane Technologies is not a stylish pair of glasses or even some retro steampunk goggles outfitted with AR HMD gear.  The unit looks so bulky and bland that not even Lady Gaga could make it trendy.

But it IS an AR HMD.

But really it’s made for industrial usage and not everyday street wear.  Though I suppose, a truly hardcore AR enthusiast could augment their home and wear them safety inside without worrying about losing a chance to ever have another date.  Again.  Ever.

The system comes with authoring software so you can customize your markers.  I’d be curious if you could also use third party software like the Kinect to make it even groovier.  The Mirage + Kinect could become quite an indie hardcore hit.  However, since they don’t list the price on their website, I assume the cost is greater than even the most hardcore could afford.

Still, it IS another AR HMD on the market and to me we’re another step closer to stylish low-cost AR HMDs.  I’m still predicting 2015 as my arrival date for said glasses, but hopefully someone will surprise me and deliver a product sooner.

There’s always that one guy who posts “First!” on every comment thread. Total Immersion gets to be the lucky bloke to put the first augmented reality app onto the iPad2.

And I for one salute them.

The tablets are made for a better AR experience. While the magic mirror is strictly 2010 tech, I’m good with that, since it gives a new user a quick visceral experience with the technology.

Go, go, gadget Total Immersion.

The continued advance of computer intelligence, riding the rails of Moore’s Law, have made events like IBM’s Watson win over two champions on Jeopardy inevitable.  While thoughts of the Singularity, a future in which we cannot predict because computers will out-innovate humans, are fascinating to consider, I prefer a human centered future.  And augmented reality has a large place in a human centered world.

While the underpinnings of this chess trainer demonstration with its Hiro-markers are circa 2009, the ideas still play out.  Instead of concerns that computers like Watson will replace humans, I believe that Watson will help us take advantage of our natural abilities.  Instead of wasting time memorizing trivia, we can focus on the combining of dissimilar ideas into new synergies.

So I say, bring on Watson.  Just with a side of AR, please.