Showing posts with label AR / VR. Show all posts
Showing posts with label AR / VR. Show all posts

Sunday, 22 January 2017

Augmented / Virtual Reality Requirements for 5G

Ever wondered whether 5G would be good enough for Augmented and Virtual Reality or will we need to wait for 6G? Some researchers are trying to identify the AR / VR requirements, challenges from a mobile network point of view and possible options to solve these challenges. They have recently published a research paper on this topic.

Here is a summary of some of the interesting things I found in this paper:

  • Humans process nearly 5.2 gigabits per second of sound and light.
  • Without moving the head, our eyes can mechanically shift across a field of view of at least 150 degrees horizontally (i.e., 30:000 pixels) and 120 degrees vertically (i.e., 24:000 pixels).
  • The human eye can perceive much faster motion (150 frames per second). For sports, games, science and other high-speed immersive experiences, video rates of 60 or even 120 frames per second are needed to avoid motion blur and disorientation.
  • 5.2 gigabits per second of network throughput (if not more) is needed.
  • At today’s 4K resolution, 30 frames per second and 24 bits per pixel, and using a 300 : 1 compression ratio, yields 300 megabits per second of imagery. That is more than 10x the typical requirement for a high-quality 4K movie experience.
  • 5G network architectures are being designed to move the post-processing at the network edge so that processors at the edge and the client display devices (VR goggles, smart TVs, tablets and phones) carry out advanced image processing to stitch camera feeds into dramatic effects.
  • In order to tackle these grand challenges, the 5G network architecture (radio access network (RAN), Edge and Core) will need to be much smarter than ever before by adaptively and dynamically making use of concepts such as software defined networking (SDN), network function virtualization (NFV) and network slicing, to mention a few facilitating a more flexible allocating resources (resource blocks (RBs), access point, storage, memory, computing, etc.) to meet these demands.
  • Immersive technology will require massive improvements in terms of bandwidth, latency and reliablility. Current remotereality prototype requires 100-to-200Mbps for a one-way immersive experience. While MirrorSys uses a single 8K, estimates about photo-realistic VR will require two 16K x 16K screens (one to each eye).
  • Latency is the other big issue in addition to reliability. With an augmented reality headset, for example, real-life visual and auditory information has to be taken in through the camera and sent to the fog/cloud for processing, with digital information sent back to be precisely overlaid onto the real-world environment, and all this has to happen in less time than it takes for humans to start noticing lag (no more than 13ms). Factoring in the much needed high reliability criteria on top of these bandwidth and delay requirements clearly indicates the need for interactions between several research disciplines.

These key research directions and scientific challenges are summarized in Fig. 3 (above), and discussed in the paper. I advice you to read it here.

Related posts:

Tuesday, 4 December 2012

5 videos on Augmented Reality

Looks like Augmented Reality (AR) is getting hot, just in time for Christmas. I wonder how many products will be sold based on AR. As I suggested in an earlier post, there may be 1 Billion users by 2020. Here are the videos:

Google's Ingress is an AR baased game:

Augmented Reality Book of Spells, Harry Potter experience:

Wonder when/ever it will come to a mobile near you.

LightBeam - Interacting with Augmented Real-World Objects in Pico Projections:

The next is a bit old but worth mentioning:

LuminAR from MIT

Finally, the science of Haptics will allows us to "touch" objects in a virtual world in future

Augmented Reality and Touch

Saturday, 16 June 2012

1 Billion Augmented Reality (AR) users by 2020

It has been slow but I am getting more and more convinced that AR can do far more than what we think it can. Part of my pessimism was due to the fact that this is placed on the Peak of Inflated expectations on the Gartner Hype cycle and was predicted to go to the trough. But in the end success depends of what the available apps are like.

Part of my optimism stems from the fact that things have been changing rapidly. Take for example the 'Augmented Future' video. When I watched it I thought this would happen but maybe quite a few years down the road. Then came the 'Project Glass' video and suddenly you are thinking from 'how it would be done' to 'when will this be available'. The latest news I read was that the prototypes are being tested Google's offices.

I am sure the first few releases would be far from perfect and will have few features, security issues, etc. but we certainly think its possible. I dont know its working but it could be actually synched with a device in your pocket and is just an add on that communicates via something like Bluetooth.

In a recent event, Intel showed off their new Ultrabook features using Augmented Reality. See the video:

And there is another video of BBC frozen planet where people can put themselves with the Augmented creatures. See below:

These just go to show what can be done via Augmented reality. With more and more powerful devices that are available to us at reasonable prices, all that needs to be done is to create Apps and they will find the users trying to make most out of them.

I have already posted some videos and presentations from an event back in March that talk more about the apps and the platforms here.

The idea of 1 Billion AR users is not mine but has been used by Tomi Ahonen in a recent TEDx presentation and his blog post. The TEDx video as follows:

You can read  more about Tomi's idea on Aurmented Reality in his blog post here.

Sunday, 8 April 2012

Security issues in new technologies

I have attended a lot of events/talks in the last month where people talked about Augmented Reality, Proximity Marketing, QR codes, etc. but nobody seems to talk about security. Its being taken for granted. For example MAC's have been said to be Virus proof and they probably are but other Apps may be infectable and in this case its the Java that has allowed a MAC botnet about 0.6 Million strong.

Some years back proximity marketing via Bluetooth was a big thing and we were lucky to be involved with couple of projects making it possible but then the Bluetooth virus came to light and people stopped leaving their Bluetooth on in public places. Doesnt look like Bluetooth based proximity marketing has gone very far since those days.

QR codes is a simple way to for advertisers redirect the end users to their websites but then recently I read that a rogue QR code can be used to redirect the end users to a site that can be used to hack their phones. The main thing pointed out is that 99% of the time QR codes are read by mobile phones and 99% of these phones are either iPhones or Android's, which can help narrow down the exploits.

There is a good chance that when there is mass adoption of these new technologies, Security is going to be a big issue. Not sure if enough is being done. If there are any pointers on security issues please feel free to comment.

Wednesday, 4 April 2012

Project Glass: One day... By Google

I seem to like the Corning ones more that I blogged here.

** New Edits 05/04/12 09:40 **
From CNET:

Google's augmented reality glasses are real! Dubbed Project Glass, the long-rumoured lenses that show you heads-up information about the world around you have been confirmed by the company.
At the moment, Google's announcement is limited to a Google+ page
Here is a parody on above video from Tom Scott:

Friday, 23 March 2012

Augmented Future

Couple of very interesting videos on how the future may look like:

Monday, 19 March 2012

Vuforia™: Qualcomm's Augmented Reality (AR) Platform

As I mentioned yesterday, while some people think that Augmented Reality is losing its charm, Qualcomm certainly thinks that things are looking up for AR and it can only get better. They have branded their AR platform as Vuforia. A recent presentation from Cambridge Wireless event is embedded below:

There are some interesting video's on Augmented Reality using the Vuforia platform on Youtube. Some of them as follows:

All presentations from the CW event are available here.

Sunday, 18 March 2012

Augmented Reality on the 'Peak of Inflated Expectations'

In a recent event in Cambridge Wireless, one of the topics of discussion was where does 'Augmented Reality' sit on the Peak of Inflated Expectations. While one of the speaker thought that it was on the Peak going towards Trough, most of the others thought that it had already passed the trough and is now going up.

Some six months back I put a picture up from the Gartner Hype Cycle that showed that the Augmented Reality is at the peak going towards the trough.

What do you think? Any opinions?

Monday, 7 March 2011

Augmented Reality: Future Killer App?

Augmented Reality can be understood very easily with the two videos embedded below:

It may look cool and one may wonder how this can be useful practically, here is another video showing how this can be used:

So in future you may have quite a few people who can only look at you through the [phone rather than directly :)

The following is an extract from The Guardian article titled, "What is mobile augmented reality for?":

Mobile augmented reality is a relatively young technology, but it has already attracted a great deal of hype and scepticism in equal measure.

Overlaying digital information onto the real world, viewed through a cameraphone, is technically impressive, but the business models and usage patterns are still evolving.

That's a polite way of saying mobile AR is cool, but nobody really knows what it's for, or how it will make money. One of the more interesting conference sessions at this year's Mobile World Congress aimed to answer the key question: what is it for?

Tourism has been an early focus. Just this week, travel site TripAdvisor added an augmented reality feature to its iPad app (pictured above), while Lonely Planet has also used AR elements in several of its travel apps.

"You are most information-starved when you are in a completely new environment," said Jeremy Kreitler, vice-president of mobile at Lonely Planet. "Those are probably the environments where augmented reality will flourish the most."

The Layar chief executive, Raimo Van der Klein, pointed to the popularity of Twitter layers in his company's app, which allow people to see local tweets superimposed on their camera view of the world around them.

"In the future, it will be the physical world that will trigger usage," he said. "Your dynamic and changing context, as you interact with different media, products, packaging and people, and you would like to make sense of what you encounter."

Technology firm Qualcomm recently held an augmented reality contest for mobile developers, announcing three winners this week at Mobile World Congress. All three were games.

Qualcomm's vice-president of ventures, Nagraj Kashyap, took the view that games are often a good proving ground for new technologies in their early stages, with AR no different.

"It's just something that appeals to a wide cross-section of users," he said. "But to have augmented reality become mass, we need to move out of just the gaming context."

Qualcomm sees much potential in marketing, particularly when AR is used to add an interactive layer to print advertisements. Kashyap also thought educational and instructional AR content will be popular in the future. "Imagine pointing your phone at a newly bought washing machine and getting instructions for it on your phone."

However, Philipp Schloter, chief executive of developer Abukai, said that looking for individual killer apps is the wrong way to approach augmented reality.

"This is really more of an enabler that sits across many different areas," he said. He was backed up by Peter Meier, founder of Metaio, the company which makes the Junaio AR browser app. "I always see augmented reality as a new user interface technology, and less as something for which there's the killer app out there," said Meier.

"For me, this is about accessing and understanding information more easily, and enjoying information that is somehow related to the real world ... I don't think there's a killer app. This is more like the next touchscreen for mobile phones – more like the next user interface revolution."

David Marimon, who heads up mobile augmented reality and visual search for operator group Telefonica, suggested that new uses for AR will be found as different kinds of developers start to work with it, including visual and interaction designers.

He also said that Telefonica is keen to help developers find new uses for AR by providing them with technology and APIs to tap into the operator's customer data.

"We know where mobile phones are thanks to GPS and other sensors, which is a very intuitive starting point to get the context of the user," he said. "We are also working on visual recognition to acquire that context: we need to know what the user is looking at, for which we can use the camera."

In the recently concluded Mobile World Congress, there was a panel that discussed the options on Augmented Reality or AR as its better known. The slides are embedded below but only the initial slides provide some value.

I have heard of some and can can think of some more simple applications that can actually be very useful. Maybe some of them are already being developed.

1. reviews of Pubs/Clubs - If you planning to go to some Pub/club in an area you can just look at the places through your lens and immediately see the number of stars received in reviews.

2. Virtual tour guide - One of the apps Lonely Planet are working on is developing virtual tour guides that can tell you all the information about a place once in your mobile camera

3. In some countries where For Sale sign could not be put while selling houses, you can go in an area and look at the houses though your camera and it will tell you which house is for sale, which estate agent and what is the price

4. Some manufacturers have suggested that simple procedures required with gadgets like changing the toner or a printer can be done using AR apps.

5. Games is certainly and area that is going to be a major user of AR for effects and to get people excited

6. Dating apps could use AR to tell about the places where singles hangout in the real time.

8. CV's for Jobs - Personally, I think QR code can do the job in this case

9. AR could be used as your personal shopping assistant in the supermarket helping you do your shopping in the least amount of time - assuming you know all the things that need to be bought in advance

And many more uses of AR can be thought of and debated.

Finally, there is also a recent presentation titled "Augmented Research" embedded below: