Augmented Future

Couple of very interesting videos on how the future may look like:

Vuforia™: Qualcomm's Augmented Reality (AR) Platform

As I mentioned yesterday, while some people think that Augmented Reality is losing its charm, Qualcomm certainly thinks that things are looking up for AR and it can only get better. They have branded their AR platform as Vuforia. A recent presentation from Cambridge Wireless event is embedded below:

Using AR Apps to Change How We Shop, Learn, Play & Interact

View more presentations from Zahid Ghadialy

There are some interesting video's on Augmented Reality using the Vuforia platform on Youtube. Some of them as follows:












All presentations from the CW event are available here.

Augmented Reality on the 'Peak of Inflated Expectations'

In a recent event in Cambridge Wireless, one of the topics of discussion was where does 'Augmented Reality' sit on the Peak of Inflated Expectations. While one of the speaker thought that it was on the Peak going towards Trough, most of the others thought that it had already passed the trough and is now going up.

Some six months back I put a picture up from the Gartner Hype Cycle that showed that the Augmented Reality is at the peak going towards the trough.

What do you think? Any opinions?

Mobile Video is more than 50% of the data traffic

With the popularity of video streaming, its no surprise that video is already more than 50% of the data traffic flowing through the network.

Ericsson Video: Using LTE to broadcast Danish elections

Danes elected a new parliament September 15. As four teams from TV 2 moved between party headquarters, Parliament House and celebration sites, they used standard off-the-shelf LTE terminals to upload interviews to the tv-station, which in turn broadcast the content live to viewers on their channel.

The solution is provided by operator TDC, on the network supplied and managed by Ericsson.

Human Activity Recognition for Personalised services

Human Activity Recognition for Personalised Services

View more documents from Zahid Ghadialy

Interesting article from the NTT Docomo Technical journal.

Service Layer Optimization element to Improve Utilisation of Network Capacity

Picture Source: Simple LTE for 4G Mobile Broadband

The following is an extract from 4G Americas whitepaper, "Optimizing the Mobile Application Ecosystem":

Applications have diverse requirements on the mobile network in terms of throughput, relative use of uplink vs. downlink, latency and variability of usage over time. While the underlying IP based Layer 3 infrastructure attempts to meet the needs of all the applications, significant network capacity is lost to inefficient use of the available resources. This inefficiency stems primarily from the non-deterministic nature of the aggregate requirements on the network from the numerous applications and their traffic flows live at any time.

This reduction in network utilization can be mitigated by incorporating application awareness into network traffic management through use of Application or Service Layer optimization technologies. A Service Layer optimization solution would incorporate awareness of:

1) device capabilities such as screen size and resolution;

2) user characteristics such as billing rates and user location;

3) network capabilities such as historic and instantaneous performance and;

4) application characteristics such as the use of specific video codecs and protocols by an application such as Video on Demand (VOD) to ensure better management of network resources.

Examples of Service Layer optimization technologies include:

* Real-time transcoding of video traffic to avoid downlink network congestion and ensure better Quality of Experience (QoE) through avoidance of buffering

* Shaping of self-adapting traffic such as Adaptive Streaming traffic through packet delay to avoid downlink network congestion

* Shaping of error-compensating flows such as video conferencing through use of packet drops to avoid uplink network congestion

* Shaping of large flows such as file uploads on the uplink through packet delays to conserve responsiveness of interactive applications such as web browsing

* Explicit caching of frequently accessed content such as video files on in-network CDNs to minimize traffic to backbone

* Implicit caching of frequently accessed content such as images in web content on in-network caches to improve web page retrieval speeds

Service Layer optimization technologies may be incorporated in the data path in many locations:

1) the origin server;

2) the UE device;

3) as a cloud-hosted offering through which devices and/or applications and/or networks route traffic or;

4) as a network element embedded in a service provider’s network.

Further, in a service provider’s network the optimization function may be deployed in either the core network and/or edge aggregation locations. When Service Layer optimization entities in the network are deployed at both core and edge locations, they may operate in conjunction with each other to form a hierarchy with adequate level of processing to match the traffic volume and topology. Such a hierarchy of network entities is especially effective in the case of caching.

The 3GPP standard network architecture defines a number of elements such as QoS levels that are understood and implemented in the network infrastructure. However, much of this network capability is not known or packaged for use in the Service Layer by application developers. One approach to resolving this discrepancy may be to publish standard Service Layer APIs that enable application developers to request network resources with specific capabilities and also to get real-time feedback on the capabilities of network resources that are in use by the applications. Such APIs may be exposed by the network to the cloud or may be exposed to application clients resident on mobile devices through device application platforms and SDKs. The network APIs being defined by the Wholesale Application Community are an example of the recognition of the need for such Service Layer visibility into network capabilities. Future versions of the WAC standards will likely incorporate and expose network Quality of Service (QoS) capabilities.

Pic Source: Aria Networks

Why does Optimization matter? A good answer to this question is provided in Telecoms.com article as follows:

For many people, says Constantine Polychronopoulos, founder and chief technology officer of mobile internet infrastructure specialist Bytemobile, the definition of optimisation as it relates to mobile networks is too narrow; restricted to compressing data or to the tweaking of the radio access network in a bid to improve throughput. While these are key elements of optimisation, he says, the term ought to be interpreted far more broadly. “The best way for us to think of optimisation,” he says, “is as a set of synergistic technologies that come together to address everything that has to do with improving network and spectrum utilisation and user experience. If you stretch the argument, it includes pretty much every thing that matters. This holistic, end-to-end approach to optimisation is the hallmark of Bytemobile’s solutions. Point products tend to be costly and difficult or impossible to evolve and maintain.”

And optimisation matters, he says, because the boom in mobile data traffic experienced in some of the world’s most advanced mobile markets represents a serious threat to carrier performance and customer satisfaction. US operator and pioneer iPhone partner AT&T is a case in point, Polychronopoulos says.

“If you look at what’s been said by Ralph de la Vega (president and CEO of AT&T Mobility) and John Donovan (the firm’s CTO), they have seen a 5,000- per cent increase in data traffic over the past two years. The data points from other operators are similar,” he continues. “They see an exponential growth of data traffic with the introduction of smartphones, in particular the iPhone.”

Operators may have received what they’d been wishing for but the scale of the uptake has taken them by surprise, Polychronopoulos says. The type of usage consumers are exhibiting can be problematic as well. Bytemobile is seeing a great deal of video-based usage, which can often be a greater drain on network resource than web browsing. Given the increasing popularity of embedding video content within web pages, the problem is becoming exacerbated.

Dr. Polychronopoulos is keen to point out that there are optimisation opportunities across different layers of the OSI stack—Bytemobile offers solutions that will have an impact on layers three (the IP layer) through seven (the application layer). But he stresses that some of the most effective returns from optimisation technologies come from addressing the application layer, where the bulk of the data is to be found.

“An IP packet can be up to 1,500 bytes long,” he says. “So at layer three, while you can balance packet by packet, there is only so much you can do to optimise 1,500 bytes. At the top layer, the application can be multiple megabytes or gigabytes if you’re watching video. And when you’re dealing with those file sizes in the application layer, there is a whole lot more you can do to reduce the amount of data or apply innovative delivery algorithms to make the content more efficient,” he says.

By optimising content such as video, Polychronopoulos says, significant gains can be made in spectral and backhaul network utilisation. A range of options are open to operators, he says, with some techniques focused on optimising the transport protocol, and others designed to reduce the size of the content.

“With video, we can resize the frame, we can reduce the number of frames, we can reduce the resolution of the frame or apply a combination of the above in a way that does not affect the video quality but greatly improves network efficiencies,” he says. “So if you go to a site like YouTube and browse a video, you might download something like 100MB of data. But if you were to go through a platform like ours, you may download only 50MB when the network is congested and still experience not only the same video quality, but also fluid video playback without constant re-buffering stalls.”

It is possible, he explains, to run these solutions in a dynamic way such that data reduction engages only when the network is congested. If a user seeks to access high-volume data like video during the network’s quiet time, the reduction technologies are not applied. But when things are busier, they kick in automatically and gradually. This could have an application in tiered pricing strategies. Operators are looking at such options in a bid to better balance the cost of provisioning mobile data services with the limited revenue stream that they currently generate because of the flat rate tariffs that were used to stimulate the market in the first place. Being able to dynamically alter data reduction and therefore speed of delivery depending on network load could be a useful tool to operators looking to charge premium prices for higher quality of service, Polychronopoulos says.

If it is possible to reduce video traf- fic in such a way that data loads are halved but the end user experience does not suffer proportionally, the question arises as to why operators would not simply reduce everything, whether the network was busy or not. Polychronopoulos argues that in quiet times there are no savings to be made by reducing the size of content being transported.

“The operator has already provisioned the network one way or another,” he says, “so there is a certain amount of bandwidth and a certain amount of backhaul capacity. When the network is not congested, the transport cost is already sunk. When it becomes congested, though, you get dropped calls and buffering and stalled videos and the user experience suffers. That’s where optimisation shines. Alternatively, media optimisation can be factored in during toplevel network provisioning when the savings in CAPEX can be extremely compelling.”

While LTE is held up by some within the industry as the panacea to growing demand for more mobile broadband service, Polychronopoulos is unconvinced. If anything, he says, the arrival of the fourth generation will serve only to exacerbate the situation.

“LTE is going to make this problem far more pronounced, for a number of reasons,” he says. “As soon as you offer improved wireless broadband, you open the door to new applications and services. People are always able to come up with new ways of inundating any resource, including bandwidth. We’re going to see more data-driven applications on mobile than we see on the typical desktop, because the mobile device is always with you.” And while LTE promises greater spectral efficiency than its 3G forebears, Polychronopoulos says, the fact that spectrum remains a finite resource will prove ever more problematic as services evolve.

“We’re reaching the limits of spectral efficiency,” he says. “Shannon’s Law defines the limit as six bits per Hertz, and while we may be moving to higher-bandwidth wireless broadband, spectrum remains finite. To offer 160Mbps, you have to allocate twice the amount of spectrum than in 3G, and it’s a very scarce and very expensive resource.”

Operators have been wrong to focus exclusively on standards-based solutions to network optimisation issues, Polychronopoulos says. In restricting themselves to 3GPP-based solutions, he argues that they have missed what he describes as “the internet component of wireless data.” Internet powerhouses like Google, Yahoo and Microsoft (which he dubs ‘the GYM consortium’) have established a model that he says is a great threat to the mobile operator community in that it establishes a direct consumer relationship and disregards the “pipe” (wireless broadband connection) used to maintain that relationship.

“The operators have to accelerate the way they define their models around wireless data so that they’re not only faster than the GYM consortium in terms of enabling popular applications, but smarter and more efficient as well,” he says. Dr. Polychronopoulos then makes a popular case for the carriers’ success: “The operators have information about the subscriber that no other entity in the internet environment can have; for example, they know everything the subscriber has done over the lifetime of their subscription and the location of each event. They don’t have to let this data outside of their networks, so they are very well positioned to win the race for the mobile internet.”

Three interesting 'Location Based Services' presentations

Privacy Enhancing Technologies for Mobile Services

View more presentations from Zahid Ghadialy

“Relevant Location” in aLocation Aware Wire-free Connected World

View more presentations from Zahid Ghadialy

Launching the First Location Bank: a new approach to location privacy

View more presentations from Zahid Ghadialy

These were presented in Cambridge Wireless Location Based Systems/Services SIG Event : "Who goes Where? Privacy for Location Based Services" - 23rd March 2011 at CSR, Cambridge

For more information see here.

Augmented Reality: Future Killer App?

Augmented Reality can be understood very easily with the two videos embedded below:

It may look cool and one may wonder how this can be useful practically, here is another video showing how this can be used:

So in future you may have quite a few people who can only look at you through the [phone rather than directly :)

The following is an extract from The Guardian article titled, "What is mobile augmented reality for?":

Mobile augmented reality is a relatively young technology, but it has already attracted a great deal of hype and scepticism in equal measure.

Overlaying digital information onto the real world, viewed through a cameraphone, is technically impressive, but the business models and usage patterns are still evolving.

That's a polite way of saying mobile AR is cool, but nobody really knows what it's for, or how it will make money. One of the more interesting conference sessions at this year's Mobile World Congress aimed to answer the key question: what is it for?

Tourism has been an early focus. Just this week, travel site TripAdvisor added an augmented reality feature to its iPad app (pictured above), while Lonely Planet has also used AR elements in several of its travel apps.

"You are most information-starved when you are in a completely new environment," said Jeremy Kreitler, vice-president of mobile at Lonely Planet. "Those are probably the environments where augmented reality will flourish the most."

The Layar chief executive, Raimo Van der Klein, pointed to the popularity of Twitter layers in his company's app, which allow people to see local tweets superimposed on their camera view of the world around them.

"In the future, it will be the physical world that will trigger usage," he said. "Your dynamic and changing context, as you interact with different media, products, packaging and people, and you would like to make sense of what you encounter."

Technology firm Qualcomm recently held an augmented reality contest for mobile developers, announcing three winners this week at Mobile World Congress. All three were games.

Qualcomm's vice-president of ventures, Nagraj Kashyap, took the view that games are often a good proving ground for new technologies in their early stages, with AR no different.

"It's just something that appeals to a wide cross-section of users," he said. "But to have augmented reality become mass, we need to move out of just the gaming context."

Qualcomm sees much potential in marketing, particularly when AR is used to add an interactive layer to print advertisements. Kashyap also thought educational and instructional AR content will be popular in the future. "Imagine pointing your phone at a newly bought washing machine and getting instructions for it on your phone."

However, Philipp Schloter, chief executive of developer Abukai, said that looking for individual killer apps is the wrong way to approach augmented reality.

"This is really more of an enabler that sits across many different areas," he said. He was backed up by Peter Meier, founder of Metaio, the company which makes the Junaio AR browser app. "I always see augmented reality as a new user interface technology, and less as something for which there's the killer app out there," said Meier.

"For me, this is about accessing and understanding information more easily, and enjoying information that is somehow related to the real world ... I don't think there's a killer app. This is more like the next touchscreen for mobile phones – more like the next user interface revolution."

David Marimon, who heads up mobile augmented reality and visual search for operator group Telefonica, suggested that new uses for AR will be found as different kinds of developers start to work with it, including visual and interaction designers.

He also said that Telefonica is keen to help developers find new uses for AR by providing them with technology and APIs to tap into the operator's customer data.

"We know where mobile phones are thanks to GPS and other sensors, which is a very intuitive starting point to get the context of the user," he said. "We are also working on visual recognition to acquire that context: we need to know what the user is looking at, for which we can use the camera."

In the recently concluded Mobile World Congress, there was a panel that discussed the options on Augmented Reality or AR as its better known. The slides are embedded below but only the initial slides provide some value.

Augmented Reality Panel - Mobile World Congress 2011

View more presentations from Zahid Ghadialy

I have heard of some and can can think of some more simple applications that can actually be very useful. Maybe some of them are already being developed.

1. reviews of Pubs/Clubs - If you planning to go to some Pub/club in an area you can just look at the places through your lens and immediately see the number of stars received in reviews.

2. Virtual tour guide - One of the apps Lonely Planet are working on is developing virtual tour guides that can tell you all the information about a place once in your mobile camera

3. In some countries where For Sale sign could not be put while selling houses, you can go in an area and look at the houses though your camera and it will tell you which house is for sale, which estate agent and what is the price

4. Some manufacturers have suggested that simple procedures required with gadgets like changing the toner or a printer can be done using AR apps.

5. Games is certainly and area that is going to be a major user of AR for effects and to get people excited

6. Dating apps could use AR to tell about the places where singles hangout in the real time.

7. Educational purpose.

8. CV's for Jobs - Personally, I think QR code can do the job in this case

9. AR could be used as your personal shopping assistant in the supermarket helping you do your shopping in the least amount of time - assuming you know all the things that need to be bought in advance

And many more uses of AR can be thought of and debated.

Finally, there is also a recent presentation titled "Augmented Research" embedded below:

Augmented Research

View more presentations from Face

Mobile Services Beyond Handsets

Interesting presentation by Ted Matsumoto from Softbank, Japan in Mobile World Congress 2011.

Mobile Services go beyond handsets

View more presentations from Zahid Ghadialy

Five quick videos from Mobile World Congress 2011 - 2

Facebook onto a SIM using Class 2 SMS

I am sure you have already heard of Gemalto's (worlds largest SIM manufacturer and supplier) Facebook on the SIM announcement. The advantage of this approach is that 100% of the existing phones will be able to support facebook (if the operator supports the application on the SIM). This is a big step0 forward. The press release says:

Gemalto’s software development team has embedded the software application into the SIM. This ensures the Facebook application is compatible with 100% of SIM-compliant mobile phones.

The innovative solution provides mobile subscribers with simple and convenient access to core Facebook features such as friend requests, status updates, wall posts or messages. It also offers unique functions: people can sign up for this service and log in directly from the SIM application. Interactive Facebook messages pop-up on the phone’s screen so people can always share up-to-the-minute posts and events. One can also automatically search their SIM phonebook for other friends and send them requests.

Facebook for SIM is extremely easy to use and is available to everyone. No data contract or application download is needed, because the software is embedded in the SIM and it uses SMS technology. As a result, it works for prepaid as well as for pay-monthly customers. Following an initial limited free trial period, Facebook for SIM then operates on a subscription model via an unlimited pass for a given period of time.

“Facebook for SIM enables operators to leverage two of their main assets: the SMS to communicate with the web application and the SIM for application distribution to the masses,” added Philippe Vallée, Executive Vice President, Gemalto. “Over 200 million people already use Facebook on handsets and those are twice as active as non-mobile users . By providing anytime, anywhere availability to the social network, Gemalto delivers on the growing demand for mobile connectivity all over the world.”

An article on the Register had more details:

The SIM-based client isn't as pretty as its smartphone contemporaries – don't expect picture streams or sliding interfaces – but it was developed with the help of Facebook, and provides text-menu-based interaction with Facebook – including status updates, pokes and friend requests – to any GSM-compatible handset through the magic of the GSM SIM Toolkit and Class 2 SMS messages.

The SIM Toolkit is part of the GSM standard and thus supported on just about every GSM handset, from the dumbest PAYG talker to the latest iGear. It allows the SIM to present menu options to the user, collect responses, and pop up alerts when new data arrives, which is all that's necessary for a basic Facebook client.

Modern handsets also allow the SIM to make TCP/IP data connections, but Gemalto is eschewing that for Class 2 SMS to ensure compatibility with the most basic handsets, and networks.

Class 2 SMS messages are delivered direct to the SIM without the user being involved, so can update friends' status messages and deliver a poke or two. The application running on the SIM then prods the handset into alerting the user.

That user's own updates are sent over SMS too, following a status change or wall posting client pastes that into an SMS, which is sent silently on its way.

How, or if, the network operator charges for all those messages flying about isn't clear. Gemalto won't name operators yet but claims to be talking to one operator who reckons that Facebook is eating half its bandwidth, and another who's already working on SIM distribution strategies.

Not that a new SIM is necessarily required – SIMs are field upgradable, though few operators deploy them with sufficient empty space for an application like this and issuing replacement SIMs is probably easier from a marketing point of view.

You can also find some of these details here.

As I have been working on SMS for the last few weeks, I decided to dig a bit deep into what these Class 2 SMS are.

Classes identify the message's importance as well as the location where it should be stored. There are 4 message classes.

Class 0: Indicates that this message is to be displayed on the MS immediately and a message delivery report is to be sent back to the SC. The message does not have to be saved in the MS or on the SIM card (unless selected to do so by the mobile user).

Class 1: Indicates that this message is to be stored in the MS memory or the SIM card (depending on memory availability).

Class 2: This message class is Phase 2 specific and carries SIM card data. The SIM card data must be successfully transferred prior to sending acknowledgement to the SC. An error message will be sent to the SC if this transmission is not possible.

Class 3: Indicates that this message will be forwarded from the receiving entity to an external device. The delivery acknowledgement will be sent to the SC regardless of whether or not the message was forwarded to the external device.

You can also read this for more details on SMS message contents

Non-Voice Emergency Services (NOVES)

Its been a while we talked about SMS for Emergency purposes and eCall. A new study item in 3GPP has looked at non-voice alternatives for Emergency purposes.

Picture Source: Dailymail

The following is from the recent 4G Americas report entitled: 4G Mobile Broadband Evolution: 3GPP Release-10 and Beyond:

Non-verbal communications such as text messaging and instant messaging via wireless devices has been very successful and continues to expand. Many of the consumers assume that they can utilize these types of non-verbal communications as mechanisms to communicate with emergency services whenever emergency assistance is required. Such mechanisms currently do not exist. The Emergency Services community has a desire to have multimedia emergency services supported with the same general characteristics as emergency voice calls.

Currently, service requirements for emergency calls (with or without the IP Multimedia Core Network) are limited to voice media. The Non-Voice Emergency Services (NOVES) is intended to be an end-to-end citizen to authority communications. NOVES could support the following examples of non-verbal communications to an emergency services network:

1. Text messages from citizen to emergency services

2. Session-based and session-less instant messaging type sessions with emergency services

3. Multimedia (e.g., pictures, video clips) transfer to emergency services either during or after other communications with emergency services.

4. Real-time video session with emergency services

In addition, to support the general public, this capability would facilitate emergency communications to emergency services by individuals with special needs (e.g., hearing impaired citizens).

The objectives of this study include the following questions for NOVES with media other than or in addition to voice:

1. What are the requirements for NOVES?

2. What are the security, reliability, and priority handling requirements for NOVES?

3. How is the appropriate recipient emergency services system (e.g., PSAP) determined?

4. What are the implications due to roaming?

5. Are there any implications to hand over between access networks?

6. Are there any implications due to the subscriber crossing a PSAP boundary during NOVES communications (e.g., subsequent text messages should go to the same PSAP)?

7. Do multiple communication streams (e.g., voice, text, video emergency services) need to be associated together?

8. What types of “call-back” capabilities are required?

9. What are the load impacts of NOVES in the case of a large scale emergency event or malicious use?

NOVES will be applicable to GPRS (GERAN, UTRAN) and to EPS (GERAN, UTRAN, E-UTRAN and non-3GPP). The content may be transmitted between the subscribers and the emergency services which might bring new security issues. Therefore, the security impacts need to be studied.

You can spend your weekend reading the 3GPP Study Item TR 22.871: Study on Non-Voice Emergency Services (Release 11).

A word of caution, the name NOVES may be changed in future as Emergency agencies in Europe have an objection to the name. See here and here.

Smarter Cars of the Future

We all know that cars are getting smarter. Back in Oct., Google unveiled the cars that can drive by themselves. I am sure they will make our life much better and we will be able to catch on the sleep at early morning commute.

Then there were quite a few futuristic cars at the CES 2011 last month. One such video is embedded below.

The following is a summary from the an IEEE article:

Cars have been getting smarter for years, studded with suites of sensors and supporting electronics aimed at keeping them from crashing. But entertainment and convenience have rapidly caught up to safety as the impetus for new in-car electronics development. Because automakers typically spend three years developing and producing new cars—and new gadget candy to go with them—they’ve found themselves constantly playing catch-up with consumer electronics and consumer expectations. So car companies have teamed up with the makers of smartphone software platforms to integrate a spectacular array of apps designed for handsets with cars’ digital dashboards, center consoles, and speaker systems.

Take for instance Ford’s new Focus all-electric vehicle, which made a big splash at the 2011 International Consumer Electronics Show in Las Vegas last month. It features a software application called MyFord Mobile.

The app, which runs on Ford’s proprietary Sync platform and is compatible with the BlackBerry, iPhone, and Android devices, links the car with the driver’s smartphone and home computer. The software lets the driver listen to a smartphone’s music library and lets passengers watch movies or TV shows. It delivers information such as when electricity prices are at their lowest (to allow for the cheapest battery recharging) and where the nearest charging stations are. And it allows a smartphone to function as a remote control, by means of a connection to cloud-based servers. This remote communication lets the handset keep tabs on the car’s location and the batteries’ state of charge. It will also let the driver start the Focus EV from indoors on a blustery January morning, then step into a car whose seats and steering wheel are already warm. The MyFord Mobile app lets the driver remotely start the car, turn on the heater or air conditioner, or unlock the doors from anywhere in the world (including beneath the bedcovers).

And because the system differentiates one driver’s key from another’s, it presents information on the reconfigurable 4-inch screens on either side of the speedometer in the current driver’s preferred color and style. The state of charge, for example, could be shown as a percentage of the full charge, as an estimate of the remaining miles before recharging, or as a simple bar that gets shorter as the batteries’ energy is consumed. This differentiation also works for utility and entertainment options; it automatically queues up driver A’s list of radio station presets, favorite mobile apps, and preferred display options for the 8-inch center console touch screen. Because MyFord Mobile links the Focus to the driver’s handset, it can also access his or her contact list for hands-free calling and read out e-mails and texts through the car’s speakers.

Ford is trying to position itself as a technological leader in the automotive industry with MyFord Mobile and Sync AppLink Voice Control, which puts the driver in control of all the Sync system’s capabilities via voice commands, but it has stiff competition from the likes of Mercedes-Benz, Continental, and Toyota. Launched by Mercedes-Benz in November 2009, the Mbrace system, designed and engineered by Hughes Telematics of Atlanta, was the first telematics service on the market to give smartphones the power to remotely lock, unlock, or locate a car. It didn’t signal a revolution in the way the average driver interacts with his or her vehicle because when the German luxury vehicle maker offers a new technology or set of features, there is usually a multiyear wait for them to trickle down to cars whose sticker prices aren’t stratospheric.

The second generation of Mbrace debuted last September. It introduced Mercedes-Benz Concierge, which not only opens the car to information from the outside but also makes some car-based information and entertainment options portable. The Mbrace Mobile Application 2.0 gives iPhone and Blackberry users single-phone-number access to recommendations for nearby entertainment and restaurant options, directions, traffic updates, and more, whether the person is in the car or not. The concierge then sends destination information to the smartphone or directly to the in-vehicle navigation system. With the Mbrace system’s latest wrinkle, the Drive2Friend service, the driver can dictate a friend’s mobile number and the app sends a text message reporting that the driver is trying to find the person. The friend has the option of allowing his or her location to be sent back to the car via cellular triangulation.

While Ford was showing off its wares at CES, Continental was also there showcasing the Android-based AutoLinQ system, which lets the driver connect to the car in three ways.

AutoLinQ’s Mobile View lets you to send text messages to your car; the smart vehicle can text you back with information such as its location. In this demo [Flash video], a smartphone user is shown making a remote inquiry about the status of his car. Mobile View reports that the sunroof is open and offers the option to close it or ignore the warning. When he taps Close on the handset’s touch screen, the sunroof’s glass panel glides shut. This type of call-and-response vehicle update also tells whether doors are closed and locked and whether the headlights or interior lights are on. Mobile View doesn’t wait for a query to alert the driver when the alarm is triggered, the battery is depleted, the air bag has been activated, or the internal temperature of the car is too high or low. And like MyFord Mobile, it turns the smartphone into a remote control for locking and unlocking the doors, starting the engine, flashing the lights, and more.

AutoLinQ’s Home View lets you download apps and configure vehicle settings from your home computer. Clickable tabs at the bottom of the Home View screen let the car owner move through screens showing a wealth of data on the car’s status, driver preferences, navigation information, and applications that can be downloaded or fine-tuned. The status menu tells whether the ignition is on and displays the fuel and motor oil levels, the pressure for each of the four tires, and much, much more.

Car View, in AutoLinQ, is for updating features from the driver’s seat. Car View provides the same information as Home View but lets the driver use the center console touch screen to download apps on the fly that provide better control of the car and the ability to remotely manipulate electronic devices back home. An app that sends an alert when a game or match in the driver’s favorite sport is about to appear on television also gives the option to activate a digital video recorder at home, pull up a Web site featuring periodic updates about the game, or listen to play-by-play on the radio.

Continental is also designing unique apps that will enhance vehicle performance. For instance, the Filling Assistant will detect underinflated tires and notify the driver. When the driver goes to inflate the tires, the Filling Assistant will report pressure information to the driver’s smartphone and honk the car’s horn or flash its lights to indicate when a tire has enough air.

Not to be left out, Toyota, the world’s leading automaker, debuted the QNX-based Entune at CES 2011. Entune is an upgradable suite of entertainment, navigation, and information functions. "Consumers have grown accustomed to having the world at their fingertips through their mobile phones," says Jon Bucci, vice president of Toyota’s advanced technology department, who notes that putting them in the car is a natural evolution.

After downloading the Toyota Entune app to a handset and syncing it with the Toyota vehicle, the driver can begin accessing content and services, including Bing for Web navigation and OpenTable, which can make reservations at any one of 15 000 restaurants, with directions sent seamlessly to the navigation system and information appearing on the center console. Entune also lets a driver get customizable real-time traffic updates, sports, weather, stocks, and information on prices at local fueling stations. The system doesn’t forget music, which has almost always been a part of the driving experience. Entune includes Iheartradio, which delivers roughly 750 local radio stations at the touch of a button.

The tide of apps extending handset capabilities to cars will only continue to rise. ABI Research, in Oyster Bay, N.Y., reports that the number of users of automotive apps will increase from 1.4 million in 2010 to more than 28 million by 2015. And according to Global Industry Analysts, the vehicle telematics market is expected to reach US $11.2 billion by 2015.

You can read the complete article here.

In other news, Robots in future will have their own Internet and content like Wikipedia, etc. Does anyone else remember 'The Terminator'?

Making small purchases simpler with Ericsson IPX

Yesterday a colleague made me aware of this Ericsson's IPX SMS based payment system that looks like a competitor to the NFC technology and doesn't involve any additional chip/hardware. Here is a video:

From Ericsson's website:

Ericsson Internet Payment Exchange (IPX) is a leading mobile aggregator, providing delivery and billing services, via SMS, MMS, web and online mobile billing, to more than 2 billion mobile subscribers across 26 countries. Ericsson IPX also brokers location information in selected countries and Ericsson IPX Messaging provides reach to 96% of all mobile subscribers worldwide with SMS. Ericsson IPX customers are companies who offer digital content, mobile voting & directory information and enterprises offering mobile marketing, communities and banking.

Now, we all love SMS and we have to admit that its the simplest of technology and even the most primitive phone nowadays support it but there could be scenarios when this can be a bit of a problem:

1. SMS can sometimes be delayed if a particular cell is overloaded, etc. So how long do we have to stand in front of the machine?

2. If say for 2-3 mins we do not receive an indication that the machine has a cash, do we send another SMS to cancel the transaction?

3. If we have a problem, do we have a support number to call to? How much will that cost?

4. If there is a queue of people and someone else wants to purchase something as well, does the next person has to wait till the person before has received the item?

5. If two people have sent an SMS, how do they know whose cash is in the machine now? Do we start putting a Pin as well ?

I agree, this technology could be really useful if you have run out of cash (even if you have NFC chip) and you need to purchase something small.

The other obvious advantage is that you can target advertisement at regular users who are at a particular place at a particular time to make them buy something. Also you can get statistics like what time people tend to purchase, what do they purchase, where, etc.

Anyway, hard for me to see this take off big time.

10 business models that rocked 2010

Very interesting read!

10 business models that rocked 2010 - by @nickdemey (boardofinnovation.com)

View more presentations from Board of Innovation (BOI).

Dilbert Humour: Face Recognition Apps

Source: http://www.dilbert.com/fast/2010-12-17/

HTML5 for Mobile Devices

I had been recently talking to some developers about the programming and App development on mobiles and quite a few people are of the opinion that HTML5 may help the mobile Apps go to the next level.

The biggest problem HTML5 is supposed to solve is write once run anywhere applicatons. Most of the programs will have the same look and feel if they are run on a PC or mobile and between different devices.

Ofcourse not everything is perfect. There are yet many API's that need to be implemented in for HTML5 like the 3D and Mic API's, etc. Another problem is that a lot of phones are not yet supporting HTML5 and some of them that are supporting, not supporting it completely. This will have to be solved asap.

The following is a recent presentation from Ericsson on HTML5 that gives a good idea on why it is a good idea.

HTML5 impact on application programming

View more presentations from Ericsson Labs.

Another interesting place to look for some HTML5 stuff is Patrick Chanezon's html5 Bookmarks

Phone(y) Detectives!

Too many Apps are being developed that will turn people into ametuer detectives.

A new mobile application called Recognizr can identify a person’s face via your phone camera and deliver not only profile information about that person but also show you their latest status updates.

Swedish computer vision specialists Polar Rose combined forces with interface designers TAT (The Astonishing Tribe) to create the Recognizr as a prototype application for Android phones to show off Polar Rose’s mobile face recognition library. Polar Rose’s software recognizes individuals, while TAT’s interface uses augmented reality to show profile information from sites like Facebook, YouTube and LinkedIn and the latest status updates from the recognized person.

Recognizr uses FaceLib, a mobile face recognition library from Polar Rose, which is available for Android and iPhone. FaceLib can recognize faces in photo or video but, in common with other facial recognition products, is more accurate for photos. Recognizr also uses Polar Rose’s server-side solution FaceCloud because you can’t store profiles of all potential matches in the phone — although recognizing people who are already in the phone’s address book can be handled locally on the device.

In a presentation at the Hot Chips conference at Stanford University, David Petrou, a project lead of Google Goggles, described the future of Goggles.

Google Goggles, as Petrou reminded the audience, includes the ability for the mobile Android application to take a picture of the object ad send it back to Google's cloud services. Petrou demonstrated the app with a picture of a beer can with an Android smart phone, which identified the can as a can of Boddington's. A results page showed an icon of the result, with some results from the Web. He also showed a videocassette of the movie Breakin', and Goggles identified it correctly.

The basic design principle of Goggles, Petrou said, was that it has to be universal: queries can't be processed within a single finite context, such as a bottle of wine. Petrou showed off a book that contained an image of a manual transmission linkage: Goggle returned both a link to the book on a shopping site, but also linked to a search on manual transmissions.

Goggles returns a specific result about a third of the time, Petrou said, and the internal CONGAS recognition engine matches images to aa database of about 150,000 landmarks by finding "interest points" within an image. New photos compared to the database can be correctly identified about 50 to 60 percent of the time, with a false positive rate of about one in 10,000, he said.

Goggles' strong suits? Packaged goods, such as movies. But with generic objects, such as an image of a red car, Goggles still struggles.

Goggles can also work with bar codes. A recent addition has been the inclusion of machine translation, which can recognize text and translate it on the fly.

Unfortunately, Goggles has to work as a client application, as Google needs as much of a fine-grained control of the camera as possible, such as the white balance.

Petrou said that Google was considering opening up Goggles to third-party applications, so that a stamp collector could upload an image of a stamp with annotation describing what it is. An open API may also be released, so that a picture could be taken of a foreign currency, and an app could be opened to automatically convert that bill's value into dollars.

Google also plans to fuse the camera with Goggles, so that augmented reality may be the future of visual search, Petrou said. "We'll use it where it's the right user interface," he said.

Goggles does have the capability to recognize faces, although that functionality hasn't been implemented in the app as yet. That might change as more and more people begin uploading data to the Web: if 17 different images of your face appeared on the Web, a picture take of you with Google Goggles would rank "you" in the top ten results about half the time. If there were 50 results, your face would be ranked in the top 5 results abour half the time, he said

Facial Recognition along with Geo-tagging is also available in Picasa web albums. You can already find who is connected to someone in facebook when you search for the people. Once all these information would start working together then you can identify the person where they have been on holidays (based on Geo-tagging of photos) and when they have gone there. Who else in their friends/family had gone with them, etc.

In fact FBI/CIA/MI5 may make their own app to "report potential terrorists" where if you see any suspicious person you can open one of their apps and click the photo of some person and the secret service will quickly check if this person is potentially a problem.

Of course we are not discussing the privacy concerns yet but looks like Scary future to me.

Mobile Payments to be mainstream in 2011

With some much talk (and hype) surrounding NFC and Mobile payments, it looks quite possible that m-payments will enter mainstream in the Western world in the forthcoming year. Though mobile payments have become norm in developing countries like Kenya, Senegal and India, its yet to catch on in UK and the USA.

Here are some interesting facts from MobileBeyond:

• The mobile transaction market is so huge it offers room for multiple players. Yearly worldwide electronic transactions total $7-$10 TRILLION
• Competitors are generally local to each country or region leaving plenty of open territory for mobile payment service and technology companies. Companies that win in their markets will be those that understand customer needs.
• PayPal in the U.S., which has traditionally catered to merchant accounts, most likely will adopt a similar mobile strategy. (Both Obopay and PayPal are service providers–not technology companies like Fundamo in South Africa that provides software solutions for service companies.)
• “The competition is cash”–not the other players in this market space
• In five to ten years, mobile payments will achieve high adoption among consumers in developing and developed countries.
• Brazil, Russia, China and Mexico offer growth opportunities for players that understand these markets
• According to Portio Research, by 2011 mobile commerce payments are estimated to climb to $86.6 billion
• Nielsen predicts 27% of all U.S. payments by 2012 will still be cash

To get an idea, there are already multiple m-payments providers in Kenya. Leaving out the gians like Google and Paypal, there are other local providers like M-pesa, Pay-Zunguka, Pesapal and Zynde.

The following are the developments in UK from Computer weekly:

Some forms of mobile payments already exist. Phone applications like PayPal Mobile support person-to-person (P2P) payments. SMS-based transactions are used for car parking tickets and mobile commerce allows online shopping through mobile phone browsers.

Contactless cards are also in circulation for credit cards, transport tickets and are used in some food stores. The industry is looking next at near-field communication (NFC) mobile handsets. NFC allows 'tap-and-go' style payments using mobile phones at in-store terminals by incorporating contactless card technology into handsets. Alternatively, micro-SD cards with NFC-enabled chips can be inserted into mobile phones.

The Global System for Mobile Association (GSMA) has launched a Pay-Buy-Mobile project to enable consumers to pay for goods and services via their mobile phones. "By storing a consumer's credit or debit card within the SIM card and employing NFC technology, the mobile phone can be passed near a contactless Point Of Sale (POS) terminal to complete transactions," said Nav Bains, GSMA's senior director of mobile money.

GSMA has been collaborating with standardisation bodies; the European Payments Council, EMVCo, which manages card specifications and smartcard infrastructure standards body, Global Platform. The consortium is developing the Trusted Service Manager requirements document and a certification process to accelerate the commercialisation of mobile NFC services. But some experts believe NFC is a long way from a mass market roll-out in the UK.

The biggest breakthrough in the mobile payment market have been in developing countries, providing bank services via mobile phones for people who have traditionally not had bank accounts. Visa Europe recently launched Europe's first micro-SD based mobile payment systems in Turkey. But it is unclear when such a system will be introduced in the UK. says Juniper Research senior analyst, Howard Wilcox.

The number of contactless terminals in the UK is approximately 26,500 and the UK Card Association predict 14 million contactless cards will have been issued with contactless functionality by the end of 2010. "We're not expecting to give a launch date any time soon," continues Swain. "Globally, there's a lot of discussion but the UK is one of the only areas where we already have the infrastructure that would accept contactless mobile payments," he adds.
UK-based mobile banking firm, Monitise, has also recently launched a joint venture with Visa in India to accelerate the delivery of mobile financial services such as banking, bill payments, mass transit ticketing and mobile top-up to Indian customers. More than infrastructure, Monitise group strategy director, Richard Johnson, believes banks and mobile network operators need to work together. "Banks are where most people keep their money. It's about mobilising bank accounts rather than creating new accounts with network operators. Tap-and-go really requires collaboration," he says.

Industry expert consortium, Mobey Forum, hopes to bring banks, mobile network operators, acquirers and merchants together to build the relationships needed to progress the mobile payments industry.

Gerhard Romen, Mobey Forum marketing chair and director of mobile financial services at Nokia, believes the NFC trials have proved the consumer demand and, by 2011, all of Nokia's new smartphones will be NFC-enabled. "Once people work together, it'll provide simplicity for the user" he says. "A phone with NFC can do more than just behave like a card - it has a display, keyboard and internet connection - and becomes more interactive," he adds.

Today we have credit, debit and, perhaps, contactless cards. Tomorrow banks and mobile network operators hope to provide a mobile wallet. The next step will be introducing tap-and-go into the mainstream market and, despite slow progress, industry experts are increasingly certain it will happen "soon".

From eWeek:

Google and Apple are both making moves to ensure smooth financial transactions on their mobile platforms.

Last week news bubbled up that Google and PayPal were brokering a deal to let the search engine use the e-commerce service as a payment option for applications purchased through Google's Android Market.

Apple, meanwhile, hired an expert in near field communication (NFC) technology as its new product manager for mobile commerce and has published a number of NFC-related patents in recent months.

Google's e-commerce infrastructure is poor compared with that of Apple. Users may only purchase applications for their Android smartphones from the Android Market in 13 countries.

By way of comparison, consumers may purchase apps from iPhone's App Store in 90 countries all over the world. PayPal would be a welcome addition to Google Checkout and credit cards as payment options in the Android Market.

Gartner has said the market for mobile apps will be $6.2 billion this year, making it an obvious sector for Google and Apple to attack with gusto.

From San Fansisco Chronicle:

Bay Area businesses like Bling Nation and eBay Inc.'s PayPal division are rolling out products that allow people to hand over money to stores, restaurants, coffee shops or friends with the tap of a mobile device. No credit cards, checks or cash are necessary.

Meanwhile, reports suggest that other major companies, including Apple Inc., AT&T Inc. and Verizon Wireless are planning or negotiating to provide similar services.

"What I see is all these distinct initiatives coming together and merging at some point in the not-too-distant future," said Aaron McPherson, practice director at IDC Financial Insights. "All together, they add up to significant change."

Bling Nation, a Palo Alto startup founded in 2007, is among the furthest along in this emerging field, with more than 1,000 retailers nationwide accepting its payment system. The company provides so-called Bling tags, or small stickers, that affix to the back of a mobile phone and transmit data using a wireless standard known as Near Field Communication.

When users tap the tag on a proprietary reader at participating retailers, it pulls money from their PayPal account. For security, users have to enter a personal identification number for purchases over a certain amount, or when transactions occur at an unusual frequency or location.

Merchants pay for or rent the reader and are charged 1.5 percent of the total of every transaction, which is well below the average transaction rate for accepting credit cards. The additional advantage for merchants is that they can analyze customer data in a more fine-grained manner than is permitted through the credit card system. This allows them, for instance, to target sales offers to regular customers or those who haven't been into the shop in a while.

"They enjoy cheaper fees and analytics that can help them issue coupons and make more money," said co-founder Meyer Malka, adding that the advantages are turning businesses into proselytizers on Bling's behalf.

A little more than a month ago, the company began an aggressive push in partnership with PayPal to expand its footprint in downtown Palo Alto. It included giving away thousands of tags preloaded with $20 in credit to customers. There are now more than 50 retailers in the city accepting the payments.

As I mentioned last week, with heavyweights like Nokia, Apple and Google all coming closer to NFC and M-Payments, it should be a winning formula for the end consumers. We will possibly see more use of m-payments in the developed world. Lets not mention about security just yet.