Feedback can be useful. Without it, your virtual motorbike can come off the road, and youll never know. With a good actuator, however, you can tell when you hit the lamppost, because it hurts.
Welcome to the world of haptics, the new thing in feedback technology—and mobile phones.
“There are three or four different types of actuators,” said John Grundy, vice president of Mobility for Immersion Corp.
“Theres the old Eccentric Rotating Mass, or ERM, which is basically a long axle with a weight—the sort of thing you have in neck massage machines. But thats old hat, and so are Coin Motors, which is really the same thing but packed flat, a short rotating motor with the mass around the outside.
“What were using today, is a magnetic actuator; we call that Linear Resonant Actuator, where the mass floats between two magnets and you feel the force as the magnets pull it around.”
And some time in the future, well have new technology, MFA (multi-function actuator), where you put weights onto the loudspeaker cone, Grundy said.
Grundy is a couple of weeks away from launching the first haptic phone into Europe. Haptics are the science of touch, and here are some of his dreams about what haptics can do for a phone.
First, games. Boring, but it works on games consoles like the X Box; if you hit your opponent with the flaming sword, you feel the jolt up your arm; if you drive your car off the road, you feel the grumble of the gravel under the wheels. Console gamers love it.
I wouldnt know; Im a PC gamer, and use a mouse. I did once try out a Logitech haptic mouse, with force feedback, and it was … well, weird.
Second, etiquette. Of course you turn your phone ring tone off when you go to a movie theater, but wouldnt you like to know whos calling anyway? “You can actually get the vibration pattern to change to match the special ring tone you have for special callers,” Grundy said.
“The average young phone user has five ring tones, set to tell them who is on the line. We can set the actuator to imitate the ring tones, so if its your spouse on the phone you can go to the bother of leaving the hotel room before answering, without anybody knowing it even rang; if its your boss, you simply ignore it.”
Can you really recognise a tune by touch?
“Yes, really. Id say that you should be able to distinguish between seven to ten ring tones just by feel, with very little training. And not just ring tones, either. Theres a lot of things that happen on a phone which we can signal to you.”
Hes thinking about dropped calls, here, and I get it at once: “Youre on the train in London or New York, and chatting away, and suddenly realise that for some time, youve been talking to yourself, because the call dropped when you went under a big bridge. We can tell the call is gone if we look at the display—but thats generally far too late. So what if we could trigger a haptic alert, which says: hes gone… as soon as the line goes down? That would be helpful!”
And in the future, he reckons, haptics could be used for text messages, too. “I reckon we can do touch-emoticons. I havent studied any detailed research on this, but if you think about it, normal SMS messages have emoticons which you have to have explained to you at first.
“You wont get a smiley unless someone tells you how to view it—and its like a secret language, these days, with dozens. We think we can get ten, twelve, maybe more emoticons so that when a text comes in, you can tell if its someone whos pleased, or angry, before you open it up.”
Helpful? Maybe less so, but you can see the idea catching on. What might be more exciting, perhaps, is a user interface feedback.
Suppose you have to place a call by feel, not being able to take your eyes off the road? “You probably have five frequently called numbers in your dialling list. If you could scroll down and tell from the feel of the vibration whether it was one of these, that would be a start.”
I tried to interest him in phone-gum. I reckon the tongue is far more sensitive than the fingertips, and so I suggested an actuator that you wrap in rubber, and chew. You might even be able to understand someones voice…?
“Its all a question of fidelity,” Grundy said. “If you compare the various senses, like sound and vision and touch, youll see that the first displays were simply monochrome, then we had 8-bit colour, then 16-bit, then true colour. With sound, we started off with simple beeps—square waves to a speaker—and then we went on to polyphonics, then stereo, then full Dolby surround. At the moment, haptics are just coming out of simple square wave vibrations.”
Haptics in the Gaming
But of course, its the gaming industry that is most interested, and where people have the money.
Grundy is an ex-Nokia exec, so I didnt have to explain the economics of phone downloads to him, and we didnt have to indulge in the list of caveats about whether games on mobile phones are a sensible way for a mobile operator to go.
I think regular readers of this column will know that Im a big download skeptic, regarding the costs of provisioning data as being inherently unmanageable in a voice-oriented network, untrackable by a voice-oriented billing system, and impossible to justify in a bandwidth-limited wireless environment.
However, whether its a long-term business or not, games are taking up budget. “I cant recall the exact figures, but I think youll find its over a billion dollars a year, the phone game market,” Grundy said. So, money is changing hands, and games writers want to make an impact, and theyre seeing haptic phones as a way of getting an edge.
He showed me two phones, both by Samsung, with Immersions “VibeTonz force feedback effects” loaded.
In the United States, Verizon Wireless has bought the n330 phone for the Get It Now service, and you can play a game called 2Fast2Furious (from I-play) on it.
The language is all about total immersion, “with all your senses acting together to create a picture in your mind, a visual sense with graphics, sound to hear the engine, and the haptics to make it seem real,” a pleased Grundy said.
I think you have to be able to play phone games to “get it” on this one. I tried the phone, and yes, I could tell it was vibrating, and my instinct was to throw it on the floor of the coffee room where we were sitting, as if Id accidentally picked up a wasp. But gamers are used to this.
It is the case that profoundly deaf people can “hear” music through haptics. Helen Keller was famously fond of dancing in time with music, which she felt, with her hand on a radio cabinet; Evelyn Glennie, famous for being the first full-time solo percussionist in classical music, is actually profoundly deaf. I dont expect the rest of us to be able to fine-tune our sense of touch to that extent, but I can see why Grundy is optimistic that we can learn to use our haptic inputs in a rather more sophisticated way than we do today.
At the end of my day, of course, Im only interested in the wireless side of this. Grundy and Immersion will, if you cant find a way of stopping them, anyway, talk for hours about the console game and the future of portable versions. For me, its phones that matter.
I could embarrass them badly by asking why, if portable consoles are so important, Microsoft isnt showing the slightest sign of following Nintendo or Sony into the hand-held market, or of trying to put Xbox games onto Windows Mobile.
But instead, I decided to limit my wet blanket responses to the observation that until the mobile phone industry actually finds a way of making more money out of games, its academic.
Contributing columnist Guy Kewney has been irritating the complacent in high tech since 1974. Previously with PC Mag UK and ZDNet UK, Guy helped found InfoWorld, Personal Computer World, MicroScope, PC Dealer, AFAICS Research and NewsWireless. And he only commits one blog—forgiveable, surely? He can be reached at [email protected]
Check out eWEEK.coms for the latest news, reviews and analysis on mobile and wireless computing.