The touchscreens which we use at supermarkets and ATMs were accidentally invented by a group of atomic physicists back in 1970. The conception of touchscreens can be traced back to the 1940s, even before science fiction writers warmed up to the innovation. Today, the use of touchscreens is only bounded by the creativity of users. You can pinch, zoom, type and move the world literally with your fingers. However, a typical user might have had the experience of typos, unwanted clicks and many other mishits, which couldn’t be undone. So, what if the touchscreens are made smart enough to understand the touch better?
The researchers at Google used state-of-the-art machine learning models and designed an intelligent touchscreen for their Pixel phones.
How Touch Works
As illustrated above, when a finger interacts with a touch sensor cell, it disturbs the charge from the projected field around two electrodes. A capacitive touch sensor is a collection of electrodes arranged in rows and columns, which are separated by a dielectric.
Capacitive touch sensors don’t respond to changes in force but are tuned to be highly sensitive to changes in distance within a couple of millimetres above the display. That is, a finger contact on the display glass should saturate the sensor near its centre, but will retain a high dynamic range around the perimeter of the finger’s contact (where the finger curls up).
When the soft tissue of the finger touches the screen, it deforms and spreads out. The nature of this spread depends on the size and shape of the user’s finger, and its angle to the screen. This is also a dynamic change that occurs over some period of time, which differentiates it from contacts that have a long duration or a large area.
Beyond tapping and swiping gestures, long-pressing has been the main alternative path for interaction. For mobile to understand a long press, the user’s finger must remain stationary for 400–500 ms. This delay is not bad, but neither is it immediate, which can ruin the user experience for some. An alternative to time threshold based interaction is through force estimation. But, there are other challenges such as differentiating between soft and firm touch, which in turn requires hardware sensors.
What ML Got To Do With Touch
Sensing touch force requires dedicated hardware sensors that are expensive to design and integrate. According to Google, touch force is difficult for people to control, so most practical force-based interactions focus on discrete levels of force (e.g., soft vs. firm touch) that do not require the full capabilities of a hardware force sensor.
The differences between users (and fingers) make it difficult to encode these observations with heuristic rules. Google, therefore, designed a machine learning solution that would allow us to learn these features and their variances directly from user interaction samples.
The researchers at Google designed a neural network that combines convolutional (CNN) and recurrent (RNN) components. The CNN takes care of the spatial features, while the RNN is used for tracking temporal development and provides a consistent runtime experience.
Each frame is processed by the network as it is received from the touch sensor, and the RNN state vectors are preserved between frames (rather than processing them in batches). The network was intentionally kept simple to minimise on-device inference costs when running concurrently with other applications taking approximately 50 µs of processing per frame and less than 1 MB of memory using TensorFlow Lite.
- Models used: CNN, RNN
- Framework: TensorFlow Lite
Through this integration of machine-learning algorithms and careful interaction design, Google researchers were able to deliver a more expressive touch experience for Pixel users and plan to explore new forms of touch interaction.
The applications of touchscreens now extend far beyond your typical smartphone usage. Touchscreens are now being used in hospitals, autonomous cars and even in spacecraft. These are few of the critical scenarios where the risk is too high in case of a mishit. Having an intelligent surface that knows what we want just from sensing the force of our finger can come in quite handy as even the AutoML tools are transitioning towards touch-based drag and drop analytics.
Know more here.
Original post: https://analyticsindiamag.com/machine-learning-for-touchscreens-mobiles/
I am the co-founder of JustCBD Store label (justcbdstore.com) and I am currently trying to expand my wholesale side of company. I am hoping someone at targetdomain can help me ! I considered that the most ideal way to do this would be to connect to vape shops and cbd retailers. I was hoping if anybody at all could recommend a dependable web-site where I can get CBD Shop Database I am presently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable solution and would appreciate any advice on this. Or would it be simpler for me to scrape my own leads? Suggestions?
I’m the proprietor of JustCBD label (justcbdstore.com) and am planning to grow my wholesale side of business. I am hoping anybody at targetdomain is able to provide some guidance ! I considered that the most suitable way to do this would be to connect to vape stores and cbd retail stores. I was hoping if anybody could recommend a qualified website where I can purchase Vape Shop Business Marketing Data I am presently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the very best choice and would appreciate any advice on this. Or would it be much simpler for me to scrape my own leads? Suggestions?
May I simply say what a relief to find somebody that genuinely knows what they are talking about on the net. You actually realize how to bring a problem to light and make it important. More and more people should check this out and understand this side of your story. I was surprised you’re not more popular since you definitely have the gift.
I blog frequently and I truly appreciate your information. Your article has really peaked my interest. I will bookmark your site and keep checking for new details about once a week. I opted in for your Feed too.
Excellent article! We will be linking to this particularly great article on our website. Keep up the great writing.
I’m amazed, I have to admit. Rarely do I encounter a blog that’s both educative and engaging, and without a doubt, you have hit the nail on the head. The issue is an issue that not enough people are speaking intelligently about. Now i’m very happy I stumbled across this in my search for something regarding this.
Greetings! Very useful advice within this article! It is the little changes which will make the most important changes. Thanks for sharing!
That is a good tip especially to those new to the blogosphere. Brief but very accurate information… Appreciate your sharing this one. A must read post!
I blog frequently and I seriously thank you for your information. This great article has really peaked my interest. I am going to book mark your website and keep checking for new information about once per week. I opted in for your RSS feed too.
Way cool! Some extremely valid points! I appreciate you writing this article and also the rest of the website is extremely good.
I must thank you for the efforts you’ve put in writing this blog. I am hoping to view the same high-grade content from you in the future as well. In truth, your creative writing abilities has motivated me to get my own, personal website now 😉
Great info. Lucky me I recently found your website by chance (stumbleupon). I have saved it for later!
Howdy! I simply want to give you a big thumbs up for the great info you’ve got right here on this post. I am returning to your website for more soon.
Hi, I do think this is a great site. I stumbledupon it 😉 I may return once again since i have book-marked it. Money and freedom is the greatest way to change, may you be rich and continue to help others.
You’re so interesting! I do not believe I’ve read through a single thing like that before. So wonderful to discover someone with a few unique thoughts on this subject matter. Seriously.. thank you for starting this up. This website is one thing that is required on the internet, someone with some originality!
I like reading through an article that can make people think. Also, thank you for allowing me to comment!
This is the perfect blog for everyone who really wants to understand this topic. You know a whole lot its almost hard to argue with you (not that I actually would want to…HaHa). You certainly put a new spin on a subject that’s been written about for decades. Excellent stuff, just excellent!
Good post. I learn something totally new and challenging on websites I stumbleupon on a daily basis. It will always be useful to read through articles from other authors and use something from other web sites.
Your style is so unique in comparison to other people I have read stuff from. I appreciate you for posting when you’ve got the opportunity, Guess I’ll just bookmark this blog.
An impressive share! I have just forwarded this onto a co-worker who has been doing a little homework on this. And he actually bought me dinner due to the fact that I stumbled upon it for him… lol. So let me reword this…. Thanks for the meal!! But yeah, thanx for spending the time to discuss this subject here on your site.
Your style is unique compared to other folks I have read stuff from. Many thanks for posting when you’ve got the opportunity, Guess I’ll just bookmark this blog.
Very good article! We are linking to this great article on our website. Keep up the great writing.
An impressive share! I have just forwarded this onto a colleague who has been conducting a little homework on this. And he in fact bought me breakfast due to the fact that I found it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending the time to talk about this topic here on your web page.
I’m more than happy to discover this website. I want to to thank you for your time for this fantastic read!! I definitely really liked every bit of it and I have you saved as a favorite to see new information on your web site.
Way cool! Some extremely valid points! I appreciate you penning this post and the rest of the website is also really good.
I like reading a post that can make people think. Also, thank you for permitting me to comment!
Hello there! This blog post couldn’t be written much better! Looking through this post reminds me of my previous roommate! He continually kept talking about this. I am going to send this post to him. Fairly certain he’s going to have a very good read. Thank you for sharing!
I was able to find good information from your blog posts.
It’s nearly impossible to find educated people for this topic, however, you sound like you know what you’re talking about! Thanks
I would like to thank you for the efforts you’ve put in penning this blog. I’m hoping to see the same high-grade blog posts by you later on as well. In truth, your creative writing abilities has encouraged me to get my own site now 😉
Good article. I am facing some of these issues as well..
You’re so cool! I don’t suppose I have read through anything like this before. So wonderful to find another person with genuine thoughts on this subject matter. Seriously.. thank you for starting this up. This website is something that is needed on the internet, someone with a little originality!
After going over a handful of the blog posts on your website, I truly appreciate your technique of blogging. I book-marked it to my bookmark site list and will be checking back in the near future. Take a look at my website too and let me know how you feel.
This website was… how do I say it? Relevant!! Finally I have found something which helped me. Thanks!
Hi, I do think this is an excellent web site. I stumbledupon it 😉 I am going to return once again since i have saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to guide others.
Spot on with this write-up, I truly think this website needs a lot more attention. I’ll probably be returning to read through more, thanks for the information!
I couldn’t resist commenting. Perfectly written!
That is a great tip particularly to those fresh to the blogosphere. Brief but very accurate info… Thank you for sharing this one. A must read article!
Hi there! This article couldn’t be written much better! Looking through this article reminds me of my previous roommate! He constantly kept preaching about this. I’ll send this information to him. Pretty sure he will have a good read. I appreciate you for sharing!
Way cool! Some extremely valid points! I appreciate you penning this write-up and the rest of the website is also really good.
Hi! I simply would like to offer you a huge thumbs up for your great information you have got here on this post. I’ll be coming back to your web site for more soon.
I must thank you for the efforts you’ve put in penning this site. I really hope to see the same high-grade blog posts from you in the future as well. In fact, your creative writing abilities has motivated me to get my very own blog now 😉
I blog often and I seriously appreciate your information. This article has truly peaked my interest. I’m going to bookmark your site and keep checking for new information about once a week. I subscribed to your Feed too.
I love it when folks get together and share thoughts. Great website, continue the good work!
You have made some really good points there. I looked on the web to find out more about the issue and found most individuals will go along with your views on this website.
I was very happy to uncover this web site. I need to to thank you for your time for this wonderful read!! I definitely liked every part of it and i also have you saved as a favorite to check out new stuff in your site.
This website was… how do you say it? Relevant!! Finally I’ve found something that helped me. Appreciate it!
Very good article! We will be linking to this particularly great content on our site. Keep up the good writing.
You’ve made some good points there. I looked on the net for more info about the issue and found most people will go along with your views on this site.
Pretty! This has been an incredibly wonderful article. Thanks for supplying this info.
Hi would you mind letting me know which webhost you’re utilizing? I’ve loaded your blog in 3 different internet browsers and I must say this blog loads a lot faster then most. Can you suggest a good hosting provider at a reasonable price? Thank you, I appreciate it!|
May I just say what a relief to find someone who genuinely understands what they’re talking about on the net. You certainly know how to bring an issue to light and make it important. More and more people ought to look at this and understand this side of the story. I was surprised that you’re not more popular since you certainly possess the gift.
Aw, this was an incredibly good post. Spending some time and actual effort to make a really good article… but what can I say… I put things off a lot and never manage to get nearly anything done.
I used to be able to find good information from your blog posts.
Great article! We will be linking to this particularly great post on our website. Keep up the good writing.
Having read this I believed it was extremely informative. I appreciate you finding the time and effort to put this article together. I once again find myself spending a lot of time both reading and posting comments. But so what, it was still worth it!
This excellent website certainly has all the info I wanted about this subject and didn’t know who to ask.
You’re so interesting! I don’t think I’ve truly read something like this before. So good to discover another person with genuine thoughts on this subject. Seriously.. thanks for starting this up. This web site is one thing that’s needed on the web, someone with a little originality!
After exploring a number of the blog articles on your blog, I honestly like your technique of writing a blog. I bookmarked it to my bookmark webpage list and will be checking back in the near future. Please check out my web site too and tell me what you think.
This is a topic that is near to my heart… Cheers! Where are your contact details though?
You’ve made some decent points there. I checked on the web to learn more about the issue and found most individuals will go along with your views on this website.
Howdy, There’s no doubt that your site could be having browser compatibility problems. Whenever I take a look at your site in Safari, it looks fine however, if opening in IE, it’s got some overlapping issues. I merely wanted to provide you with a quick heads up! Besides that, wonderful site!
Achieving your fitness goal doesn’t need a certified personal trainer or an expensive gym membership, especially if you have the budget and the space to consider practically every workout machine in the market.
I seriously love your website.. Pleasant colors & theme. Did you create this site yourself? Please reply back as I’m wanting to create my own website and would like to learn where you got this from or exactly what the theme is called. Thank you!
This site definitely has all the information and facts I wanted concerning this subject and didn’t know who to ask.
Hello there! This post could not be written much better! Going through this article reminds me of my previous roommate! He always kept talking about this. I’ll send this post to him. Pretty sure he will have a good read. Many thanks for sharing!
I’ve read several good stuff here. Certainly value bookmarking for revisiting. I wonder how a lot attempt you set to make this kind of excellent informative site.|
Everything is very open with a clear clarification of the issues. It was definitely informative. Your site is very useful. Thank you for sharing!
I really like it whenever people come together and share opinions. Great website, keep it up!
Hi, I do believe this is a great web site. I stumbledupon it 😉 I may return once again since I bookmarked it. Money and freedom is the best way to change, may you be rich and continue to help others.
Way cool! Some very valid points! I appreciate you penning this write-up and also the rest of the site is extremely good.
You should take part in a contest for one of the highest quality blogs on the internet. I will recommend this website!
This website was… how do you say it? Relevant!! Finally I’ve found something that helped me. Kudos!
Pretty! This was an extremely wonderful article. Thanks for supplying this info.
I enjoy looking through a post that can make men and women think. Also, thank you for allowing for me to comment!
An intriguing discussion is worth comment. I think that you ought to publish more about this issue, it may not be a taboo subject but usually people do not talk about these subjects. To the next! Best wishes!!
That is a great tip especially to those fresh to the blogosphere. Brief but very precise info… Thanks for sharing this one. A must read article!
I couldn’t refrain from commenting. Perfectly written!
Good day! I simply want to give you a big thumbs up for your great information you have right here on this post. I’ll be returning to your website for more soon.
I truly appreciate this blog.Really thank you! Really Great.
I was curious if you ever thought of changing the
layout of your blog? Its very well written; I love what youve got to say.
But maybe you could a little more in the way of content so people could
connect with it better. Youve got an awful lot of text for
only having 1 or 2 images. Maybe you could space it out better?