EmotionCues: AI Knows Whether Students Are Paying Attention

Facial recognition technology was introduced in the 1960s, languished through the AI winter, and in recent years has taken off — boosted by increasingly powerful deep neural networks. Facial recognition has been applied in Face ID device unlocking functions, public security services, smart payment systems and more. During Taylor Swift’s 2018 “Reputation” tour, the American singer-songwriter’s security team utilized the tech to safeguard her from stalkers.

Now, a research team from the Hong Kong University of Science and Technology and Harbin Engineering University has adopted facial recognition technology to analyze students’ emotions in the classroom through a visual analytics system called “EmotionCues.”

MzU1MTA5NA.jpeg

Paper co-author Huamin Qu says the system “provides teachers with a quick and convenient measure of students’ engagement level in a class. Knowing whether the lectures are too hard and when students get bored can help improve teaching.”

But is it really that simple?

image.png
image.png

The proposed EmotionCues system includes a data processing phase and a visual exploration phase. The system first processes a series of raw data inputs and uses computer vision algorithms to extract emotion information using steps such as face detection, face recognition, emotion recognition and feature extraction. In phase two, the interactive visual system uses granular visual analysis of classroom videos to predict students’ emotional state and also the evolution of each student’s emotional state — i.e. is Lily losing interest?

The research team tested their EmotionCues system in the Hong Kong University of Science and Technology and at a Japanese kindergarten. Results show that EmotionCues performs better in detecting “obvious emotions” such as the sense of joy when students experience a particularly interesting or intense learning interest. The system’s ability to interpret “anger” or “sadness” however still needs improvement. Students who are actually very focused on class content may for example purse their lips in contemplation, which unfortunately the system might easily interpreted as “anger.”

HeadBand.jpg

The new study is not the first use of tech to analyze students’ emotional states. Last year, students in a primary school in Jinhua, Zhejiang wore smart headbands which measured electric signals of brain neurons and translated the collected information into an attention score. The headbands on students who were focused displayed a red light, while the less focused students’ headbands glowed blue. Student attention scores were sent to the teacher’s laptop every 10 minutes and synchronized to a WeChat group so parents could remotely monitor their child’s status at any time.

Although the aim of the project was to help students study more efficiently and help teachers improve their teaching quality, concerns were raised regarding both student privacy and system effectiveness.

The paper EmotionCues: Emotion-Oriented Visual Summarization of Classroom Videos is available on IEEE.


Author: Yuqing Li | Editor: Michael Sarazen

 

Original post: https://syncedreview.com/2020/01/16/emotioncues-ai-knows-whether-students-are-paying-attention/

64 comentários em “EmotionCues: AI Knows Whether Students Are Paying Attention

  1. excellent issues altogether, you simply won a new reader.
    What could you recommend in regards to your submit
    that you made some days ago? Any sure?

  2. Hmm it looks like your site ate my first comment (it was super long) so I guess I’ll just
    sum it up what I had written and say, I’m thoroughly enjoying your
    blog. I too am an aspiring blog writer but I’m still new to everything.
    Do you have any helpful hints for inexperienced blog writers?
    I’d definitely appreciate it.

  3. Nice blog here! Additionally your website loads up fast!

    What web host are you the usage of? Can I am getting your affiliate hyperlink for your host?
    I desire my web site loaded up as quickly as yours lol

  4. I absolutely love your site.. Very nice colors &
    theme. Did you create this amazing site yourself? Please
    reply back as I’m planning to create my own personal site and want to know where
    you got this from or exactly what the theme is called.
    Kudos!

  5. I’ve been browsing on-line greater than three hours today, but I never
    found any attention-grabbing article like yours. It’s lovely value enough for me.
    In my view, if all website owners and bloggers made excellent content as
    you did, the net will likely be much more useful than ever before.

  6. I am the owner of JustCBD Store label (justcbdstore.com) and am aiming to expand my wholesale side of business. I really hope that someone at targetdomain is able to provide some guidance . I thought that the most effective way to do this would be to reach out to vape shops and cbd retailers. I was hoping if someone could suggest a reputable web site where I can get Vape Shop Business Data I am already checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not sure which one would be the most suitable choice and would appreciate any advice on this. Or would it be much simpler for me to scrape my own leads? Ideas?

  7. I’m the owner of JustCBD label (justcbdstore.com) and am trying to develop my wholesale side of company. I am hoping anybody at targetdomain is able to provide some guidance ! I thought that the very best way to accomplish this would be to reach out to vape shops and cbd retail stores. I was really hoping if anyone could recommend a trusted web site where I can buy Vape Shop B2B Data I am currently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most ideal selection and would appreciate any guidance on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  8. Its such as you learn my mind! You appear to know so much about this, such as
    you wrote the e-book in it or something. I think that you just can do with a
    few percent to drive the message home a little bit, but other than that,
    that is magnificent blog. An excellent read. I will definitely be back.

  9. Hi there i am kavin, its my first occasion to commenting anywhere, when i read
    this post i thought i could also make comment due
    to this sensible piece of writing.

  10. What i do not realize is in fact how you’re no longer actually much more
    neatly-liked than you might be now. You’re so intelligent.
    You know thus significantly in the case of this
    matter, made me personally imagine it from so many various angles.
    Its like men and women don’t seem to be interested until it’s something
    to do with Woman gaga! Your individual stuffs outstanding.
    Always handle it up!

  11. A motivating discussion is definitely worth comment. I think that you ought to publish more about this subject matter, it may not be a taboo matter but generally people do not discuss such topics. To the next! Best wishes!!

  12. An impressive share! I’ve just forwarded this onto a co-worker who had been doing a little research on this. And he actually bought me breakfast because I discovered it for him… lol. So let me reword this…. Thanks for the meal!! But yeah, thanx for spending the time to discuss this subject here on your blog.

  13. I’m impressed, I have to admit. Seldom do I come across a blog that’s equally educative and interesting, and let me tell you, you have hit the nail on the head. The issue is something which not enough folks are speaking intelligently about. Now i’m very happy I found this during my hunt for something regarding this.

  14. Oh my goodness! Impressive article dude! Many thanks, However I am experiencing difficulties with your RSS. I don’t know the reason why I am unable to subscribe to it. Is there anyone else getting the same RSS problems? Anyone who knows the answer will you kindly respond? Thanx!!

  15. Hi there! This blog post could not be written any better! Looking through this article reminds me of my previous roommate! He continually kept talking about this. I will forward this post to him. Fairly certain he will have a great read. Thanks for sharing!

  16. Spot on with this write-up, I actually believe this amazing site needs far more attention. I’ll probably be returning to read more, thanks for the information!

  17. We are a group of volunteers and starting a new scheme in our community.
    Your web site offered us with valuable info to work on. You have done an impressive job and our whole community will be thankful to
    you.

  18. Hello There. I found your blog the usage of msn. That is an extremely smartly written article.

    I will make sure to bookmark it and return to learn more of your useful information. Thank you for the post.
    I will certainly return.

  19. Appreciating the time and energy you put into your website and in depth information you
    offer. It’s nice to come across a blog every once in a while
    that isn’t the same old rehashed information. Excellent read!
    I’ve saved your site and I’m including your RSS feeds to my Google account.

  20. I would like to thank you for the efforts you’ve put in writing this blog. I’m hoping to check out the same high-grade content from you in the future as well. In fact, your creative writing abilities has inspired me to get my own blog now 😉

  21. Right here is the right webpage for everyone who wishes to understand this topic. You realize so much its almost tough to argue with you (not that I actually will need to…HaHa). You certainly put a fresh spin on a topic that has been written about for decades. Great stuff, just excellent!

  22. Hi, I do believe this is an excellent site. I stumbledupon it 😉 I’m going to come back yet again since I saved as a favorite it. Money and freedom is the best way to change, may you be rich and continue to help other people.

  23. Hi, I believe your website could be having web browser compatibility issues. Whenever I look at your website in Safari, it looks fine however, if opening in Internet Explorer, it has some overlapping issues. I simply wanted to give you a quick heads up! Besides that, great blog!

  24. I’d like to thank you for the efforts you’ve put in writing this blog. I really hope to check out the same high-grade content from you later on as well. In fact, your creative writing abilities has encouraged me to get my own site now 😉

  25. A motivating discussion is definitely worth comment. I believe that you ought to publish more on this issue, it might not be a taboo matter but typically people do not speak about such subjects. To the next! Best wishes!!

  26. Achieving your fitness goals doesn’t need a certified personal trainer or an expensive gym membership, it’s not hard to exercise at home. It’s easy to go down a training and fitness rabbit hole, however, when you are looking for the best home exercise equipment to outfit your personal home gym.

  27. Nice post. I learn something totally new and challenging on blogs I stumbleupon every day. It’s always interesting to read through articles from other authors and use something from other web sites.

  28. Having read this I thought it was very informative. I appreciate you finding the time and energy to put this content together. I once again find myself personally spending way too much time both reading and commenting. But so what, it was still worth it!

  29. An interesting discussion is definitely worth comment. There’s no doubt that that you ought to publish more on this subject, it might not be a taboo matter but generally folks don’t discuss these subjects. To the next! Many thanks!!

  30. You’re so interesting! I don’t believe I’ve truly read through anything like this before. So great to find another person with genuine thoughts on this topic. Really.. thank you for starting this up. This web site is one thing that is required on the internet, someone with a little originality!

  31. I blog quite often and I really thank you for your information. This article has truly peaked my interest. I’m going to book mark your site and keep checking for new information about once per week. I opted in for your Feed too.

  32. Hi there! This post couldn’t be written much better! Reading through this post reminds me of my previous roommate! He always kept preaching about this. I am going to send this article to him. Pretty sure he’s going to have a great read. Thank you for sharing!

  33. Howdy! I could have sworn I’ve been to this website before but after going through some of the articles I realized it’s new to me. Anyways, I’m definitely happy I stumbled upon it and I’ll be bookmarking it and checking back frequently!

  34. Having read this I believed it was rather informative. I appreciate you finding the time and energy to put this content together. I once again find myself personally spending way too much time both reading and leaving comments. But so what, it was still worthwhile!

  35. After exploring a few of the articles on your web site, I seriously appreciate your technique of blogging. I added it to my bookmark webpage list and will be checking back in the near future. Take a look at my web site too and tell me how you feel.

Leave a Reply

Your email address will not be published. Required fields are marked *