Method for Viewing Real-World Scenes while Recording Video
Source abstract
Abstract
Because smartphones support various functions, they are carried by users everywhere. Whenever a user believes that a moment is interesting, important, or meaningful to them, they can record a video to preserve such memories. The main problem with video recording an important moment is the fact that the user needs to look at the scene through the mobile phone screen rather than seeing the actual real-world event. This occurs owing to uncertainty the user might feel when recording the video. For example, the user might not be sure if the recording is of high-quality and might worry about missing the target object. To overcome this, we developed a new camera application that utilizes two main algorithms, the minimum output sum of squared error and the histograms of oriented gradient algorithms, to track the target object and recognize the direction of the user’s head. We assumed that the functions of the new camera application can solve the user’s anxiety while recording a video. To test the effectiveness of the proposed application, we conducted a case study and measured the emotional responses of users and the error rates based on a comparison with the use of a regular camera application. The results indicate that the new camera application induces greater feelings of pleasure, excitement, and independence than a regular camera application. Furthermore, it effectively reduces the error rates during video recording.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Video Analysis and Summarization · Image and Video Quality Assessment
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Samsung Research, Seoul 06765, Korea
References (35)
Show source-provided references
1. Wang, R., Yu, C., Yang, X., He, W., and Shi, Y. (2019, January 4–9). EarTouch: Facilitating smartphone use for visually impaired people in mobile and public scenarios. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.10.1145/3290605.3300254 ↗
2. Nguyen, D., Marcu, G., Hayes, G., Truong, K., Scott, J., Langheinrich, M., and Roduner, C. (October, January 30). Encountering SenseCam: Personal recording technologies in everyday life. Proceedings of the 11th International Conference on Ubiquitous Computing, Orlando, FL, USA.
3. O’Dea, S. (2020, September 07). Global Smartphone Sales to End Users 2007–2021. Available online: https://www.statista.com/statistics/263437/global-smartphone-sales-to-end-users-since-2007.
4. DCW Team (2020, September 07). The Best Camera Phone in 2020: Which Is the Best Smartphone for Photography?. Available online: https://www.digitalcameraworld.com/uk/buying-guides/best-camera-phone.
5. Bolme, D., Beveridge, J., Draper, B., and Lui, Y. (2010, January 13–18). Visual object tracking using adaptive correlation filters. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539960 ↗
6. Incremental learning for robust visual tracking10.1007/s11263-007-0075-7 ↗
7. Adam, A., Rivlin, E., and Shimshoni, I. (2006, January 17–22). Robust fragments based tracking using the integral histogram. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, USA.
8. Zhang, X., Hu, W., Maybank, S., and Li, X. (2007, January 14–21). Graph based discriminative learning for robust and efficient object tracking. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.10.1109/ICCV.2007.4409034 ↗
9. Babenko, B., Yang, M., and Belongie, S. (2009, January 20–25). Visual Tracking with Online Multiple Instance Learning. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206737 ↗
10. Image object tracking based on temporal context and MOSSE10.1007/s10586-017-0800-0 ↗
11. Efficient HOG human detection10.1016/j.sigpro.2010.08.010 ↗
12. Fast human detection using a novel boosted cascading structure with meta stages10.1109/TIP.2008.926152 ↗
13. Learned local Gabor patterns for face representation and recognition10.1016/j.sigpro.2009.02.016 ↗
14. Face detection using template matching and skin-color information10.1016/j.neucom.2006.10.043 ↗
15. Lian, G. (2020, January 28–30). Pedestrian detection using quaternion histograms of oriented gradients. Proceedings of the 2020 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China.10.1109/ICPICS50287.2020.9202071 ↗
16. Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O’Reilly Media, Inc.
17. Grabner, H., Grabner, M., and Bischof, H. (2006, January 4–7). Real-time tracking via on-line boosting. Proceedings of the British Machine Vision Conference 2006, Edinburgh, UK.10.5244/C.20.6 ↗
18. Kalal, Z., Mikolajczyk, K., and Matas, J. (2010, January 23–26). Forward-backward error: Automatic detection of tracking failures. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.10.1109/ICPR.2010.675 ↗
19. An improved algorithm of median flow for visual object tracking and its implementation on ARM platform10.1007/s11554-013-0354-1 ↗
20. Dlib-ml: A machine learning toolkit
21. Holzmann, C., and Hochgatterer, M. (2012, January 18–21). Measuring Distance with Mobile Phones Using Single-Camera Stereo Vision. Proceedings of the 32nd International Conference on Distributed Computing Systems Workshops, Macau, China.10.1109/ICDCSW.2012.22 ↗
22. Parkkola, H., and Saariluoma, P. (2006). Would Ten Participants Be Enough for Design of New Services?. Quality and Impact of Qualitative Research, Institute for Integrated and Intelligent Systems, Griffith University.
23. Park, H., Lee, J., Bae, S., Park, D., and Lee, Y. (2018). A Proposal for an Affective Design and User-Friendly Voice Agent. International Conference on Human Systems Engineering and Design: Future Trends and Applications, Springer.10.1007/978-3-030-02053-8_38 ↗
24. Designing products with added emotional value: Development and application of an approach for research through design
25. Lang, P. (1985). The Cognitive Psychophysiology of Emotion: Fear and Anxiety, Routledge.
26. Measuring emotion: The self assessment manikin and the semantic differential10.1016/0005-7916(94)90063-9 ↗
27. Observations: SAM: The Self-Assessment Manikin; an efficient cross-cultural measurement of emotional response
28. The effect of negative emotion on eyewitness functional field of view10.4992/jjpsy.72.361 ↗
29. Meyer, B., Lipski, C., Scolz, B., and Magnor, M. (2010, January 19–21). Real-time free-viewpoint navigation from compressed multi-video recordings. Proceedings of the 3D Data Processing, Visualization and Transmission (3DPVT), Padova, Italy.
30. Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P. (2019, January 15–20). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00142 ↗
31. Voigtlaender, P., Krause, M., Osep, A., Luiten, J., Sekar, B., Geiger, A., and Leibe, B. (2019, January 15–20). MOTS: Multi-object tracking and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00813 ↗
32. Organizing egocentric videos of daily living activities10.1016/j.patcog.2017.07.010 ↗
33. Furnari, A., Farinella, G., and Battiato, S. (2016). Temporal segmentation of egocentric videos to highlight personal locations of interest. European Conference on Computer Vision, ECCV.10.1007/978-3-319-46604-0_34 ↗
34. Facial emotion recognition using convolutional neural networks (FERC)10.1007/s42452-020-2234-1 ↗
35. Dashtipour, K., Gogate, M., Cambria, E., and Hussain, A. (2021). A novel context-aware multimodal framework for persian sentiment analysis. arXiv.10.1016/j.neucom.2021.02.020 ↗