Benefits and Challenges of Virtual-Reality-Based Industrial Usability Testing and Design Reviews: A Patents Landscape and Literature Review
Source abstract
Abstract
With the introduction of new devices, industries are turning to virtual reality to innovate their product development processes. However, before the technology’s possibilities can be fully harnessed, certain constraints must be overcome. This study identifies the benefits and challenges of virtual-reality-based usability testing and design reviews in industry through a patents and articles review. We searched Derwent Innovation, Scopus, and Web of Science and identified 7 patent filings and 20 articles. We discovered an increase in patent filings since 2016 and strong development in the technology space, offering opportunities to enter an area while it is still young. The most frequently researched field is the automotive industry and the most used device is the HTC VIVE head-mounted display, which is frequently paired with motion capture systems and Unity 3D game engines. Virtual reality benefits design reviews and usability testing by providing the visualization of new angles that stimulate novel insights, increasing team engagement, offering more intuitive interactions for non-CAD specialists, saving redesign cost and time, and increasing participants’ safety. The challenges faced by virtual-reality-based prototypes are a lack of realism due to unnatural tactile and visual interactions, latency and registration issues, communication difficulties between teams, and unpleasant symptoms. While these constraints prevent virtual reality from replacing conventional design reviews and usability testing in the near future, it is already a valuable contribution to the industrial product development process.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Augmented Reality Applications · Anatomy and Medical Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Management and Industrial Technology, SENAI CIMATEC University Center, Salvador 41650010, Brazil
Department of Creative Industry, SENAI CIMATEC University Center, Salvador 41650010, Brazil
References (67)
Show source-provided references
1. How Integrating Industrial Design in the Product Development Process Impacts on Company Performance10.1111/1540-5885.1810028 ↗
2. Virtual Reality in the Product Development Process Virtual Reality in the Product Development Process10.1080/09544820210129823 ↗
3. García Acosta, G., Morales, K., Puentes Lagos, D., and Ruiz Ortiz, M. (2011). Addressing human factors and ergonomics in design process, product life cycle and innovation. Human Factors and Ergonomics in Consumer Product Design, CRC Press.10.1201/b10950-12 ↗
4. (2021, December 05). ISO—Standards. Available online: https://www.iso.org/standards.html.
5. Jordan, P.W. (2020). An Introduction to Usability, CRC Press.10.1201/9781003062769 ↗
6. Nielsen, J. (1993). Usability Engineering, Morgan Kaufmann. Available online: https://books.google.com.br/books?hl=pt-BR&lr=&id=95As2OF67f0C&oi=fnd&pg=PR9&dq=%22Usability+engineering%22&ots=3cBFFlhqYv&sig=rzrcuU75ZNU88y9yF_JuGkXyhus#v=onepage&q=%22Usability%20engineering%22&f=false.
7. Bruno, F., Angilica, A., Cosco, F.I., Luchi, M.L., Muzzupappa, M., and Bruno, F. (2011, January 15–17). Mixed prototyping environment with different video tracking techniques. Proceedings of the International Conference on Innovative Methods in Product Design (IMProVe), Venice, Italy.
8. Methods and procedures to usability testing in virtual reality systems
9. Salvendy, G. (2012). Handbook of Human Factors and Ergonomics, John Wiley & Sons. Available online: https://books.google.com.br/books?hl=pt-BR&lr=&id=WxJVNLzvRVUC&oi=fnd&pg=PA3&dq=Handbook+of+human+factors+and+ergonomics&ots=pZnrLQYAm6&sig=PLgzmdIf9xuyUr5NKVpB4OtULO8#v=onepage&q=Handbook%20of%20human%20factors%20and%20ergonomics&f=false.10.1002/9781118131350 ↗
10. Soares Falcão, C., and Márcio Soares, M. (2013, January 21–26). Application of virtual reality technologies in consumer product usability. Proceedings of the International Conference of Design, User Experience, and Usability, Las Vegas, NV, USA.10.1007/978-3-642-39253-5_37 ↗
11. Zimmermann, P. (2008). Virtual reality aided design: A survey of the use of VR in automotive industry. Product Engineering, Springer.10.1007/978-1-4020-8200-9_13 ↗
12. Jerald, J. (2015). The VR Book: Human-Centered Design for Virtual Reality, Morgan & Claypool.10.1145/2792790 ↗
13. Future directions for the development of virtual reality within an automotive manufacturer10.1016/j.apergo.2015.06.024 ↗
14. A Review of the Capabilities of Current Low-Cost Virtual Reality Technology and Its Potential to Enhance the Design Process10.1115/1.4036921 ↗
15. A virtual reality supported 3D environment for engineering design review
16. Analyzing the potential of Virtual Reality for engineering design review10.1016/j.autcon.2019.03.018 ↗
17. Applicability Evaluation of Kinect for EAWS Ergonomic Assessments10.1016/j.procir.2019.03.194 ↗
18. (2021, December 28). Virtual Reality (VR) Market Share, Growth: Research Report, 2021–2028. Available online: https://www.fortunebusinessinsights.com/industry-reports/virtual-reality-market-101378.
19. Optimizing the Design Review Process for Cyber-Physical Systems Using Virtual Reality10.1016/j.procir.2020.03.115 ↗
20. Supporting Teamwork in Industrial Virtual Reality Applications10.1016/j.promfg.2020.02.016 ↗
21. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews10.1186/s13643-021-01626-4 ↗
22. Booth, A., Sutton, A., and Papaioannou, D. (2016). Systematic Approaches to a Successful Literature Review, SAGE.
23. (2021, December 25). How Does Smart Search Work?. Available online: https://www.derwentinnovation.com/tip-innovation/support/help/smart_search/How_Does_Smart_Search_Work_.htm.
24. (2021, December 25). Derwent World Patents Index (DWPI)—Data on Derwent Innovation. Available online: https://www.derwentinnovation.com/tip-innovation/support/help/dwpi.htm.
25. (2022, January 30). How Scopus Works. Available online: https://www.elsevier.com/solutions/scopus/how-scopus-works/content.
26. Matthews, T. (2022, January 30). LibGuides: Resources for Librarians: Web of Science Coverage Details. Available online: https://clarivate.libguides.com/librarianresources/coverage.
27. Using Virtual Reality to Investigate Geological Outcrops on Planetary Surfaces
28. Zeng, L., Li, Z., Zhao, Z., and Mao, M. (2018, January 8–12). Landscapes and Emerging Trends of Virtual Reality in Recent 30 Years: A Bibliometric Analysis. Proceedings of the IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, Guangzhou, China. Available online: https://ieeexplore.ieee.org/document/8560289.10.1109/SmartWorld.2018.00311 ↗
29. (2021, December 14). Major HTC Vive VR “Breakthrough” to Be Shown at CES 2016. Available online: https://www.techradar.com/news/wearables/major-htc-vive-breakthrough-to-be-unveiled-at-ces-2016-1311518.
30. (2021, December 14). HTC Vive to Demo a “Very Big” Breakthrough in VR at CES. Available online: https://www.engadget.com/2015-12-18-htc-vive-vr-big-breakthrough-ces.html.
31. Ren, Z., He, Y., Shen, S., Lai, Z., Wang, X., Jin, C., and Li, W. (2020). Method and Device for Testing Availability of Space. (No. CN111414083A), Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200714&CC=CN&NR=111414083A&KC=A.
32. Ren, Z., He, Y., Shen, S., Lai, Z., Wang, X., Jin, C., and Li, W. (2020). Space Availability Test Laboratory and Use Method and Device Thereof. (No. CN111414084A), Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200714&CC=CN&NR=111414084A&KC=A.
33. Murayama, T. (2021). Design Review System and Design Review Method. (No. JP2021068278A), Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&FT=D&date=20210430&CC=JP&NR=2021068278A&KC=A.
34. Vaidyanath, M., Anbalagan, V., Kannaiyan, T., and Vasudevan Varshini, R. (2021). System for Rendering Applications Based on Real-Time Accessibility Assessment. (No. US20210011593A1), U.S. Patent, Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210114&CC=US&NR=2021011593A1&KC=A1.
35. Godi, M., and Kommabhatla, S. (2021). Method, and a System for Design Reviews and Trainings. (No. US20210090343A1), U.S. Patent, Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210325&CC=US&NR=2021090343A1&KC=A1.
36. Mohammadrezazadeh, I., and Bhattacharyya, R. (2019). Neuro-Adaptive Body Sensing for User States Framework (NABSUS). (No. US20190227626A1), U.S. Patent, Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20190725&CC=US&NR=2019227626A1&KC=A1.
37. Ryu, H.B., Jo, H.U., Lee, H.M., and Kim, J.E. (2019). Method for Evaluating Usability on Vehicle Infortainment Syste Method for Evaluating Cognitive Load of Driver Using Vehicle Infortainment System. (No. KR20190088710A), Available online: https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20190729&CC=KR&NR=20190088710A&KC=A.
38. The State of Virtual Reality Hardware10.1145/3441290 ↗
39. (2021, December 28). Virtual Reality Gets a Boost during the Pandemic. Available online: https://www.ccsinsight.com/press/company-news/virtual-reality-gets-a-boost-during-the-pandemic/.
40. A Novel Design Engineering Review System with Searchable Content: Knowledge Engineering via Real-Time Multimodal Recording10.1080/09544828.2017.1393655 ↗
41. An Industry Case Study: Investigating Early Design Decision Making in Virtual Reality10.1115/1.4034267 ↗
42. Brandt, S., Fischer, M., Gerges, M., Ahn, C.J., Berssenbrügge, J., and Berssenbrügge, B. (2017, January 6–9). Automatic derivation of geometric properties of components from 3D polygon models. Proceedings of the 37th Computers and Information in Engineering Conference, Cleveland, OH, USA.10.1115/DETC2017-67528 ↗
43. de Clerk, M., Schmierer, G., Dangelmaier, M., and Spath, D. (2017, January 12–14). Interaction techniques for virtual reality based automotive design reviews. Proceedings of the International Conference on Virtual Reality and Augmented Reality, Laval, France.10.1007/978-3-319-72323-5_3 ↗
44. VR-Based Operating Modes and Metaphors for Collaborative Ergonomic Design of Industrial Workstations10.1007/s12193-016-0231-x ↗
45. Chances and Limitations of a Virtual Reality-Supported Tool for Decision Making in Industrial Engineering10.1016/j.ifacol.2018.08.390 ↗
46. Bolder, A., Grünvogel, S.M., and Angelescu, E. (December, January 28). Comparison of the usability of a car infotainment system in a mixed reality environment and in a real car. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST), Tokyo, Japan.
47. Lee, J., and Nam, K.S. (2019, January 1–3). A study of deriving usability evaluation factors on virtual reality contents. Proceedings of the 11th International Conference on Education and New Learning Technologies, Palma, Spain.10.21125/edulearn.2019.0616 ↗
48. Combining Virtual Reality (VR) Technology with physical models—A new way for human-vehicle interaction simulation and usability evaluation10.1007/978-3-030-22666-4_11 ↗
49. Usability evaluation of VR products in industry—A Systematic literature review
50. User Centered Design of Interaction Techniques for VR-Based Automotive Design Reviews10.3389/frobt.2019.00013 ↗
51. Nam, S., Ko, G., Suh, K.-W., and Kwon, J. (2019, January 23–26). User Experience- and Design-Oriented Virtual Product Prototyping System. Proceedings of the 11th International Conference on Knowledge and Smart Technology, Phuket, Thailand.10.1109/KST.2019.8687418 ↗
52. Pettersson, I., Karlsson, M.A., and Ghiurau, F.T. (2019, January 23–28). Virtually the same experience? Learning from user experience evaluation of in-vehicle systems in vr and in the field. Proceedings of the ACM Designing Interactive Systems Conference (DIS 2019), San Diego, CA, USA.10.1145/3322276.3322288 ↗
53. Bellalouna, F. (2019, January 23–25). Virtual-Reality-Based Approach for Cognitive Design-Review and FMEA in the Industrial and Manufacturing Engineering. Proceedings of the 10th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Naples, Italy.10.1109/CogInfoCom47531.2019.9090002 ↗
54. A Transdisciplinary Digital Approach for Tractor’s Human-Centred Design10.1080/0951192X.2019.1599441 ↗
55. Implications of Virtual Reality on Environmental Sustainability in Manufacturing Industry: A Case Study10.1016/j.procir.2021.11.078 ↗
56. Applications and Research Trends of Digital Human Models in the Manufacturing Industry10.1016/j.vrih.2019.09.005 ↗
57. Application of Virtual and Augmented Reality in Automotive10.1515/eng-2020-0022 ↗
58. Virtual Reality in the Automotive Field in Industry 4.010.1016/j.matpr.2020.12.037 ↗
59. A Systematic Review of Augmented Reality Applications in Maintenance10.1016/j.rcim.2017.06.002 ↗
60. Locascio, J., Khurana, R., He, Y., and Kaye, J. (2016, January 7–12). Utilizing Employees as Usability Participants: Exploring When and When Not to Leverage Your Coworkers. Proceedings of the Conference on Human Factors in Computing Systems—Proceedings 2016, San Jose, CA, USA.10.1145/2858036.2858047 ↗
61. Chandran, S.K., Forbes, J., Bittick, C., Allanson, K., and Brinda, F. (2017, January 4–6). Sample Size in the Application of System Usability Scale to Automotive Interfaces. Proceedings of the SAE World Congress Experience (WCX), Detroit, MI, USA.10.4271/2017-01-1383 ↗
62. The Use and Usage of Virtual Reality Technologies in Planning and Implementing New Workstations
63. Integrating Mocap System and Immersive Reality for Efficient Human-Centred Workstation Design10.1016/j.ifacol.2018.08.256 ↗
64. Current Trends in Research and Application of Digital Human Modeling10.1007/978-3-030-74614-8_44 ↗
65. On Immersive Virtual Environments for Assessing Human-Driven Assembly of Large Mechanical Parts10.1016/j.promfg.2017.07.253 ↗
66. Carlsson, M., and Sonesson, T. (2017). Using Virtual Reality in an Automotive User Experience Development Process, Chalmers University of Technology.
67. Mixed Prototyping with Configurable Physical Archetype for Usability Evaluation of Product Interfaces10.1016/j.compind.2012.11.010 ↗