2022 International Conference on Image, Signal Processing and Pattern Recognition(ISPP2022)
Prof. Kiyoshi Hoshino


Prof. Kiyoshi Hoshino.jpg

Prof. Kiyoshi Hoshino

University of Tsukuba, Japan

Gaze estimation and eye rotation measurement using a small camera placed almost next to the eyeball


In this keynote speech, the author introduces a new method that enables you to detect, firstly, where the user is looking (gaze estimation) and, secondly, physical disorders such as dizziness and queasiness and their signs (eye rotation measurement). The required specification of the measurement is to be able to measure the user's eye movements with high accuracy, without being affected by the surrounding light environment and without psychological load, even when the eye imaging camera is placed in a free position.

In order to achieve this goal, my research group firstly developed an image processing system that can track the template vascular image with high accuracy and stability even for users with various shapes of ocular vascular images and even when external light sources are reflected on the surface of the eye, based on a system that measures eye rotation movement by tracking the vascular image in the whites of the eyes.

Secondly, we have created a calibration gazing point presentation method that enables highly accurate gaze estimation even when a small camera is placed almost next to the eye, as in the case of eye rotation measurement. As a result of the evaluation experiments, we have been able to obtain the number of gazing points and the order of presentation of the gazing points for calibration, which are about 7 to 9 points that enable good gaze estimation with an estimation error of less than 1.2 degrees at the worst.


He received two doctor's degrees; one in Medical Science in 1993, and the other in Engineering in 1996, from the University of Tokyo respectively. From 1993 to 1995, he was an assistant professor at Tokyo Medical and Dental University School of Medicine. From 1995 to 2002, he was an associate professor at University of the Ryukyus. From 2002, he was an associate professor at the Biological Cybernetics Lab of University of Tsukuba. He is now a professor. From 1998 to 2001, he was jointly appointed as a senior researcher of the PRESTO "Information and Human Activity" project of the Japan Science and Technology Agency (JST). From 2002 to 2005, he was a project leader of a SORST project of JST. He served as a member of the “cultivation of human resources in the information science field” WG, Special Coordination Funds for the Promotion of Science and Technology, MEXT, a member of “Committee for Comport 3D Fundamental Technology Promotion”, JEITA, a councilor and director of the Ibaraki Sports Association, and the General Conference Chair of the 43rd Annual Meeting of Japanese Society of Biofeedback Research, ICBBE 2018 to 2020, and DMIP 2018 to 2021. He received Laval Virtual Awards in 2009, 2013, and 2014.