A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation

On Chun Arthur Liu; Shun Ki Li; Li Qi Yan; Sin Chun Ng; Chok Pang Kwok

doi:10.1007/978-3-030-64221-1_24

A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation

On Chun Arthur Liu
, Shun Ki Li
, Li Qi Yan
, Sin Chun Ng
, Chok Pang Kwok

Hong Kong Metropolitan University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Citation (Scopus)

Abstract

In Hong Kong, over 2.4% of the total population suffered from visual impairment. They are facing many difficulties in their daily lives, such as shopping and travelling from places to places within the city. For outdoor activities, they usually need to have an assistant to guide their ways to reach the destinations. In this paper, a mobile application assisting visually impaired people for outdoor navigation is proposed. The application consists of navigation, obstacle detection and scene description functions. The navigation function assists the user to travel to the destination with the Global Positioning System (GPS) and sound guidance. The obstacle detection function alerts the visually impaired people for any obstacles ahead that may be avoided for collision. The scene description function describes the scene in front of the users with voice. In general, the mobile application can assist the people with low vision to walk on the streets safely, reliably and efficiently.

Original language	English
Title of host publication	Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings
Editors	Min Han, Sitian Qin, Nian Zhang
Pages	270-281
Number of pages	12
DOIs	https://doi.org/10.1007/978-3-030-64221-1_24
Publication status	Published - 2020
Event	17th International Symposium on Neural Networks, ISNN 2020 - Cairo, Egypt Duration: 4 Dec 2020 → 6 Dec 2020

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12557 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	17th International Symposium on Neural Networks, ISNN 2020
Country/Territory	Egypt
City	Cairo
Period	4/12/20 → 6/12/20

Keywords

Image recognition
Navigation
Neural network
Visually impaired

Access to Document

10.1007/978-3-030-64221-1_24

Cite this

Liu, O. C. A., Li, S. K., Yan, L. Q., Ng, S. C., & Kwok, C. P. (2020). A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation. In M. Han, S. Qin, & N. Zhang (Eds.), Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings (pp. 270-281). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12557 LNCS). https://doi.org/10.1007/978-3-030-64221-1_24

Liu, On Chun Arthur ; Li, Shun Ki ; Yan, Li Qi et al. / A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation. Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings. editor / Min Han ; Sitian Qin ; Nian Zhang. 2020. pp. 270-281 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{a496eaf238f241e19ea75c7b0553279e,

title = "A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation",

abstract = "In Hong Kong, over 2.4\% of the total population suffered from visual impairment. They are facing many difficulties in their daily lives, such as shopping and travelling from places to places within the city. For outdoor activities, they usually need to have an assistant to guide their ways to reach the destinations. In this paper, a mobile application assisting visually impaired people for outdoor navigation is proposed. The application consists of navigation, obstacle detection and scene description functions. The navigation function assists the user to travel to the destination with the Global Positioning System (GPS) and sound guidance. The obstacle detection function alerts the visually impaired people for any obstacles ahead that may be avoided for collision. The scene description function describes the scene in front of the users with voice. In general, the mobile application can assist the people with low vision to walk on the streets safely, reliably and efficiently.",

keywords = "Image recognition, Navigation, Neural network, Visually impaired",

author = "Liu, \{On Chun Arthur\} and Li, \{Shun Ki\} and Yan, \{Li Qi\} and Ng, \{Sin Chun\} and Kwok, \{Chok Pang\}",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 17th International Symposium on Neural Networks, ISNN 2020 ; Conference date: 04-12-2020 Through 06-12-2020",

year = "2020",

doi = "10.1007/978-3-030-64221-1\_24",

language = "English",

isbn = "9783030642204",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "270--281",

editor = "Min Han and Sitian Qin and Nian Zhang",

booktitle = "Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings",

}

Liu, OCA, Li, SK, Yan, LQ, Ng, SC & Kwok, CP 2020, A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation. in M Han, S Qin & N Zhang (eds), Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12557 LNCS, pp. 270-281, 17th International Symposium on Neural Networks, ISNN 2020, Cairo, Egypt, 4/12/20. https://doi.org/10.1007/978-3-030-64221-1_24

A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation. / Liu, On Chun Arthur; Li, Shun Ki; Yan, Li Qi et al.
Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings. ed. / Min Han; Sitian Qin; Nian Zhang. 2020. p. 270-281 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12557 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation

AU - Liu, On Chun Arthur

AU - Li, Shun Ki

AU - Yan, Li Qi

AU - Ng, Sin Chun

AU - Kwok, Chok Pang

PY - 2020

Y1 - 2020

N2 - In Hong Kong, over 2.4% of the total population suffered from visual impairment. They are facing many difficulties in their daily lives, such as shopping and travelling from places to places within the city. For outdoor activities, they usually need to have an assistant to guide their ways to reach the destinations. In this paper, a mobile application assisting visually impaired people for outdoor navigation is proposed. The application consists of navigation, obstacle detection and scene description functions. The navigation function assists the user to travel to the destination with the Global Positioning System (GPS) and sound guidance. The obstacle detection function alerts the visually impaired people for any obstacles ahead that may be avoided for collision. The scene description function describes the scene in front of the users with voice. In general, the mobile application can assist the people with low vision to walk on the streets safely, reliably and efficiently.

AB - In Hong Kong, over 2.4% of the total population suffered from visual impairment. They are facing many difficulties in their daily lives, such as shopping and travelling from places to places within the city. For outdoor activities, they usually need to have an assistant to guide their ways to reach the destinations. In this paper, a mobile application assisting visually impaired people for outdoor navigation is proposed. The application consists of navigation, obstacle detection and scene description functions. The navigation function assists the user to travel to the destination with the Global Positioning System (GPS) and sound guidance. The obstacle detection function alerts the visually impaired people for any obstacles ahead that may be avoided for collision. The scene description function describes the scene in front of the users with voice. In general, the mobile application can assist the people with low vision to walk on the streets safely, reliably and efficiently.

KW - Image recognition

KW - Navigation

KW - Neural network

KW - Visually impaired

UR - https://www.scopus.com/pages/publications/85097638983

U2 - 10.1007/978-3-030-64221-1_24

DO - 10.1007/978-3-030-64221-1_24

M3 - Conference contribution

AN - SCOPUS:85097638983

SN - 9783030642204

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 270

EP - 281

BT - Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings

A2 - Han, Min

A2 - Qin, Sitian

A2 - Zhang, Nian

T2 - 17th International Symposium on Neural Networks, ISNN 2020

Y2 - 4 December 2020 through 6 December 2020

ER -

Liu OCA, Li SK, Yan LQ, Ng SC, Kwok CP. A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation. In Han M, Qin S, Zhang N, editors, Advances in Neural Networks – ISNN 2020 - 17th International Symposium on Neural Networks, ISNN 2020, Proceedings. 2020. p. 270-281. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-64221-1_24

A Visually Impaired Assistant Using Neural Network and Image Recognition with Physical Navigation

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this