Text-Driven Talking Head Using Dynamic Viseme and DFFD for SIBI

Penulis: Muzahidin, Sultan; Rakun, Erdefi
Informasi
Jurnal7th International Conference on Information Technology, Computer, and Electrical Engineering, ICITACEE 2020 - Proceedings
PenerbitInstitute of Electrical and Electronics Engineers Inc.
Halaman173 - 178
Tahun Publikasi2020
ISBN978-172817225-5
Jenis SumberScopus
Sitasi
Scopus: 4
Abstrak
This research aims to build an android application that is able to help a deaf person in learning the Indonesian Sign Language System (SIBI). The application is packaged in the form of a 3D animated talking head. This research, the development of a talking head uses the dynamic viseme method. Dynamic viseme has the advantage of creating a more natural animation movement because it uses the original human model in the building process. By using the Dirichlet Free-Form Deformation (DFFD) method as control, the concatenative method is able to produce animated movements that are easily understood by the deaf person. In its build, linear interpolation was also used so that the displacement in the speaker becomes more natural. To build animated movements, four different human models were used. Experimental testing was carried out using surveys and calculations were carried out using the Mean Opinion Score (MOS) method. The number of surveys carried out was five. The purpose of the survey is to determine a model that is easier to understand by mouth movements. The test results on the Indonesian sentence show a value of 4.25. These results indicate that the 3D talking head has the potential to be developed so that it can be understood by a deaf person. © 2020 IEEE.
Dokumen & Tautan

© 2025 Universitas Indonesia. Seluruh hak cipta dilindungi.