New University of East Anglia lip reading technology could help solve crimes

University of East Anglia. Picture: Supplied

University of East Anglia. Picture: Supplied - Credit: Supplied

New lip reading technology developed in Norfolk could help solve crimes by deciphering what people caught on CCTV are saying.

The visual speech recognition technology developed by the University of East Anglia in Norwich can be used to determine what people are saying in situations where audio is not good enough to hear – such as on security camera footage.

Helen Bear, from the university's school of computing science, said the technology could be applied to a wide range of situations from criminal investigations to entertainment.

She said: 'Lip reading has been used to pinpoint words footballers have shouted in heated moments on the pitch, but is likely to be of most practical use in situations where there are high levels of noise, such as in cars or aircraft cockpits.

'Crucially, while there are still improvements to be made, such a system could be adapted for use for a range of purposes – for example, for people with hearing or speech impairments.'

Some sounds like 'P' and 'B' look similar on the lips and have traditionally been hard to decipher, the researchers said. But now the machine lip reading technology can differentiate between the sounds for a more accurate translation.

Co-creator Richard Harvey said: 'Lip reading is one of the most challenging problems in artificial intelligence so it's great to make progress on one of the trickier aspects, which is how to train machines to recognise the appearance and shape of human lips.'

Most Read

Details about the developments will be presented to the International Conference on Acoustics, Speech and Signal Processing in Shanghai, China.

Do you have a technology story? Email

Become a Supporter

This newspaper has been a central part of community life for many years. Our industry faces testing times, which is why we're asking for your support. Every contribution will help us continue to produce local journalism that makes a measurable difference to our community.

Become a Supporter