Dr. David Brang was recently quoted in an article about synesthesia featured in the Fall 2020, Mysteries issue of Popular Science. The article, “Why some people hear colors and taste words” introduces how extra connections in the brain can lead to the experience of mixed senses.
Graduate student Karthik was awarded a fellowship with the Michigan Institute for Computational Discovery and Engineering for the upcoming 2020-2021 year. The award will support his research project, “Computational modeling of auditory speech perception,” which involves the use and advancement of scientific computing techniques and practices. Congratulations!
In this article, we demonstrate that the human perceptual system exploits the natural correlation between mouth shape and auditory signal frequency to facilitate speech perception. Due to the acoustics physics of the oral cavity, changing the shape of the mouth (i.e., its width or narrowness) can be used to predict frequencies of auditory signals …
Publication: Vision perceptually restores auditory spectral dynamics in speech Read More »
