Audiovisual Speech-in-Noise

Software developed by Seth Bashford for Dr. Kaylah Lalonde

The Problem:

The researcher needed a program to present audiovisual stimuli in noise at adaptively tracked sound levels without compromising audiovisual synchrony.

The Solution:

Our engineer created a platform using Apple's AVFoundation and Core Audio frameworks for video playback and audio processing. These frameworks facilitate audio level manipulation in the playback context. Because this approach circumvents re-encoding media data, it retains the default audiovisual synchrony afforded by Apple systems.

Screen 1 Screen 2