TY - GEN
T1 - Audio-Visual beamforming with the Eigenmike microphone array an omni-camera and cognitive auditory features
AU - Mendat, Daniel R.
AU - West, James E.
AU - Ramenahalli, Sudarshan
AU - Niebur, Ernst
AU - Andreou, Andreas G.
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2017/5/10
Y1 - 2017/5/10
N2 - Audio-visual beamforming involves both an acoustic sensor and an omni-camera to form a composite 3D audio-visual representation of the environment. Information from the respective modalities is combined in the process of acoustic localization taking into account high level cognitive features of the signals, namely the presence of specific sounds - speech and tones - which have characteristic signatures in specific spectral bands. We compare the results from two systems. One is a custom-built architecture based on the MH Acoustics Eigenmike microphone array and a consumer grade omni-camera (Bloggie). The other is the commercially available Visisonics Audio-Visual (AV) camera. We show that the performances of the two systems are comparable.
AB - Audio-visual beamforming involves both an acoustic sensor and an omni-camera to form a composite 3D audio-visual representation of the environment. Information from the respective modalities is combined in the process of acoustic localization taking into account high level cognitive features of the signals, namely the presence of specific sounds - speech and tones - which have characteristic signatures in specific spectral bands. We compare the results from two systems. One is a custom-built architecture based on the MH Acoustics Eigenmike microphone array and a consumer grade omni-camera (Bloggie). The other is the commercially available Visisonics Audio-Visual (AV) camera. We show that the performances of the two systems are comparable.
UR - http://www.scopus.com/inward/record.url?scp=85020223397&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85020223397&partnerID=8YFLogxK
U2 - 10.1109/CISS.2017.7926180
DO - 10.1109/CISS.2017.7926180
M3 - Conference contribution
AN - SCOPUS:85020223397
T3 - 2017 51st Annual Conference on Information Sciences and Systems, CISS 2017
BT - 2017 51st Annual Conference on Information Sciences and Systems, CISS 2017
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 51st Annual Conference on Information Sciences and Systems, CISS 2017
Y2 - 22 March 2017 through 24 March 2017
ER -