Conversation video dataset with a camera on each speaker and full-duplex audio.

otoSpeech Video is audio-visual English conversation between two people. Each speaker has their own camera video, synced to two-channel audio with a separate channel for each voice. You can line up speech, faces, and gestures for each person, even when they talk at the same time.

Faces are mosaicked in the sample to protect the speakers’ privacy. The licensed data has no mosaic.

Casual	Language	Speakers	Media	License	Actions
	English	2	AudioVideo	On request	Request
English conversation with a camera view of each speaker, synced to two-channel audio. Faces are mosaicked in the sample to protect the speakers' privacy. The licensed data has no mosaic. Sample rate 48 kHz Includes One camera video per speaker, stereo audio, and per-speaker transcripts

Need other camera setups or languages? We record and annotate to your specification.Request

What the dataset includes

Video: One camera video per speaker.
Audio: Stereo at 48 kHz, with one speaker on each channel.
Transcripts: Per-speaker transcripts.

More conversation with video

Casual	Language	Speakers	Media	License	Actions
	English	2-5	AudioVideo	On request	Request
English conversation recorded in person, with two to five people. Sessions are casual or deliberative. Room 23.1 m² floor area, 46.27 m³ volume, 2.3 m ceiling Seating Four speaker stations in alternating positions Microphones Sony C-38B and a Sony lavalier (ECM-77B or ECM-44B) at every station. Shure SM7B and Sennheiser MKE600 at stations 1 to 3. Sennheiser MKH416 at station 3. Room mic AKG C414 XLII near the center of the room Channels 16 channels, 48 kHz, 24-bit WAV Note This is the main setup. Some later sessions used different microphones. About multi-speaker datasets
Task-oriented
	English	2-4	AudioVideo	On request	Request
English conversation with first-person video, as two to four people fold towels, tidy everyday objects, or play Jenga. Audio A close microphone for every person, plus left-ear and right-ear microphones on the main worker Video Head-mounted cameras on the main worker and one other participant, plus wide and close fixed views About full-duplex egocentric data

FAQ

Does the licensed data have mosaics?

No. Faces are mosaicked in the sample to protect the speakers’ privacy. The licensed data has no mosaic.

How is it different from otoSpeech Egocentric?

otoSpeech Video has a camera view of each of two speakers. otoSpeech Egocentric shows the scene from a speaker’s point of view, with two to four people doing a task together.

How is it different from otoSpeech Face-to-Face?

otoSpeech Video has one camera video per speaker and two-channel audio. otoSpeech Face-to-Face is recorded in person with two to five people in one room.

How is the dataset licensed?

Licensing is on request. Tell us how you plan to use the data and we will follow up.