6DoF VR Ventriloquist Effect

This project investigates the ventriloquist effect — the perceptual capture of auditory location by visual information — in a six-degrees-of-freedom virtual reality environment rendered with 5th-order Ambisonics. Participants used Meta Quest 3 headsets with full head movement and positional tracking, examining how audiovisual spatial discrepancy affects sound localisation under natural VR conditions.

ASCOE platform. The study required a dedicated VR platform: ASCOE (Audiovisual Spatial Cognition and Object Experiment), implemented in Unity with the Wwise audio engine and Atmoky trueSpatial renderer. ASCOE supports parametric 3D sound source positioning, trial-based logging, and tight audiovisual timing — making it reusable for future spatial hearing experiments. Developed by P. Perkowski (M.Sc.Eng thesis, 2025) under my supervision. Repository: PG GitLab.

Co-authored with P. Perkowski. Companion repository includes participant data, head-trajectory logs, and reproducible R modelling scripts. Submitted to IEEE Transactions on Visualization and Computer Graphics (2026). Further development planned under NCN Miniatura (submitted 2026).

@article{mroz_ventriloquist_2026,
  title = {Ventriloquist effect in {6DoF} {VR} with {Higher}-{Order} {Ambisonics}},
  author = {Mróz, Bartłomiej and Perkowski, Paweł},
  journal = {{IEEE} Transactions on Visualization and Computer Graphics},
  year = {2026},
  note = {Under review}
}