Collaboration with AUO

The research team at NTU CSIE, including the members of Prof. Chi-Sheng (Daniel) Shih, Prof. Yi-Ping Hung, Prof. Bin-Yu (Robin) Chen, and Prof. Chin-Yao Lin, has a long-term collaboration with the AUO team to develop the technologies to enable immersive experience inside the vehicle cabin. Part of our collaboration outcomes were demonstrated in CES 2024 and 2025. The technology shown in the demo includes:

  • Synchronization between the CARLA simulator and vehicle dashboard: this technology enables the synchronization between the CARLA simulator and vehicle (e.g., Autoware). In the demo shown below, the dashboard information is synchronized with the street view generated by the CARLA simulator. The results are shown in the CES 2025 video clips.

  • Generative AI for real-time interaction: this technology enables the passenger to interact with real objects and generative objects, shown as the dog and bones in the demo, in real-time in the first demo video.

  • Wave field synthesis: this technology enables the multimedia system to accurately re-play the sound at designated 3D locations inside the cabin, as shown in the second demo video.

Here are two video clips from CES 2025.

  • Real-time interaction and generative AI: link
  • Dashboard and wave field synthesized sound: link