Deliverable 4: Voice Command Integration


Description:

The goal of this deliverable is to incorporate voice interactions into the virtual reality environment. By introducing voice commands, the project aims to create a more immersive and user-friendly experience. The implementation would include voice recognition, speech-to-text transcription, integration with ChatGPT, and vocal feedback responses. The overall focus is to optimize user communication and to create a seamless experience within the virtual reality environment.

Implementation Steps:

  1. Setup voice recognition (Whisper API)
  2. Capture voice commands
  3. Transcribe voice commands and send them to ChatGPT
  4. Extract ChatGPT responses
  5. Refine the voice interactions

Results:

  • Process Diagram

    diagram


  • Virtual Reality Audio Command Test




  • Another test (with Text-to-Speech sound)