Chris Pollett > Students >
Ivan
    ( Print View)

    [Bio]

    [Blog]

    [C297 Proposal]

    [Deliverable 1]

    [Deliverable 2]

    [Deliverable 3]

    [Deliverable 4]

    [CS297 Report (PDF)]

    [Paper 1: A-Frame Virtual Reality (PDF)]

    [Paper 2: ChatGPT - Fundamentals and Applications (PDF)]

    [Paper 3: ChatGPT Consistency (PDF)]

    [Paper 4: VR Voice Interaction (PDF)]

    [C298 Proposal]

    [CS298 - Deliverable 1]

    [CS298 - Deliverable 2]

    [CS298 - Deliverable 3]

    [CS298 - Deliverable 4]

    [CS298 Report (PDF)]

    [CS298 Presentation (PDF)]

    [CS298 - Code (ZIP)]

Deliverable 4: Voice Command Integration


Description:

The goal of this deliverable is to incorporate voice interactions into the virtual reality environment. By introducing voice commands, the project aims to create a more immersive and user-friendly experience. The implementation would include voice recognition, speech-to-text transcription, integration with ChatGPT, and vocal feedback responses. The overall focus is to optimize user communication and to create a seamless experience within the virtual reality environment.

Implementation Steps:

  1. Setup voice recognition (Whisper API)
  2. Capture voice commands
  3. Transcribe voice commands and send them to ChatGPT
  4. Extract ChatGPT responses
  5. Refine the voice interactions

Results:

  • Process Diagram

    diagram


  • Virtual Reality Audio Command Test




  • Another test (with Text-to-Speech sound)