Unity 3D will be used to create an interactive VR environment, and photon server (cloud-based networking) will be used to implement multiplayer function. Voice Over IP technique (VOIP) will be used to set up the voice interactive system in Photon networking server. Based on the VOIP technology, the trainers and the trainees will be able to have conversations in the virtual environment. To simulate the natural conversation, the virtual VOIP conversation will be enabled only if two avatars are close enough. The participants will be able to hear and talk to each other with voices.
The main pillars for the development of the platform will be:
- Ease of use: the more friendly to people who have never used VR before, the better
- Ability to interact with multiple multimedia assets (images, video, sounds, texts, 3D objects)
- Ability to use nonverbal communication
- Availability on multiple platforms: Especially being accessible to non-VR users, since “VR headsets for everyone” is not always feasible. Unity is acknowledged as a multiplatform game engine, so it can support this requirement. In other words non VR users will be able to use the platform through an application on their computers and will be able to manage their avatars with the aid of mouse and keyboard. The platform supports all popular VR headsets but also serves the same content for web, desktop and mobile devices.
Some of the main features of the platform (will become explicit in O1) will be:
- Avatar customization
- Avatar body movements control by the users
- Avatar facials emotions control by the user
- Analytics engine for the systemic evaluation of the trainees and the trainers.
- Whiteboards where the participants will be able to write
- Post-It note fill and snapping on the wall
- Notes categorization and voting
- Import images, sounds and videos and tools to load them on demand in the 3D environment
- Import and presentation of 3D objects with animations
- Flipcharts presentation tools
- Hand raising
- Role playing tools