VR Interaction & Scenario Manager

An interaction system and scenario manager for VR training simulation. It handles aspects like setting up VR training scenarios (i.e., steps of completing a certain task), providing audio/visual instructions to the user to complete that task and tracking if the given interactions from the scenario are being completed properly or not.

The interaction system includes features like hand tracking, grab detection, object manipulation (e.g., moving, rotating, overlapping etc.) and other common VR interactions.

Tools Used: Meta XR, Interaction SDK, C++ and Blueprint (Unreal Engine)

Technical info (summarized): Meta XR has been used for hand tracking, some of the components from Interaction SDK have been used as the base to handle interactions like grabbing, rotating, hiding hand when grabbed, etc. The scenario manager and other base classes were custom coded in C++ from scratch and further extended using Blueprints.