3D Tablet/ VR Menu
Setting Up a VR Menu in SightLab
Introduction
The 3D Tablet Menu feature in SightLab allows users to use and modify a VR Menu to interact with your scene. This guide will walk you through the setup and use of this feature. Use either a selector/ highlighter tool or your controllers to interact with the menu.
Installation
Locate the following files in the ExampleScripts- 3D Tablet Menu directory:
3D_tablet_menu.py: Example using the GUI and standard VR scenes
3D_tablet_menu_XR.py: Example using the passthrough camera to show menu in AR
VR_Menu.osgb: Required object for the virtual menu functionality
Choose your preferred implementation:
If you want to use the existing example: Copy either script and VR_Menu.osgb to your project directory.
If you prefer to integrate the functionality into your existing script: Copy only the necessary code snippets and VR_Menu.osgb
Basic Setup
If integrating to your own script, add the following code:
# Import the vr_menu and selector modules
from sightlab_utils.vr_menu import VRMenu
from sightlab_utils import selector
#Add functions that will be called from the menu buttons
def Action1():
print('button 1 pressed')
#Define which functions are called with the buttons
actions = [Action1, Action2, Action3, Action4]
vr_menu = VRMenu(actions,tablet_model = 'VR_Menu.osgb',config=sightlab.getConfig())
vr_menu_object = vr_menu.tablet
sightlab.addSceneObject('vr_menu_object', vr_menu_object, grab=True)
# After sightlab.startTrial() or yield viztask.waitEvent(TRIAL_START), add:
vr_menu.experiment_loop()
selector.setupSelector(sightlab.getConfig())
Using the VR Menu
Menu Visibility: Press 'm' key or right thumbstick (controller) to reposition and toggle menu visibility (left trackpad for Vive controllers).
Menu Grabbing: Use either trigger button to grab the menu.
Button Interaction: Use either a selector/ highlighter tool or your controllers to interact with the menu.
- Configuring the Menu
Open the "VR_Menu.osgb" model in Inspector
Select the text for each button and change the "Value" property on the right to change the name of the button
For adding new buttons you will need to scale and move the Main-VR_Menu object in Inspector (using the scale and move tools) to make room, then use Shift and the move tools to make copies of the original button images and button(number)_target objects (the targets are what is used for the sensor). Making sure to place them in the same hierarchy in the tree as the others.
Advanced Configuration
Seated Mode: Add seated=True when initializing JumpToLocations.
More than 4 Buttons: Modify the VR_Menu.osgb file and update the vr_menu initialization:
vr_menu = VRMenu(actions,tablet_model = 'VR_Menu.osgb',config=sightlab.getConfig(), number_of_buttons=5)