Real-Time Hand-Tracking Interaction with GPU-Based Smoothed Particle Hydrodynamics Fluid in Virtual Reality
This project explores the interaction of real-time hand tracking with GPU-based Smoothed Particle Hydrodynamics (SPH) fluid simulation in a virtual reality (VR) environment. Using the SPH particle method, we simulated dynamic fluid behaviors such as splashing and merging, enhancing the realism and interactivity of virtual fluids.
Our implementation uses Unity and the Meta XR All-in-One SDK for VR development, ensuring efficient simulation and rendering through GPU compute shaders. On Meta Quest 3, users can naturally interact with virtual fluids via hand-tracking. Although high frame rates were only achieved with up to 50,000 particles, future work will focus on improving model efficiency and enhancing interaction realism by introducing tangential forces and surface tension.
- Real-time hand tracking
- GPU-based SPH fluid simulation
- Dynamic fluid behaviors (splashing, merging)
- VR environment using Unity and Meta XR All-in-One SDK
- Interaction with virtual fluids on Meta Quest 3
Watch the demo video here.
- Unity 2022.3.23f1
- Meta XR All-in-One SDK Version 64.0.0
- GPU compute shaders
- Clone the repository.
git clone https://github.com/your-username/your-repo-name.git