XR Projects

ZIAScope

A VR application combining language models with computer vision so users can explore virtual environments through natural language instead of traditional controls. Design Mode lets users quickly alter the appearance of an uploaded 3D scene for rapid, hands-free design iteration; Navigation Mode describes large scenes and makes travel around them easy. Built with Unity, the Gemini API, OpenAI Whisper, and LLaVA.