Multimodal Emotion Recognition & VIRI
What can a computer learn about emotion from more than one signal? My doctoral research combined speech with visible and infrared facial imagery and led to the VIRI database.
I enjoy the process of turning a question into something I can try, build, and learn from. Here are a few examples from research collaborations and projects developed with students.
From understanding emotion to creating immersive learning environments, these projects reflect different paths that curiosity can take.
What can a computer learn about emotion from more than one signal? My doctoral research combined speech with visible and infrared facial imagery and led to the VIRI database.
An augmented-reality approach to exploring molecular structures and scientific ideas in three dimensions, developed with students in the context of computational materials science education.
Exploring how language models and retrieval-based systems could support rural nurse practitioners. The work combines a needs assessment with early decision-support prototypes.
A student-led interdisciplinary project connecting a Meta Quest 3 interface to a six-axis robotic arm. A hands-on experiment in translating virtual interactions into physical movement.
A student team developed a network of environmental sensors and a web dashboard to observe rainfall, water levels, and related conditions at a rainwater-harvesting site.
Exploring whether interactive three-dimensional environments can help students understand abstract mathematical ideas, including solids of revolution, through hands-on visualization.
These project-specific illustrations are conceptual, not photographs of the actual systems. I plan to replace them with photographs, screenshots, demonstrations, and links as the individual project pages take shape.
Explore my research interests →