NeFT-Net: N-window extended frequency transformer for rhythmic motion prediction
Journal Article
Ademola, A., Sinclair, D., Koniaris, B., Hannah, S., & Mitchell, K. (2025)
NeFT-Net: N-window extended frequency transformer for rhythmic motion prediction. Computers and Graphics, 129, Article 104244. https://doi.org/10.1016/j.cag.2025.104244
Advancements in prediction of human motion sequences are critical for enabling online virtual reality (VR) users to dance and move in ways that accurately mirror real-world ac...
HoloJig: Interactive Spoken Prompt Specified Generative AI Environments
Journal Article
Casas, L., Hannah, S., & Mitchell, K. (online)
HoloJig: Interactive Spoken Prompt Specified Generative AI Environments. IEEE Computer Graphics and Applications, https://doi.org/10.1109/mcg.2025.3553780
HoloJig offers an interactive, speech-to-VR, virtual reality experience that generates diverse environments in real-time based on live spoken descriptions. Unlike traditional ...
Machine learning for animatronic development and optimization
Patent
Mitchell, K., Castellon, J., Bacher, M., McCrory, M., Stolarz, J., & Ayala, A. (2025)
Machine learning for animatronic development and optimization. US12236168B2
Techniques for animatronic design are provided. A plurality of simulated meshes is generated using a physics simulation model, where the plurality of simulated meshes correspo...
Audio Occlusion Experiment Data
Data
McSeveney, S., Tamariz, M., McGregor, I., Koniaris, B., & Mitchell, K. (2025)
Audio Occlusion Experiment Data. [Data]
This dataset comprises anonymous user study participant responses of audio occlusion to investigate presence response of body occlusions in the presence of sound sources in th...
Synchronous Patterned Motion Avatars
Patent
Mitchell, K., Sinclair, D., Koniaris, B., & Ademola, A. (2024)
Synchronous Patterned Motion Avatars
DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences
Presentation / Conference Contribution
Koniaris, B., Sinclair, D., & Mitchell, K. (2024, March)
DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences. Presented at IEEE VR Workshop on Open Access Tools and Libraries for Virtual Reality, Orlando, FL
DanceMark is an open telemetry framework designed for latency-sensitive real-time networked immersive experiences, focusing on online dancing in virtual reality within the Dan...
Method and system for visually seamless grafting of volumetric data
Patent
Mitchell, K. J. (2024)
Method and system for visually seamless grafting of volumetric data
Visually seamless grafting of volumetric data. In some implementations, a method includes obtaining volumetric data that represents a first volume including one or more three-...
Design Considerations of Voice Articulated Generative AI Virtual Reality Dance Environments
Conference Proceeding
Casas, L., Mitchell, K., Tamariz, M., Hannah, S., Sinclair, D., Koniaris, B., & Kennedy, J. (in press)
Design Considerations of Voice Articulated Generative AI Virtual Reality Dance Environments.
We consider practical and social considerations of collaborating verbally with colleagues and friends, not confined by physical distance, but through seamless networked telepr...
Expressive Talking Avatars
Journal Article
Pan, Y., Tan, S., Cheng, S., Lin, Q., Zeng, Z., & Mitchell, K. (2024)
Expressive Talking Avatars. IEEE Transactions on Visualization and Computer Graphics, 30(5), 2538-2548. https://doi.org/10.1109/TVCG.2024.3372047
Stylized avatars are common virtual representations used in VR to support interaction and communication between remote collaborators. However, explicit expressions are notorio...
Augmented Reality Methods and Systems
Patent
Cambra, L. C., & Mitchell, K. (2024)
Augmented Reality Methods and Systems. US11908068
Methods and systems employing augmented reality techniques via real-world objects for various purposes. Computer implemented methods are provided for animated augmentation of ...