9 results

Design Considerations of Voice Articulated Generative AI Virtual Reality Dance Environments

Conference Proceeding
Casas, L., Mitchell, K., Tamariz, M., Hannah, S., Sinclair, D., Koniaris, B., & Kennedy, J. (in press)
Design Considerations of Voice Articulated Generative AI Virtual Reality Dance Environments.
We consider practical and social considerations of collaborating verbally with colleagues and friends, not confined by physical distance, but through seamless networked telepr...

Expressive Talking Avatars

Journal Article
Pan, Y., Tan, S., Cheng, S., Lin, Q., Zeng, Z., & Mitchell, K. (2024)
Expressive Talking Avatars. IEEE Transactions on Visualization and Computer Graphics, 30(5), 2538-2548. https://doi.org/10.1109/TVCG.2024.3372047
Stylized avatars are common virtual representations used in VR to support interaction and communication between remote collaborators. However, explicit expressions are notorio...

DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences

Conference Proceeding
Koniaris, B., Sinclair, D., & Mitchell, K. (in press)
DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences.
DanceMark is an open telemetry framework designed for latency-sensitive real-time networked immersive experiences, focusing on online dancing in virtual reality within the Dan...

MoodFlow: Orchestrating Conversations with Emotionally Intelligent Avatars in Mixed Reality

Conference Proceeding
Casas, L., Hannah, S., & Mitchell, K. (in press)
MoodFlow: Orchestrating Conversations with Emotionally Intelligent Avatars in Mixed Reality.
MoodFlow presents a novel approach at the intersection of mixed reality and conversational artificial intelligence for emotionally intelligent avatars. Through a state machine...

Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics

Conference Proceeding
Pan, Y., Zhang, R., Wang, J., Ding, Y., & Mitchell, K. (2023)
Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics. In MM '23: Proceedings of the 31st ACM International Conference on Multimedia (6851-6859). https://doi.org/10.1145/3581783.3613803
Our aim is to improve animation production techniques' efficiency and effectiveness. We present two real-time solutions which drive character expressions in a geometrically co...

Intermediated Reality with an AI 3D Printed Character

Conference Proceeding
Casas, L., & Mitchell, K. (2023)
Intermediated Reality with an AI 3D Printed Character. In SIGGRAPH '23: ACM SIGGRAPH 2023 Real-Time Live!. https://doi.org/10.1145/3588430.3597251
We introduce live character conversational interactions in Intermediated Reality to bring real-world objects to life in Augmented Reality (AR) and Artificial Intelligence (AI)...

Generating real-time detailed ground visualisations from sparse aerial point clouds

Conference Proceeding
Murray, A., Mitchell, S., Bradley, A., Waite, E., Ross, C., Jamrozy, J., & Mitchell, K. (in press)
Generating real-time detailed ground visualisations from sparse aerial point clouds.
Our new scheme provides a both texture-less and mesh-less framework, which affords memory efficient, flexible level of detail and visibility optimizations for rendering scener...

MienCap: Performance-based Facial Animation with Live Mood Dynamics

Conference Proceeding
Pan, Y., Zhang, R., Wang, J., Chen, N., Qiu, Y., Ding, Y., & Mitchell, K. (2022)
MienCap: Performance-based Facial Animation with Live Mood Dynamics. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (645-646). https://doi.org/10.1109/vrw55335.2022.00178
Our purpose is to improve performance-based animation which can drive believable 3D stylized characters that are truly perceptual. By combining traditional blendshape animatio...

Collimated Whole Volume Light Scattering in Homogeneous Finite Media

Journal Article
Velinov, Z., & Mitchell, K. (in press)
Collimated Whole Volume Light Scattering in Homogeneous Finite Media. IEEE Transactions on Visualization and Computer Graphics, https://doi.org/10.1109/TVCG.2021.3135764
Crepuscular rays form when light encounters an optically thick or opaque medium which masks out portions of the visible scene. Real-time applications commonly estimate this ph...