FaceMagic: Real-time Facial Detail Effects on Mobile
Conference Proceeding
Casas, L., Li, Y., & Mitchell, K. (2020)
FaceMagic: Real-time Facial Detail Effects on Mobile. In SA '20: SIGGRAPH Asia 2020 Technical Communications. , (1-4). https://doi.org/10.1145/3410700.3425429
We present a novel real-time face detail reconstruction method capable of recovering high quality geometry on consumer mobile devices. Our system firstly uses a morphable mode...
Improving VIP viewer Gaze Estimation and Engagement Using Adaptive Dynamic Anamorphosis
Journal Article
Pan, Y., & Mitchell, K. (2021)
Improving VIP viewer Gaze Estimation and Engagement Using Adaptive Dynamic Anamorphosis. International Journal of Human-Computer Studies, 147, https://doi.org/10.1016/j.ijhcs.2020.102563
Anamorphosis for 2D displays can provide viewer centric perspective viewing, enabling 3D appearance, eye contact and engagement, by adapting dynamically in real time to a sing...
Active Learning for Interactive Audio-Animatronic Performance Design
Journal Article
Castellon, J., Bächer, M., McCrory, M., Ayala, A., Stolarz, J., & Mitchell, K. (2020)
Active Learning for Interactive Audio-Animatronic Performance Design. The Journal of Computer Graphics Techniques, 9(3), 1-19
We present a practical neural computational approach for interactive design of Audio-Animatronic® facial performances. An offline quasi-static reference simulation, driven by ...
Group-Based Expert Walkthroughs: How Immersive Technologies Can Facilitate the Collaborative Authoring of Character Animation
Conference Proceeding
Pan, Y., & Mitchell, K. (2020)
Group-Based Expert Walkthroughs: How Immersive Technologies Can Facilitate the Collaborative Authoring of Character Animation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). , ( 188-195). https://doi.org/10.1109/vrw50115.2020.00041
Immersive technologies have increasingly attracted the attention of the computer animation community in search of more intuitive and effective alternatives to the current soph...
PoseMMR: A Collaborative Mixed Reality Authoring Tool for Character Animation
Conference Proceeding
Pan, Y., & Mitchell, K. (2020)
PoseMMR: A Collaborative Mixed Reality Authoring Tool for Character Animation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). , (759-760). https://doi.org/10.1109/vrw50115.2020.00230
Augmented reality devices enable new approaches for character animation, e.g., given that character posing is three dimensional in nature it follows that interfaces with highe...
Photo-Realistic Facial Details Synthesis from Single Image
Conference Proceeding
Chen, A., Chen, Z., Zhang, G., Zhang, Z., Mitchell, K., & Yu, J. (2019)
Photo-Realistic Facial Details Synthesis from Single Image. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (9429-9439). https://doi.org/10.1109/ICCV.2019.00952
We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression ...
Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses
Journal Article
Casas, L., Fauconneau, M., Kosek, M., Mclister, K., & Mitchell, K. (2019)
Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses. Computers, 8(2), https://doi.org/10.3390/computers8020029
Shadow-retargeting maps depict the appearance of real shadows to virtual shadows given corresponding deformation of scene geometry, such that appearance is seamlessly maintain...
Deep Precomputed Radiance Transfer for Deformable Objects
Journal Article
Li, Y., Wiedemann, P., & Mitchell, K. (2019)
Deep Precomputed Radiance Transfer for Deformable Objects. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2(1), 1-16. https://doi.org/10.1145/3320284
We propose, DeepPRT, a deep convolutional neural network to compactly encapsulate the radiance transfer of a freely deformable object for rasterization in real-time.
With pre...
Feature-preserving detailed 3D face reconstruction from a single image
Conference Proceeding
Li, Y., Ma, L., Fan, H., & Mitchell, K. (2018)
Feature-preserving detailed 3D face reconstruction from a single image. In CVMP '18 Proceedings of the 15th ACM SIGGRAPH European Conference on Visual Media Productionhttps://doi.org/10.1145/3278471.3278473
Dense 3D face reconstruction plays a fundamental role in visual media production involving digital actors. We improve upon high fidelity reconstruction from a single 2D photo ...
Multi-reality games: an experience across the entire reality-virtuality continuum
Conference Proceeding
Casas, L., Ciccone, L., Çimen, G., Wiedemann, P., Fauconneau, M., Sumner, R. W., & Mitchell, K. (2018)
Multi-reality games: an experience across the entire reality-virtuality continuum. In Proceedings of the VRCAI2018https://doi.org/10.1145/3284398.3284411
Interactive play can take very different forms, from playing with physical board games to fully digital video games. In recent years, new video game paradigms were introduced ...