L3V: A Layered Video Format for 3D Display
Conference Proceeding
Mitchell, K., Sinclair, D., Kosek, M., & Swaford, N. (2014)
L3V: A Layered Video Format for 3D Display
We present a layered video format for 3D interactive display which adapts and exploits well-developed 2D codecs with layer centric packing for real-time user perspective playb...
Active Learning for Interactive Audio-Animatronic Performance Design
Journal Article
Castellon, J., Bächer, M., McCrory, M., Ayala, A., Stolarz, J., & Mitchell, K. (2020)
Active Learning for Interactive Audio-Animatronic Performance Design. The Journal of Computer Graphics Techniques, 9(3), 1-19
We present a practical neural computational approach for interactive design of Audio-Animatronic® facial performances. An offline quasi-static reference simulation, driven by ...
Deep Precomputed Radiance Transfer for Deformable Objects
Journal Article
Li, Y., Wiedemann, P., & Mitchell, K. (2019)
Deep Precomputed Radiance Transfer for Deformable Objects. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2(1), 1-16. https://doi.org/10.1145/3320284
We propose, DeepPRT, a deep convolutional neural network to compactly encapsulate the radiance transfer of a freely deformable object for rasterization in real-time.
With pre...
Synthetic Prior Design for Real-Time Face Tracking
Conference Proceeding
McDonagh, S., Klaudiny, M., Bradley, D., Beeler, T., Matthews, I., & Mitchell, K. (2016)
Synthetic Prior Design for Real-Time Face Tracking. In 2016 Fourth International Conference on 3D Vision (3DV),. https://doi.org/10.1109/3dv.2016.72
Real-time facial performance capture has recently been gaining popularity in virtual film production, driven by advances in machine learning, which allows for fast inference o...
Online view sampling for estimating depth from light fields
Conference Proceeding
Kim, C., Subr, K., Mitchell, K., Sorkine-Hornung, A., & Gross, M. (2015)
Online view sampling for estimating depth from light fields. In 2015 IEEE International Conference on Image Processing (ICIP)https://doi.org/10.1109/icip.2015.7350981
Geometric information such as depth obtained from light fields
finds more applications recently. Where and how to sample
images to populate a light field is an important probl...
Nonlinearly Weighted First-order Regression for Denoising Monte Carlo Renderings
Journal Article
Bitterli, B., Rousselle, F., Moon, B., Iglesias-Guitián, J. A., Adler, D., Mitchell, K., …Novák, J. (2016)
Nonlinearly Weighted First-order Regression for Denoising Monte Carlo Renderings. Computer Graphics Forum, 35(4), 107-117. https://doi.org/10.1111/cgf.12954
We address the problem of denoising Monte Carlo renderings by studying existing approaches and proposing a new algorithm that yields state-of-the-art performance on a wide ran...
Augmented creativity: bridging the real and virtual worlds to enhance creative play
Conference Proceeding
Zünd, F., Ryffel, M., Magnenat, S., Marra, A., Nitti, M., Kapadia, M., …Sumner, R. W. (2015)
Augmented creativity: bridging the real and virtual worlds to enhance creative play. In SA '15 SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applicationshttps://doi.org/10.1145/2818427.2818460
Augmented Reality (AR) holds unique and promising potential to bridge between real-world activities and digital experiences, allowing users to engage their imagination and boo...
Image Based Proximate Shadow Retargeting
Conference Proceeding
Casas, L., Fauconneau, M., Kosek, M., Mclister, K., & Mitchell, K. (2018)
Image Based Proximate Shadow Retargeting. In Proceedings of Computer Graphics & Visual Computing (CGVC) 2018https://doi.org/10.2312/cgvc.20181206
We introduce Shadow Retargeting which maps real shadow appearance to virtual shadows given a corresponding deformation of scene geometry, such that appearance is seamlessly ma...
Real-time Physics-based Motion Capture with Sparse Sensors
Conference Proceeding
Andrews, S., Huerta, I., Komura, T., Sigal, L., & Mitchell, K. (2016)
Real-time Physics-based Motion Capture with Sparse Sensors. In Proceedings of the 13th European Conference on Visual Media Production (CVMP 2016)https://doi.org/10.1145/2998559.2998564
We propose a framework for real-time tracking of humans using sparse multi-modal sensor sets, including data obtained from optical markers and inertial measurement units. A sm...
Adaptive rendering with linear predictions
Journal Article
Moon, B., Iglesias-Guitian, J. A., Yoon, S., & Mitchell, K. (2015)
Adaptive rendering with linear predictions. ACM transactions on graphics, 34(4), 121:1-121:11. https://doi.org/10.1145/2766992
We propose a new adaptive rendering algorithm that enhances the
performance of Monte Carlo ray tracing by reducing the noise, i.e.,
variance, while preserving a variety of hig...