Photo-Realistic Facial Details Synthesis from Single Image
Conference Proceeding
Chen, A., Chen, Z., Zhang, G., Zhang, Z., Mitchell, K., & Yu, J. (2019)
Photo-Realistic Facial Details Synthesis from Single Image. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (9429-9439). https://doi.org/10.1109/ICCV.2019.00952
We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression ...
Real-time rendering with compressed animated light fields.
Conference Proceeding
Koniaris, B., Kosek, M., Sinclair, D., & Mitchell, K. (2017)
Real-time rendering with compressed animated light fields. In GI '17 Proceedings of the 43rd Graphics Interface Conference. , (33-40). https://doi.org/10.20380/GI2017.05
We propose an end-to-end solution for presenting movie quality animated graphics to the user while still allowing the sense of presence afforded by free viewpoint head motion....
Rapid one-shot acquisition of dynamic VR avatars
Conference Proceeding
Malleson, C., Kosek, M., Klaudiny, M., Huerta, I., Bazin, J., Sorkine-Hornung, A., …Mitchell, K. (2017)
Rapid one-shot acquisition of dynamic VR avatars. In IEEE 2017 Virtual Reality (VR). https://doi.org/10.1109/vr.2017.7892240
We present a system for rapid acquisition of bespoke, animatable, full-body avatars including face texture and shape. A blendshape rig with a skeleton is used as a template fo...
Synthetic Prior Design for Real-Time Face Tracking
Conference Proceeding
McDonagh, S., Klaudiny, M., Bradley, D., Beeler, T., Matthews, I., & Mitchell, K. (2016)
Synthetic Prior Design for Real-Time Face Tracking. In 2016 Fourth International Conference on 3D Vision (3DV),. https://doi.org/10.1109/3dv.2016.72
Real-time facial performance capture has recently been gaining popularity in virtual film production, driven by advances in machine learning, which allows for fast inference o...
Real-time Physics-based Motion Capture with Sparse Sensors
Conference Proceeding
Andrews, S., Huerta, I., Komura, T., Sigal, L., & Mitchell, K. (2016)
Real-time Physics-based Motion Capture with Sparse Sensors. In Proceedings of the 13th European Conference on Visual Media Production (CVMP 2016)https://doi.org/10.1145/2998559.2998564
We propose a framework for real-time tracking of humans using sparse multi-modal sensor sets, including data obtained from optical markers and inertial measurement units. A sm...
Stereohaptics: a haptic interaction toolkit for tangible virtual experiences
Conference Proceeding
Israr, A., Zhao, S., McIntosh, K., Schwemler, Z., Fritz, A., Mars, J., …Mitchell, K. (2016)
Stereohaptics: a haptic interaction toolkit for tangible virtual experiences. In SIGGRAPH '16: ACM SIGGRAPH 2016 Studio. https://doi.org/10.1145/2929484.2970273
With a recent rise in the availability of affordable head mounted gear sets, various sensory stimulations (e.g., visual, auditory and haptics) are integrated to provide seamle...
IRIDiuM: immersive rendered interactive deep media
Conference Proceeding
Koniaris, B., Israr, A., Mitchell, K., Huerta, I., Kosek, M., Darragh, K., …Moon, B. (2016)
IRIDiuM: immersive rendered interactive deep media. https://doi.org/10.1145/2929490.2929496
Compelling virtual reality experiences require high quality imagery as well as head motion with six degrees of freedom. Most existing systems limit the motion of the viewer (p...
User, metric, and computational evaluation of foveated rendering methods
Conference Proceeding
Swafford, N. T., Iglesias-Guitian, J. A., Koniaris, C., Moon, B., Cosker, D., & Mitchell, K. (2016)
User, metric, and computational evaluation of foveated rendering methods. In SAP '16 Proceedings of the ACM Symposium on Applied Perception. https://doi.org/10.1145/2931002.2931011
Perceptually lossless foveated rendering methods exploit human perception by selectively rendering at different quality levels based on eye gaze (at a lower computational cost...
Online view sampling for estimating depth from light fields
Conference Proceeding
Kim, C., Subr, K., Mitchell, K., Sorkine-Hornung, A., & Gross, M. (2015)
Online view sampling for estimating depth from light fields. In 2015 IEEE International Conference on Image Processing (ICIP)https://doi.org/10.1109/icip.2015.7350981
Geometric information such as depth obtained from light fields
finds more applications recently. Where and how to sample
images to populate a light field is an important probl...
Latency aware foveated rendering in unreal engine 4
Conference Proceeding
Swafford, N. T., Cosker, D., & Mitchell, K. (2015)
Latency aware foveated rendering in unreal engine 4. In CVMP '15 Proceedings of the 12th European Conference on Visual Media Productionhttps://doi.org/10.1145/2824840.2824863
We contribute a foveated rendering implementation in Unreal Engine 4 (UE4) and a straight-forward metric to allow calculation of rendered foveal region sizes to compensate for...