Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Filters








151 Hits in 5.5 sec

Weakly-Supervised Multi-Face 3D Reconstruction [article]

Jialiang Zhang, Lixiang Lin, Jianke Zhu, Steven C.H. Hoi
2021 arXiv   pre-print
The de-facto pipeline for estimating the parametric face model from an image requires to firstly detect the facial regions with landmarks, and then crop each face to feed the deep learning-based regressor  ...  More importantly, we employ the same global camera model for the reconstructed faces in each image, which makes it possible to recover the relative head positions and orientations in the 3D scene.  ...  With the prevalence of deep learning, 3D face reconstruction from a single image becomes promising, in which the deep models are learned without 3D labels in the unsupervised or weakly-supervised fashion  ... 
arXiv:2101.02000v1 fatcat:hstsoyvc75ew7pk5salpxpy3vq

3D Face Reconstruction from A Single Image Assisted by 2D Face Images in the Wild [article]

Xiaoguang Tu, Jian Zhao, Zihang Jiang, Yao Luo, Mei Xie, Yang Zhao, Linxiao He, Zheng Ma, Jiashi Feng
2020 arXiv   pre-print
Recent methods typically aim to learn a CNN-based 3D face model that regresses coefficients of 3D Morphable Model (3DMM) from 2D images to render 3D face reconstruction or dense face alignment.  ...  3D face model learning.  ...  Conclusion In this paper, we propose a novel 2D-Assisted Selfsupervised Learning (2DASL) method for 3D face reconstruction and dense face alignment based on the 3D Morphable face Model.  ... 
arXiv:1903.09359v2 fatcat:36qg3p4rine2fp2464j6jh2cni

Nonlinear 3D Face Morphable Model [article]

Luan Tran, Xiaoming Liu
2018 arXiv   pre-print
As a classic statistical model of 3D facial shape and texture, 3D Morphable Model (3DMM) is widely used in facial analysis, e.g., model fitting, image synthesis.  ...  To address these problems, this paper proposes an innovative framework to learn a nonlinear 3DMM model from a large set of unconstrained face images, without collecting 3D face scans.  ...  Figure 1 : 1 Conventional 3DMM employs linear bases models for Figure 2 : 2 Jointly learning a nonlinear 3DMM and its fitting algorithm from unconstrained 2D face images, in a weakly supervised fashion  ... 
arXiv:1804.03786v3 fatcat:xxrfugvfcrgrvmhnbw6h7lfoo4

From 2D Images to 3D Model:Weakly Supervised Multi-View Face Reconstruction with Deep Fusion [article]

Weiguang Zhao and Chaolong Yang and Jianan Ye and Rui Zhang and Yuyao Yan and Xi Yang and Bin Dong and Amir Hussain and Kaizhu Huang
2024 arXiv   pre-print
While weakly supervised multi-view face reconstruction (MVR) is garnering increased attention, one critical issue still remains open: how to effectively fuse multiple image information to reconstruct high-precision  ...  Without 3D annotation, DF-MVR achieves 5.2% and 3.0% RMSE improvement over the existing weakly supervised MVRs respectively on Pixel-Face and Bosphorus dataset.  ...  Surprisingly, there are few multi-view 3D face reconstruction methods based on weakly supervised machine learning in the literature.  ... 
arXiv:2204.03842v4 fatcat:5xvljq24njevjeyedpxmusduvq

Hybrid Approach for 3D Head Reconstruction: Using Neural Networks and Visual Geometry [article]

Oussema Bouafif, Bogdan Khomutenko, Mohamed Daoudi
2021 arXiv   pre-print
In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s) using a hybrid approach based on deep learning and geometric techniques.  ...  Landmarks are used for the pose computation and the initialization of the optimization problem, which, in turn, reconstructs the 3D head geometry by using a parametric morphable model and normal vector  ...  A novel deep 3D face reconstruction approach in [24] uses a hybrid loss function for weakly-supervised learning. More recently, Wang et al.  ... 
arXiv:2104.13710v1 fatcat:wg3dvn2lwnd47hh6idbj5eio6y

Dense 3D Face Decoding over 2500FPS: Joint Texture & Shape Convolutional Mesh Decoders [article]

Yuxiang Zhou, Jiankang Deng, Irene Kotsia, Stefanos Zafeiriou
2019 arXiv   pre-print
3D Morphable Models (3DMMs) are statistical models that represent facial texture and shape variations using a set of linear bases and more particular Principal Component Analysis (PCA). 3DMMs were used  ...  as statistical priors for reconstructing 3D faces from images by solving non-linear least square optimization problems.  ...  Face Reconstruction We first qualitatively compare our approach with five recent state-of-the-art 3D face reconstruction methods: (1) 3DMM fitting networks learned in a supervised way (Sela et al  ... 
arXiv:1904.03525v1 fatcat:5jclnx5xdfek7aotmsny6clqyy

Hybrid Approach for 3D Head Reconstruction: Using Neural Networks and Visual Geometry

Oussema Bouafif, Bogdan Khomutenko, Mohamed Daoudi
2021 2020 25th International Conference on Pattern Recognition (ICPR)  
In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s) using a hybrid approach based on deep learning and geometric techniques.  ...  Landmarks are used for the pose computation and the initialization of the optimization problem, which, in turn, reconstructs the 3D head geometry by using a parametric morphable model and normal vector  ...  A novel deep 3D face reconstruction approach in [24] uses a hybrid loss function for weakly-supervised learning. More recently, Wang et al.  ... 
doi:10.1109/icpr48806.2021.9412782 fatcat:qdbv6wi7djav5eyo5lnlricxou

Fast 3D Face Reconstruction from a Single Image Using Different Deep Learning Approaches for Facial Palsy Patients

Duc-Phong Nguyen, Tan-Nhu Nguyen, Stéphanie Dakpé, Marie-Christine Ho Ba Ho Ba Tho, Tien-Tuan Dao
2022 Bioengineering  
The recent development of deep learning (DL) models opens new challenges for 3D shape reconstruction from a single image.  ...  Before using the procedure to reconstruct the 3D faces of patients with facial palsy or other facial disorders, several ideas for increasing the accuracy of the reconstruction can be discussed based on  ...  The third applied method reconstructs the 3D face of the patient with weakly-supervised learning to regress the shape and texture coefficients from a given input image [53] .  ... 
doi:10.3390/bioengineering9110619 pmid:36354529 pmcid:PMC9687570 fatcat:zairlomkp5ei3ojttwyr6wtk3u

Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set [article]

Yu Deng, Jiaolong Yang, Sicheng Xu, Dong Chen, Yunde Jia, Xin Tong
2020 arXiv   pre-print
In this paper, we propose a novel deep 3D face reconstruction approach that 1) leverages a robust, hybrid loss function for weakly-supervised learning which takes into account both low-level and perception-level  ...  Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data  ...  Our goal in this paper is to obtain accurate 3D face reconstruction with weakly-supervised learning.  ... 
arXiv:1903.08527v2 fatcat:nwscyixadfeqlktsv4vjyiqzpa

Dense 3D Face Decoding Over 2500FPS: Joint Texture & Shape Convolutional Mesh Decoders

Yuxiang Zhou, Jiankang Deng, Irene Kotsia, Stefanos Zafeiriou
2019 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  
2019) Dense 3D face decoding over 2500FPS: Joint texture and shape convolutional mesh decoders.  ...  Face Reconstruction We first qualitatively compare our approach with five recent state-of-the-art 3D face reconstruction methods: (1) 3DMM fitting networks learned in a supervised way (Sela et al  ...  Methods based on 3DMMs are still among the state-of-the-art for 3D face reconstruction, even from images captured in-the-wild [6, 4, 5] .  ... 
doi:10.1109/cvpr.2019.00119 dblp:conf/cvpr/ZhouDKZ19 fatcat:rtekvvjtd5bvtcahlx3anjmgpi

Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set

Yu Deng, Jiaolong Yang, Sicheng Xu, Dong Chen, Yunde Jia, Xin Tong
2019 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)  
Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.  ...  In this paper, we propose a novel deep 3D face reconstruction approach that 1) leverages a robust, hybrid loss function for weakly-supervised learning which takes into account both low-level and perception-level  ...  Our goal in this paper is to obtain accurate 3D face reconstruction with weakly-supervised learning.  ... 
doi:10.1109/cvprw.2019.00038 dblp:conf/cvpr/DengYX0JT19 fatcat:xcfulxaqfjafjlwoasjlcxw5r4

3D Face Modeling From Diverse Raw Scan Data [article]

Feng Liu, Luan Tran, Xiaoming Liu
2019 arXiv   pre-print
Further, we propose a weakly supervised learning approach that does not require correspondence label for the scans.  ...  Traditional 3D face models learn a latent representation of faces using linear subspaces from limited scans of a single database.  ...  In summary, the contributions of this work include: We propose a new encoder-decoder framework that for the first time jointly learns face models directly from raw We devise a weakly-supervised learning  ... 
arXiv:1902.04943v3 fatcat:sog6ywiglvhvbecqbq6lymzkse

Sphere Face Model:A 3D Morphable Model with Hypersphere Manifold Latent Space [article]

Diqiong Jiang, Yiwei Jin, Fanglue Zhang, Zhe Zhu, Yun Zhang, Ruofeng Tong, Min Tang
2021 arXiv   pre-print
3D Morphable Models (3DMMs) are generative models for face shape and appearance.  ...  The core of our SFM is the basis matrix which can be used to reconstruct 3D face shapes, and the basic matrix is learned by adopting a two-stage training approach where 3D and 2D training data are used  ...  In Proceedings of the IEEE Conference curate 3d face reconstruction with weakly-supervised learn- on Computer Vision and Pattern Recognition, pages 5216– ing: From single image to image  ... 
arXiv:2112.02238v1 fatcat:bjeqwk3pcjfhbouwqrp4twu6zi

Towards High-fidelity Nonlinear 3D Face Morphable Model [article]

Luan Tran, Feng Liu, Xiaoming Liu
2019 arXiv   pre-print
As a result, our model achieves state-of-the-art performance on 3D face reconstruction by solely optimizing latent representations.  ...  By improving the nonlinear 3D morphable model in both learning objective and network architecture, we present a model which is superior in capturing higher level of details than the linear or its precedent  ...  To better handle the ambiguity, one must rely on additional prior assumptions, such as constraining faces to lie in a restricted subspace, e.g., 3D Morphable Models (3DMM) [6] learned from a small 3D  ... 
arXiv:1904.04933v1 fatcat:g4sip656jfax3lxjbvo6pqljjq

Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks [article]

Jiangke Lin, Yi Yuan, Tianjia Shao, Kun Zhou
2020 arXiv   pre-print
3D Morphable Model (3DMM) based methods have achieved great success in recovering 3D face shapes from single-view images.  ...  In this paper, we introduce a method to reconstruct 3D facial shapes with high-fidelity textures from single-view images in-the-wild, without the need to capture a large-scale face texture database.  ...  Related Work Morphable 3D Face Models Blanz and Vetter [3] introduced the first 3D morphable face model twenty years ago.  ... 
arXiv:2003.05653v3 fatcat:pc6fsavlmzamvmaxt2ocw4tgra
« Previous Showing results 1 — 15 out of 151 results