Metaverse communications, networking, security, and applications: Research issues, state-of-the-art, and future directions

M Ali, F Naeem, G Kaddoum… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
Metaverse is an evolving orchestrator of the next-generation Internet architecture that
produces an immersive and self-adapting virtual world in which humans perform activities …

Generative novel view synthesis with 3d-aware diffusion models

ER Chan, K Nagano, MA Chan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present a diffusion-based model for 3D-aware generative novel view synthesis from as
few as a single input image. Our model samples from the distribution of possible renderings …

Ide-3d: Interactive disentangled editing for high-resolution 3d-aware portrait synthesis

J Sun, X Wang, Y Shi, L Wang, J Wang… - ACM Transactions on …, 2022 - dl.acm.org
Existing 3D-aware facial generation methods face a dilemma in quality versus editability:
they either generate editable results in low resolution, or high-quality ones with no editing …

The augmented designer: a research agenda for generative AI-enabled design

K Thoring, S Huettemann, RM Mueller - Proceedings of the Design …, 2023 - cambridge.org
Generative AI algorithms that are able to generate creative output are progressing at
tremendous speed. This paper presents a research agenda for Generative AI-based support …

Cc3d: Layout-conditioned generation of compositional 3d scenes

S Bahmani, JJ Park, D Paschalidou… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we introduce CC3D, a conditional generative model that synthesizes complex
3D scenes conditioned on 2D semantic scene layouts, trained using single-view images …

3d generation on imagenet

I Skorokhodov, A Siarohin, Y Xu, J Ren, HY Lee… - arXiv preprint arXiv …, 2023 - arxiv.org
Existing 3D-from-2D generators are typically designed for well-curated single-category
datasets, where all the objects have (approximately) the same scale, 3D location, and …

Unsupervised volumetric animation

A Siarohin, W Menapace… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a novel approach for unsupervised 3D animation of non-rigid deformable
objects. Our method learns the 3D structure and dynamics of objects solely from single-view …

Styleavatar: Real-time photo-realistic portrait avatar from a single video

L Wang, X Zhao, J Sun, Y Zhang, H Zhang… - ACM SIGGRAPH 2023 …, 2023 - dl.acm.org
Face reenactment methods attempt to restore and re-animate portrait videos as realistically
as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN …

VIVE3D: Viewpoint-independent video editing using 3D-aware GANs

A Frühstück, N Sarafianos, Y Xu… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce VIVE3D, a novel approach that extends the capabilities of image-based 3D
GANs to video editing and is able to represent the input video in an identity-preserving and …

Tc4d: Trajectory-conditioned text-to-4d generation

S Bahmani, X Liu, Y Wang, I Skorokhodov… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent techniques for text-to-4D generation synthesize dynamic 3D scenes using
supervision from pre-trained text-to-video models. However, existing representations for …