4D reconstruction

In computer vision and computer graphics, 4D reconstruction is the process of capturing the shape and appearance of real objects along a temporal dimension.[1][2][3][4] This process can be accomplished by methods such as depth camera imaging,[1] photometric stereo, or structure from motion,[5] and is also referred to as spatio-temporal reconstruction.[4]

## Contents

* 1 4D Gaussian splatting
* 2 See also
* 3 References
* 4 External links

## 4D Gaussian splatting

This section is an excerpt from Gaussian splatting § 4D Gaussian Splatting[ edit ]

Extending the concept of 3D Gaussian Splatting, the 4D Gaussian Splatting incorporates a time component, allowing for dynamic scene rendering. It represents and renders dynamic scenes, with a focus on modeling complex motions while maintaining efficiency.[6] The method uses a HexPlane to connect different adjacent Gaussians, providing an accurate representation of position and shape deformations. By utilizing only a single set of canonical 3D Gaussians, and predictive analytics, the 4D Gaussian splatting method models how they move over different timestamps.[7]

Achievements of this technique include real-time rendering on dynamic scenes with high resolutions, while maintaining quality. It showcases potential applications for future developments in film and other media, although there are current limitations regarding the length of motion captured.[7]

## See also

* 3D reconstruction
* Free viewpoint television
* Structure from motion
* Volumetric video

## References

1. ↑ 1.0 1.1 Dou, Mingsong, et al. "Fusion4d: Real-time performance capture of challenging scenes." ACM Transactions on Graphics (TOG) 35.4 (2016): 1-13.
2. ↑ Mustafa, Armin, et al. "Temporally coherent 4d reconstruction of complex dynamic scenes." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016.
3. ↑ Oswald, Martin Ralf, Jan Stühmer, and Daniel Cremers. "Generalized connectivity constraints for spatio-temporal 3d reconstruction." European Conference on Computer Vision. Springer, Cham, 2014.
4. ↑ 4.0 4.1 Dong, Jing, et al. "4D crop monitoring: Spatio-temporal reconstruction for agriculture." 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017.
5. ↑ Kyriakaki, Georgia, et al. "4D reconstruction of tangible cultural heritage objects from web-retrieved images." International Journal of Heritage in the Digital Era 3.2 (2014): 431-451.
6. ↑ Guanjun Wu; Taoran Yi; Jiemin Fang; Lingxi Xie; Xiaopeng Zhang; Wei Wei; Wenyu Liu; Qi Tian; Xinggang Wang (12 Oct 2023). "4D Gaussian Splatting for Real-Time Dynamic Scene Rendering". arXiv:2310.08528 [cs.CV].
7. ↑ 7.0 7.1 Franzen, Carl. "Actors' worst fears come true? New 4D Gaussian splatting method captures human motion". VentureBeat. https://venturebeat.com/ai/actors-worst-fears-come-true-new-4d-gaussian-splatting-method-captures-human-motion.

## External links

* c-Space: 4D Reconstruction from pictures and videos

* v
* t
* e

Computer vision

Categories|

* Datasets
* Digital geometry
* Commercial systems
* Feature detection
* Geometry
* Image sensor technology
* Learning
* Morphology
* Motion analysis
* Noise reduction techniques
* Recognition and categorization
* Research infrastructure
* Researchers
* Segmentation
* Software

Technologies|

* Computer stereo vision
* 3D reconstruction
* 3D reconstruction from multiple images
* Free viewpoint television
* Structure from motion
* Visual hull
* Motion capture

Applications|

* Augmented reality
* Autonomous vehicles
* Face recognition
* Image search
* Optical character recognition
* Remote sensing
* Robots

Main category

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/4D reconstruction. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=4D_reconstruction&oldid=3367176"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template