{"name":"VGGT: Visual Geometry Grounded Transformer for Rapid 3D Scene Reconstruction","description":"VGGT, the recipient of the CVPR 2025 Best Paper Award, is a Visual Geometry Grounded Transformer developed by Facebook AI and the Visual Geometry Group at Oxford. This innovative feed-forward neural network efficiently infers key 3D scene attributes, including camera parameters, depth maps, and 3D point tracks, from single or multiple images within seconds. It offers a powerful solution for rapid 3D reconstruction and scene understanding.","github":"https://github.com/facebookresearch/vggt","url":"https://osrepos.com/repo/facebookresearch-vggt","source":"osrepos.com","sourceDescription":"This repository profile is provided by osrepos.com, an open source repository discovery platform.","repositoryProfile":"https://osrepos.com/repo/facebookresearch-vggt","generatedFor":"open source discovery and AI-assisted research","markdown":"https://osrepos.com/repo/facebookresearch-vggt.md","json":"https://osrepos.com/repo/facebookresearch-vggt.json","topics":["Python","Computer Vision","3D Reconstruction","Transformer","Deep Learning","AI","CVPR"],"keywords":["Python","Computer Vision","3D Reconstruction","Transformer","Deep Learning","AI","CVPR"],"stars":null,"summary":"VGGT, the recipient of the CVPR 2025 Best Paper Award, is a Visual Geometry Grounded Transformer developed by Facebook AI and the Visual Geometry Group at Oxford. This innovative feed-forward neural network efficiently infers key 3D scene attributes, including camera parameters, depth maps, and 3D point tracks, from single or multiple images within seconds. It offers a powerful solution for rapid 3D reconstruction and scene understanding.","content":"## Introduction\n\nVGGT, the Visual Geometry Grounded Transformer, is an innovative feed-forward neural network developed by Facebook AI and the Visual Geometry Group at Oxford. Recognized with the prestigious CVPR 2025 Best Paper Award, VGGT is designed to directly infer all key 3D attributes of a scene, including extrinsic and intrinsic camera parameters, point maps, depth maps, and 3D point tracks. It achieves this remarkable feat from one, a few, or hundreds of views, all within seconds. The project recently updated its licensing to permit commercial use for a specific checkpoint, VGGT-1B-Commercial, making it accessible for a wider range of applications.\n\n## Installation\n\nTo get started with VGGT, clone the repository and install the necessary dependencies. Ensure you have `torch`, `torchvision`, `numpy`, `Pillow`, and `huggingface_hub` installed.\n\nbash\ngit clone https://github.com/facebookresearch/vggt.git\ncd vggt\npip install -r requirements.txt\n\n\nAlternatively, VGGT can be installed as a Python package. Refer to the official documentation for detailed instructions on package installation.\n\n## Examples\n\nUsing VGGT is straightforward. The model automatically downloads pretrained weights upon its first run. Here’s a quick example to predict 3D attributes from a set of images:\n\npython\nimport torch\nfrom vggt.models.vggt import VGGT\nfrom vggt.utils.load_fn import load_and_preprocess_images\n\ndevice = \"cuda\" if torch.cuda.is_available() else \"cpu\"\ndtype = torch.bfloat16 if torch.cuda.get_device_capability()[0] >= 8 else torch.float16\n\n# Initialize the model and load the pretrained weights.\nmodel = VGGT.from_pretrained(\"facebook/VGGT-1B\").to(device)\n\n# Load and preprocess example images (replace with your own image paths)\nimage_names = [\"path/to/imageA.png\", \"path/to/imageB.png\", \"path/to/imageC.png\"]  \nimages = load_and_preprocess_images(image_names).to(device)\n\nwith torch.no_grad():\n    with torch.cuda.amp.autocast(dtype=dtype):\n        # Predict attributes including cameras, depth maps, and point maps.\n        predictions = model(images)\n\n\nVGGT also offers detailed usage for specific branches (camera, depth, point, track heads), interactive 3D visualization demos (Gradio and Viser), and the ability to export predictions to COLMAP format, which can then be used for Gaussian Splatting training. It also demonstrates surprisingly strong zero-shot single-view reconstruction capabilities.\n\n## Why Use VGGT\n\nVGGT stands out for several compelling reasons:\n*   **Rapid 3D Reconstruction:** It infers complex 3D scene attributes within seconds, significantly faster than many traditional methods.\n*   **Comprehensive Output:** The model provides a full suite of 3D data, including camera parameters, depth maps, point maps, and 3D point tracks.\n*   **Versatile Input:** It effectively processes scenes from a single image, a few images, or hundreds of views.\n*   **Award-Winning Research:** Recognized with the CVPR 2025 Best Paper Award, highlighting its groundbreaking contributions to computer vision.\n*   **Seamless Integration:** Supports direct export to COLMAP format, enabling easy integration with other 3D reconstruction and rendering pipelines like Gaussian Splatting.\n*   **Strong Zero-Shot Performance:** Achieves competitive results in single-view reconstruction without explicit training for this task.\n*   **Commercial Use License:** A dedicated checkpoint, VGGT-1B-Commercial, is available under a commercial-friendly license, expanding its applicability for businesses and developers.\n\n## Links\n\n*   **GitHub Repository:** [https://github.com/facebookresearch/vggt](https://github.com/facebookresearch/vggt){target=\"_blank\"}\n*   **Paper PDF:** [https://jytime.github.io/data/VGGT_CVPR25.pdf](https://jytime.github.io/data/VGGT_CVPR25.pdf){target=\"_blank\"}\n*   **arXiv:** [https://arxiv.org/abs/2503.11651](https://arxiv.org/abs/2503.11651){target=\"_blank\"}\n*   **Project Page:** [https://vgg-t.github.io/](https://vgg-t.github.io/){target=\"_blank\"}\n*   **Hugging Face Demo:** [https://huggingface.co/spaces/facebook/vggt](https://huggingface.co/spaces/facebook/vggt){target=\"_blank\"}\n*   **Commercial Checkpoint:** [https://huggingface.co/facebook/VGGT-1B-Commercial](https://huggingface.co/facebook/VGGT-1B-Commercial){target=\"_blank\"}","metrics":{"detailViews":10,"githubClicks":8},"dates":{"published":null,"modified":"2025-12-10T20:00:54.000Z"}}