base on Mitsuba 3: A Retargetable Forward and Inverse Renderer <!-- <img src="https://github.com/mitsuba-renderer/mitsuba3/raw/master/docs/images/logo_plain.png" width="120" height="120" alt="Mitsuba logo"> --> <img src="https://raw.githubusercontent.com/mitsuba-renderer/mitsuba-data/master/docs/images/banners/banner_01.jpg" alt="Mitsuba banner"> # Mitsuba Renderer 3 | Documentation | Tutorial videos | Linux | MacOS | Windows | PyPI | | :---: | :---: | :---: | :---: | :---: | :---: | | [![docs][1]][2]| [![vids][9]][10] | [![rgl-ci][3]][4] | [![rgl-ci][5]][6] | [![rgl-ci][7]][8] | [![pypi][11]][12] | [1]: https://readthedocs.org/projects/mitsuba/badge/?version=stable [2]: https://mitsuba.readthedocs.io/en/stable/ [3]: https://rgl-ci.epfl.ch/app/rest/builds/buildType(id:Mitsuba3_LinuxAmd64Clang10)/statusIcon.svg [4]: https://rgl-ci.epfl.ch/viewType.html?buildTypeId=Mitsuba3_LinuxAmd64Clang10&guest=1 [5]: https://rgl-ci.epfl.ch/app/rest/builds/buildType(id:Mitsuba3_LinuxAmd64gcc9)/statusIcon.svg [6]: https://rgl-ci.epfl.ch/viewType.html?buildTypeId=Mitsuba3_LinuxAmd64gcc9&guest=1 [7]: https://rgl-ci.epfl.ch/app/rest/builds/buildType(id:Mitsuba3_WindowsAmd64msvc2020)/statusIcon.svg [8]: https://rgl-ci.epfl.ch/viewType.html?buildTypeId=Mitsuba3_WindowsAmd64msvc2020&guest=1 [9]: https://img.shields.io/badge/YouTube-View-green?style=plastic&logo=youtube [10]: https://www.youtube.com/watch?v=9Ja9buZx0Cs&list=PLI9y-85z_Po6da-pyTNGTns2n4fhpbLe5&index=1 [11]: https://img.shields.io/pypi/v/mitsuba.svg?color=green [12]: https://pypi.org/pypi/mitsuba ## Introduction Mitsuba 3 is a research-oriented rendering system for forward and inverse light transport simulation developed at [EPFL](https://www.epfl.ch) in Switzerland. It consists of a core library and a set of plugins that implement functionality ranging from materials and light sources to complete rendering algorithms. Mitsuba 3 is *retargetable*: this means that the underlying implementations and data structures can transform to accomplish various different tasks. For example, the same code can simulate both scalar (classic one-ray-at-a-time) RGB transport or differential spectral transport on the GPU. This all builds on [Dr.Jit](https://github.com/mitsuba-renderer/drjit), a specialized *just-in-time* (JIT) compiler developed specifically for this project. ## Main Features - **Cross-platform**: Mitsuba 3 has been tested on Linux (``x86_64``), macOS (``aarch64``, ``x86_64``), and Windows (``x86_64``). - **High performance**: The underlying Dr.Jit compiler fuses rendering code into kernels that achieve state-of-the-art performance using an LLVM backend targeting the CPU and a CUDA/OptiX backend targeting NVIDIA GPUs with ray tracing hardware acceleration. - **Python first**: Mitsuba 3 is deeply integrated with Python. Materials, textures, and even full rendering algorithms can be developed in Python, which the system JIT-compiles (and optionally differentiates) on the fly. This enables the experimentation needed for research in computer graphics and other disciplines. - **Differentiation**: Mitsuba 3 is a differentiable renderer, meaning that it can compute derivatives of the entire simulation with respect to input parameters such as camera pose, geometry, BSDFs, textures, and volumes. It implements recent differentiable rendering algorithms developed at EPFL. - **Spectral & Polarization**: Mitsuba 3 can be used as a monochromatic renderer, RGB-based renderer, or spectral renderer. Each variant can optionally account for the effects of polarization if desired. ## Tutorial videos, documentation We've recorded several [YouTube videos][10] that provide a gentle introduction Mitsuba 3 and Dr.Jit. Beyond this you can find complete Juypter notebooks covering a variety of applications, how-to guides, and reference documentation on [readthedocs][2]. ## Installation We provide pre-compiled binary wheels via PyPI. Installing Mitsuba this way is as simple as running ```bash pip install mitsuba ``` on the command line. The Python package includes thirteen variants by default: - ``scalar_rgb`` - ``scalar_spectral`` - ``scalar_spectral_polarized`` - ``llvm_ad_rgb`` - ``llvm_ad_mono`` - ``llvm_ad_mono_polarized`` - ``llvm_ad_spectral`` - ``llvm_ad_spectral_polarized`` - ``cuda_ad_rgb`` - ``cuda_ad_mono`` - ``cuda_ad_mono_polarized`` - ``cuda_ad_spectral`` - ``cuda_ad_spectral_polarized`` The scalar variants perform one-ray-at-a-time simulations, while the LLVM and CUDA variants can be used for inverse rendering on the CPU or GPU respectively. To access additional variants, you will need to compile a custom version of Dr.Jit using CMake. Please see the [documentation](https://mitsuba.readthedocs.io/en/latest/src/developer_guide/compiling.html) for details on this. ### Requirements - `Python >= 3.8` - (optional) For computation on the GPU: `Nvidia driver >= 495.89` - (optional) For vectorized / parallel computation on the CPU: `LLVM >= 11.1` ## Usage Here is a simple "Hello World" example that shows how simple it is to render a scene using Mitsuba 3 from Python: ```python # Import the library using the alias "mi" import mitsuba as mi # Set the variant of the renderer mi.set_variant('scalar_rgb') # Load a scene scene = mi.load_dict(mi.cornell_box()) # Render the scene img = mi.render(scene) # Write the rendered image to an EXR file mi.Bitmap(img).write('cbox.exr') ``` Tutorials and example notebooks covering a variety of applications can be found in the [documentation][2]. ## About This project was created by [Wenzel Jakob](https://rgl.epfl.ch/people/wjakob). Significant features and/or improvements to the code were contributed by [Sébastien Speierer](https://speierers.github.io/), [Nicolas Roussel](https://github.com/njroussel), [Merlin Nimier-David](https://merlin.nimierdavid.fr/), [Delio Vicini](https://dvicini.github.io/), [Tizian Zeltner](https://tizianzeltner.com/), [Baptiste Nicolet](https://bnicolet.com/), [Miguel Crespo](https://mcrespo.me/), [Vincent Leroy](https://github.com/leroyvn), and [Ziyi Zhang](https://github.com/ziyi-zhang). When using Mitsuba 3 in academic projects, please cite: ```bibtex @software{Mitsuba3, title = {Mitsuba 3 renderer}, author = {Wenzel Jakob and Sébastien Speierer and Nicolas Roussel and Merlin Nimier-David and Delio Vicini and Tizian Zeltner and Baptiste Nicolet and Miguel Crespo and Vincent Leroy and Ziyi Zhang}, note = {https://mitsuba-renderer.org}, version = {3.1.1}, year = 2022 } ``` ", Assign "at most 3 tags" to the expected json: {"id":"12311","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"