base on Cryptic Cabinet is a short Mixed Reality (MR) experience for Meta Quest headsets. It will demonstrate the possibilities of MR through gameplay, narrative, and aesthetics. The app adapts to your room (big or small) to create a unique experience for everyone.  # Cryptic Cabinet Cryptic Cabinet is a Mixed Reality (MR) escape room game that demonstrates creating mixed reality multiplayer experiences adaptable to various room sizes. This codebase serves as a reference and template for MR projects. You can test the game on the [Meta Horizon Store](https://www.meta.com/experiences/cryptic-cabinet/6858450927578454/). ## Project Description This project showcases Scene API, Passthrough, Shared Spatial Anchors, Colocation, Interaction SDK, and Passthrough Styling in a multiplayer escape room experience. Built using the [Unity engine](https://unity.com/) with Unity 6000.0.50f1 and [Photon Fusion](https://doc.photonengine.com/fusion/current/fusion-intro) for networking, it demonstrates how the app adapts to the physical environment through capabilities like Scene understanding, real-time multiplayer collaboration, and dynamic content placement. ## How to Run the Project in Unity 1. [Configure the project](./Documentation/ProjectConfiguration.md) with Meta Quest and Photon. 2. Use *Unity 6000.0.50f1* or newer. 3. Load the [Assets/CrypticCabinet/Scenes/MainScene.unity](./Assets/CrypticCabinet/Scenes/MainScene.unity) scene. 4. To test in the Editor, use Quest Link: <details> <summary><b>Quest Link</b></summary> - In the Oculus desktop app, navigate to Settings -> Beta and enable: - Developer runtime features - Pass-through over Oculus Link - Share point cloud over Oculus Link - Enable Quest Link: - Put on your headset, go to "Quick Settings", and select "Quest Link" (or "Quest Air Link" if using Air Link). - Select your desktop from the list, then select "Launch". This opens the Quest Link app, allowing desktop control from your headset. - With the headset on, select "Desktop" from the control panel in front of you. You should see your desktop in VR. - Navigate to Unity and press "Play"; the application should launch on your headset automatically. </details> 5. To test multiplayer in Editor, use Meta XR Simulator: <details> <summary><b>Enabling the Simulator</b></summary> - Select Meta -> Simulator -> Enable Simulator - Press Play - The simulator should open a new window ([Simulator Docs](https://developers.meta.com/horizon/documentation/unity/xrsim-intro/)) </details> ## Dependencies This project uses the following plugins and software: - [Unity](https://unity.com/download) 6000.0.50f1 or newer - [Meta XR Core SDK](https://assetstore.unity.com/packages/tools/integration/meta-xr-core-sdk-269169) - [Meta XR Platform SDK](https://assetstore.unity.com/packages/tools/integration/meta-xr-platform-sdk-262366) - [Meta XR Interaction SDK](https://assetstore.unity.com/packages/tools/integration/meta-xr-interaction-sdk-265014) - [Meta XR Simulator](https://assetstore.unity.com/packages/tools/integration/meta-xr-simulator-266732) - [Mixed Reality Utility Kit](https://assetstore.unity.com/packages/tools/integration/meta-mr-utility-kit-272450) - [Photon Fusion](https://www.photonengine.com/fusion) - [UniTask](https://github.com/Cysharp/UniTask) To test this project within Unity, you need: - [The Meta Quest App](https://www.meta.com/quest/setup/) ## Getting the Code First, ensure you have Git LFS installed by running: ```sh git lfs install ``` Then, clone this repository using the "Code" button above or this command: ```sh git clone https://github.com/oculus-samples/Unity-CrypticCabinet.git ``` ## Documentation ### Before You Get Started Familiarize yourself with the packages and tools that enable Cryptic Cabinet to support rich multiplayer experiences and dynamically adapt to users' physical environments. - [Meta XR Core SDK](https://assetstore.unity.com/packages/tools/integration/meta-xr-core-sdk-269169): This package includes core features for mixed reality development, such as Passthrough, Anchors, and Scene, to help you create engaging and immersive experiences. - [Meta XR Platform SDK](https://assetstore.unity.com/packages/tools/integration/meta-xr-platform-sdk-262366): This package enables you to create social immersive experiences that support matchmaking, in-app purchases, downloadable content (DLC), cloud storage, and more. - [Meta XR Interaction SDK](https://assetstore.unity.com/packages/tools/integration/meta-xr-interaction-sdk-265014): This package contains components unique to Interaction SDK that are used for controller and hand interactions and body pose detection. - [Meta XR Simulator](https://assetstore.unity.com/packages/tools/integration/meta-xr-simulator-266732): This lightweight XR runtime enables you to simulate Meta Quest headsets and features on the API level so you can iterate and test your experiences without a physical device. - [Photon Fusion](https://www.photonengine.com/fusion#): Seamlessly support multiplayer modes by implementing this networking solution to handle and route networking traffic in shared user experiences. - [UniTask](https://github.com/Cysharp/UniTask?tab=readme-ov-file): This package provides efficient allocation-free async/await integration for Unity. ### Meta Horizon OS Capabilities Explore the Meta Horizon OS capabilities powering rich, shared mixed reality experiences in Cryptic Cabinet. - [Scene](https://developers.meta.com/horizon/documentation/unity/unity-scene-overview/): Leverage Mixed Reality Utility Kit on top of the Scene API to quickly index and query an up-to-date representation of the physical world that you can use to support mixed reality. Scene enables Cryptic Cabinet to support dynamic interactions between users, virtual objects, and their physical space. - [Passthrough](https://developers.meta.com/horizon/documentation/unity/unity-passthrough/): See your physical space in full, rich color. Passthrough API provides a real-time and perceptually comfortable 3D visualization of the physical world in Meta Quest headsets so users can see and navigate their surroundings. - [Shared Spatial Anchors](https://developers.meta.com/horizon/documentation/unity/unity-shared-spatial-anchors/): Create local multiplayer experiences for users in the same room. Shared Spatial Anchors enables a shared, world-locked frame of reference for many users playing Cryptic Cabinet together. - [Colocation](https://developers.meta.com/horizon/documentation/unity/unity-set-up-colocation-package/): Enable users to jump into the action together in the same physical space. Using Shared Spatial Anchors, colocation supports sharing physical environment information between headsets to enable accurate virtual positioning so players have a consistent, shared perspective of their surroundings. - [Interaction SDK](https://developers.meta.com/horizon/documentation/unity/unity-isdk-interaction-sdk-overview/): Power rich, dynamic interactions between users and their virtual environment. This SDK provides a suite of components that support intuitive navigation and interactions like grabbing, poking, teleportation, and more using your controller or hands. In Cryptic Cabinet, these interactions enable players to interact with virtual elements and progress through the escape room. - [Passthrough Styling](https://developers.meta.com/horizon/documentation/unity/unity-customize-passthrough-styling/): Add your unique touch to the headset's visual feed. Color mapping allows you to customize the output color by adjusting contrast, brightness, saturation, and more. ### Mechanics and Features Discover some of the mechanics, features, and techniques used to deliver this unique and engaging multiplayer experience. For more information, visit the [Feature Overview](./Documentation/FeatureOverview.md) page. <p> <img src="./Documentation/Images/UVbulb_screw.gif" width="30%"> <img src="./Documentation/Images/Safe.gif" width="30%"> <img src="./Documentation/Images/Key.gif" width="30%"> </p> - [Room Setup](./Documentation/FeatureOverview.md#room-setup): Using returned scene primitives via Scene API, a 3D grid of cells is generated to cover the entire room and track where scene objects are placed so they don't overlap with real-world objects. You can preview the scene after cells are generated. - [Networking](./Documentation/FeatureOverview.md#networking): Using Photon Fusion, Cryptic Cabinet provides the game host with a room code that they can share with other users and enable them to join. - [Rope](./Documentation/FeatureOverview.md#rope): Through Interaction SDK, users can grab the in-game rope at any point along its length using one or two hands, with grabbed positions being synchronized with other users. Realistic collisions are supported to push rope nodes away from each other and from scene objects. - [LUT](./Documentation/FeatureOverview.md#lut): Using Passthrough Styling, the Passthrough camera feed is darkened when a user activates the game's UV light or Orrery projection to deliver the effect of being in a dark room. A central manager ensures the effect is replicated for all users. - [Camera darkens when inside objects](./Documentation/FeatureOverview.md#camera-darkens-when-inside-objects): When a user puts their head inside virtual objects, the camera darkens to replicate a more realistic perspective. Passthrough is disabled and enabled as users look in and out of virtual objects. - [Safe Dials](./Documentation/FeatureOverview.md#safe-dials): By putting a trigger collider on the index finger of a user's hand, users can seamlessly swipe the game's safe dial up and down to crack the safe's code. - [Clock](./Documentation/FeatureOverview.md#clock): Through the use of the OneGrabRotateTransformer feature, users can rotate a handle that subsequently rotates the game's clock hands to detect when the user has selected the correct time, opening the clock door. - [Key & UV Bulb](./Documentation/FeatureOverview.md#key--uv-bulb): The game's UV bulb and key combine two interaction modes: The first mode enables users to freely manipulate these objects by grabbing, rotating, and moving them, and the second mode locks the objects in position so they can only be rotated around a single axis. ### Project Structure The project is structured to distinguish the main components of the MR experience's logic. A breakdown of the core features is defined on the [Main Scene](./Assets/CrypticCabinet/Scenes/MainScene.Unity) under the "**CrypticCabinetLogic**" GameObject. The **CrypticCabinetLogic** contains the following core objects: - **ColocationManager**, which is responsible for colocating multiple players within the same room and keeping a single player aligned to the real room throughout the gameplay. For more information, check the documentation inside the **ColocationManager** script. - **ConnectionManager**, which handles the Photon Fusion connection workflows for single and multiplayer sessions. The PhotonConnector logic showcases how a shared multiplayer session is handled via Photon Fusion, how the creation of shared rooms and lobbies work, and how the connection states can be handled accordingly. - **PassthroughManager**, which is responsible for the Color LUT effects applied to the passthrough of the supported Quest headsets. During gameplay, this feature is showcased when interacting with the UV machine puzzle and the light beam hitting the glass globe in the Orrery puzzle. Additional functions are implemented inside the **PassthroughConfigurator** and **PassthroughChanger** as an example of customized effects using Meta's Color LUT APIs from the SDK. - **SceneManagement**, which holds the logic to use the Scene Understanding API from the SDK to configure the virtual objects' placements around the real room of the player, allowing their tweaking when desired. - **GameManager**, which controls the game phases' flow of the gameplay. - **Player**, which holds the logic for all the interactions a player can perform across the whole experience. This showcases how the Meta Interaction SDK can be used to simplify usability for XR scenarios. ### Gameplay Phases The [**GameManager**](./Assets/CrypticCabinet/Scripts/GameManagement/GameManager.cs) script controls the game phases of the gameplay. Each game phase is responsible for a specific task of the game: - **ObjectSpawningGamePhase** handles the scene setup via the scene understanding APIs to tweak the placements for the virtual objects around the room before starting the gameplay; - **WaitForGuestPhase** waits for Guest players that want to join a multiplayer game before the gameplay starts; - **Act1TimelinePhase** starts the intro animation of the gameplay; - **PuzzleLoadingGamePhase** spawns the interactive objects around the room after the intro animation has finished playing; - **Act3TimelinePhase** starts the outro animation once the gameplay completes and all puzzles are resolved. ### UI System The main UI for the application is defined through the [**UIModalWindow**](.\Assets\CrypticCabinet\UI\UIModalWindow.prefab) prefab, which is controlled by the [UISystem script](.\Assets\CrypticCabinet\Scripts\UI\UISystem.cs). This script defines a singleton object that any class in the game can interact with to trigger UI messages and callbacks. ### Code Documentation Within the repo, there's detailed Doxygen documentation for the code in [Documentation/docs/html/index.html](./Documentation/docs/html/index.html). This can be opened in a web browser once the code has been cloned. <img src="./Documentation/Images/Doxygen.png" > ## License The majority of Cryptic Cabinet is licensed under the [MIT LICENSE](./LICENSE); however, files from [Text Mesh Pro](https://unity.com/legal/licenses/unity-companion-license) and [Photon SDK](./Assets/Photon/LICENSE) are licensed under their respective licensing terms. ## Contribution See the [CONTRIBUTING](./CONTRIBUTING.md) file for information on how to contribute. ", Assign "at most 3 tags" to the expected json: {"id":"8086","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"