base on 🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces, RUM, Error tracking, Session replay). <p align="center"> <a href="https://openobserve.ai"><img src="https://openobserve.ai/img/logo/logo_horizontal.svg" alt="OpenObserve"></a> </p> <p align="center"> <em>🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces).</em> </p> <p align="center"> <a href="https://github.com/openobserve/openobserve" target="_blank"> <img src="https://img.shields.io/github/last-commit/openobserve/openobserve" alt="Last Commit"> </a> <a href="https://github.com/openobserve/openobserve/stargazers" target="_blank"> <img src="https://img.shields.io/github/stars/openobserve/openobserve" alt="GitHub Stars"> </a> <a href="https://github.com/openobserve/openobserve/issues" target="_blank"> <img src="https://img.shields.io/github/issues/openobserve/openobserve" alt="GitHub Issues"> </a> <a href="https://github.com/openobserve/openobserve/graphs/contributors" target="_blank"> <img src="https://img.shields.io/github/contributors/openobserve/openobserve" alt="Contributors"> </a> <a href="https://github.com/openobserve/openobserve/releases" target="_blank"> <img src="https://img.shields.io/github/v/release/openobserve/openobserve" alt="GitHub Release"> </a> </p> OpenObserve (O2 for short) is a cloud-native observability platform built specifically for logs, metrics, traces, analytics, RUM (Real User Monitoring - Performance, Errors, Session Replay) designed to work at petabyte scale. It is straightforward and easy to operate, in contrast to Elasticsearch, which requires understanding and tuning numerous settings. Get OpenObserve up and running in under 2 minutes. OpenObserve serves as a seamless replacement for Elasticsearch for users who ingest data using APIs and perform searches. OpenObserve comes with its own user interface, eliminating the need for separate installation. You can reduce your log storage costs by ~140x compared to Elasticsearch by using OpenObserve. Below, we present the results from pushing logs from our production Kubernetes cluster to both Elasticsearch and OpenObserve using Fluent Bit.  ## 🎥 Introduction Video [](https://www.youtube.com/watch?v=3rHxOVgIY6A) ## 🌟 Features: - **Logs, Metrics, Traces**: Comprehensive support for various data types. - **OpenTelemetry Support**: Full compatibility with OTLP for logs, metrics, and traces. - **Real User Monitoring (RUM)**: Includes performance tracking, error logging, and session replay. - **Dashboards, Reports, Alerts**: Features over 18 different chart types for comprehensive data visualization for on-the-fly analysis and reporting along with alerting. - **Pipelines**: Enrich, redact, reduce, normalize data on the fly. Stream processing for logs to metrics and more. - **Advanced Embedded GUI**: Intuitive and user-friendly interface. - **SQL and PromQL Support**: Query logs and traces with SQL, and metrics with SQL and PromQL. - **Single Binary or HA Installation**: Install using a single binary for small deployments or in HA mode for large deployments. - **Versatile Storage Options**: Supports local disk, S3, MinIO, GCS, Azure Blob Storage. - **High Availability and Clustering**: Ensures reliable and scalable performance. - **Dynamic Schema**: Adapts to your data structure seamlessly. - **Built-in Authentication**: Secure and ready to use. - **Ease of Operation**: Designed for simplicity and efficiency. - **Seamless Upgrades**: Hassle-free updates. - **Multilingual UI**: Supports 11 languages, including English, Spanish, German, French, Chinese, and more. For a full list of features, check the [documentation](https://openobserve.ai/docs/#project-status-features-and-roadmap). ## ⚡️ Quick start ### 🐳 Docker: ```bash docker run -d \ --name openobserve \ -v $PWD/data:/data \ -p 5080:5080 \ -e ZO_ROOT_USER_EMAIL="[email protected]" \ -e ZO_ROOT_USER_PASSWORD="Complexpass#123" \ public.ecr.aws/zinclabs/openobserve:latest ``` ### 🐙 Docker Compose: ```yaml services: openobserve: image: public.ecr.aws/zinclabs/openobserve:latest restart: unless-stopped environment: ZO_ROOT_USER_EMAIL: "[email protected]" ZO_ROOT_USER_PASSWORD: "Complexpass#123" ports: - "5080:5080" volumes: - data:/data volumes: data: ``` For other ways to quickly install OpenObserve or use OpenObserve cloud, check [quickstart documentation](https://openobserve.ai/docs/quickstart). For installing OpenObserve in HA mode, check [HA deployment documentation](https://openobserve.ai/docs/ha_deployment/). <!-- ## Enterprise Vs Open source Vs Cloud edition OpenObserve is available in three different editions: | Feature | Open Source (Self hosted) | Enterprise (Self hosted) | Cloud | | --- | --- | --- | --- | | Logs | ✅ | ✅ | ✅ | | Metrics | ✅ | ✅ | ✅ | | Traces | ✅ | ✅ | ✅ | | RUM | ✅ | ✅ | ✅ | | Alerts | ✅ | ✅ | ✅ | | Dashboards | ✅ | ✅ | ✅ | | Reports | ✅ | ✅ | ✅ | | VRL functions | ✅ | ✅ | ✅ | | Pipelines | ✅ | ✅ | ✅ | | High Availability | ✅ | ✅ | ✅ | | Multitenancy (Organizations) | ✅ | ✅ | ✅ | | Dynamic schema and schema evolution | ✅ | ✅ | ✅ | | Advanced multilingual GUI | ✅ | ✅ | ✅ | | Single Sign On | ❌ | ✅ | ✅ | | Role Based Access Control (RBAC) | ❌ | ✅ | ✅ | | Federated search / Super cluster | ❌ | ✅ | ❌ | | Query management | ❌ | ✅ | ❌ | | Workload management (QoS) | ❌ | ✅ | ❌ | | Audit trail | ❌ | ✅ | ❌ | | Ability to influence roadmap | ❌ | ✅ | ✅ on enterprise plan | | License | AGPL | Enterprise | Cloud | | Support | Community | Enterprise | Cloud | | Cost | Free | If self hosted, free for up to 200 GB/Day data ingested <br> Paid thereafter | Free 200 GB/Month data ingested <br> Paid thereafter | --> ## 📷 Screenshots ### Home  ### Logs  ### Traces (OpenTelemetry) Trace details page  Golden metrics based on traces  ### Visualizations and Dashboards     ### Front end monitoring Performance analytics  Session replay  Error tracking  ### Alerts  ### Streams  ### Ingestion   ### SBOM Software Bill of Materials for OpenObserve #### Rust SBOM can be found [here](./openobserve.cdx.xml). You can analyze it using [dependency track](https://dependencytrack.org/). In order to generate the SBOM, you can use the following commands: Install cargo-cyclonedx: ````bash cargo install cargo-cyclonedx ```` Generate the SBOM: ```bash cargo-cyclonedx cyclonedx ``` #### JavaScript SBOM can be found [here](./web/sbom.json ). You can analyze it using [dependency track](https://dependencytrack.org/). In order to generate the SBOM, you can use the following commands: Install cyclonedx-npm: ````bash npm install --global @cyclonedx/cyclonedx-npm ```` Generate the SBOM: ```bash cd web cyclonedx-npm > sbom.json ``` ## ⚖️ License OpenObserve is licensed under the AGPL-3.0 license. For more details, see the [LICENSE](https://github.com/openobserve/openobserve/blob/main/LICENSE). ## 🌍 Community ### 🔗 Join OpenObserve community on Slack [](https://short.openobserve.ai/community) Easiest way to get support is to join the [Slack channel](https://short.openobserve.ai/community). ### 📱 Join OpenObserve community on WeChat <img src="./screenshots/wechat_qr.jpg" width="300"> ", Assign "at most 3 tags" to the expected json: {"id":"2031","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"