base on SQL powered operating system instrumentation, monitoring, and analytics. # osquery <p align="center"> <img alt="osquery logo" width="200" src="https://github.com/osquery/osquery/raw/master/docs/img/logo-2x-dark.png" /> </p> <p align="center"> osquery is a SQL powered operating system instrumentation, monitoring, and analytics framework. <br> Available for Linux, macOS, and Windows. </p> ## Information and resources - Homepage: [osquery.io](https://osquery.io) - Downloads: [osquery.io/downloads](https://osquery.io/downloads) - Documentation: [ReadTheDocs](https://osquery.readthedocs.org) - Stack Overflow: [Stack Overflow questions](https://stackoverflow.com/questions/tagged/osquery) - Table Schema: [osquery.io/schema](https://osquery.io/schema) - Query Packs: [osquery.io/packs](https://github.com/osquery/osquery/tree/master/packs) - Slack: [Browse the archives](https://chat.osquery.io/c/general) or [Join the conversation](https://join.slack.com/t/osquery/shared_invite/zt-1wipcuc04-DBXmo51zYJKBu3_EP3xZPA) - Build Status: [](https://github.com/osquery/osquery/actions/workflows/hosted_runners.yml) [](https://github.com/osquery/osquery/actions/workflows/self_hosted_runners.yml) [](https://osquery.readthedocs.io/en/latest/?badge=latest) - CII Best Practices: [](https://bestpractices.coreinfrastructure.org/projects/3125) ## What is osquery? osquery exposes an operating system as a high-performance relational database. This allows you to write SQL-based queries to explore operating system data. With osquery, SQL tables represent abstract concepts such as running processes, loaded kernel modules, open network connections, browser plugins, hardware events or file hashes. SQL tables are implemented via a simple plugin and extensions API. A variety of tables already exist and more are being written: [https://osquery.io/schema](https://osquery.io/schema/). To best understand the expressiveness that is afforded to you by osquery, consider the following SQL queries: List the [`users`](https://osquery.io/schema/current#users): ```sql SELECT * FROM users; ``` Check the [`processes`](https://osquery.io/schema/current#processes) that have a deleted executable: ```sql SELECT * FROM processes WHERE on_disk = 0; ``` Get the process name, port, and PID, for processes listening on all interfaces: ```sql SELECT DISTINCT processes.name, listening_ports.port, processes.pid FROM listening_ports JOIN processes USING (pid) WHERE listening_ports.address = '0.0.0.0'; ``` Find every macOS LaunchDaemon that launches an executable and keeps it running: ```sql SELECT name, program || program_arguments AS executable FROM launchd WHERE (run_at_load = 1 AND keep_alive = 1) AND (program != '' OR program_arguments != ''); ``` Check for ARP anomalies from the host's perspective: ```sql SELECT address, mac, COUNT(mac) AS mac_count FROM arp_cache GROUP BY mac HAVING count(mac) > 1; ``` Alternatively, you could also use a SQL sub-query to accomplish the same result: ```sql SELECT address, mac, mac_count FROM (SELECT address, mac, COUNT(mac) AS mac_count FROM arp_cache GROUP BY mac) WHERE mac_count > 1; ``` These queries can be: - performed on an ad-hoc basis to explore operating system state using the [osqueryi](https://osquery.readthedocs.org/en/latest/introduction/using-osqueryi/) shell - executed via a [scheduler](https://osquery.readthedocs.org/en/latest/introduction/using-osqueryd/) to monitor operating system state across a set of hosts - launched from custom applications using osquery Thrift APIs ## Download & Install To download the latest stable builds and for repository information and installation instructions visit [https://osquery.io/downloads](https://osquery.io/downloads/). We use a simple numbered versioning scheme `X.Y.Z`, where X is a major version, Y is a minor, and Z is a patch. We plan minor releases roughly every two months. These releases are tracked on our [Milestones](https://github.com/osquery/osquery/milestones) page. A patch release is used when there are unforeseen bugs with our minor release and we need to quickly patch. A rare 'revision' release might be used if we need to change build configurations. Major, minor, and patch releases are tagged on GitHub and can be viewed on the [Releases](https://github.com/osquery/osquery/releases) page. We open a new [Release Checklist](https://github.com/osquery/osquery/blob/master/.github/ISSUE_TEMPLATE/New_Release.md) issue when we prepare a minor release. If you are interested in the status of a release, please find the corresponding checklist issue, and note that the issue will be marked closed when we are finished the checklist. We consider a release 'in testing' during the period of hosting new downloads on our website and adding them to our hosted repositories. We will mark the release as 'stable' on GitHub when enough testing has occurred, this usually takes two weeks. ## Build from source Building osquery from source is encouraged! Check out our [build guide](https://osquery.readthedocs.io/en/latest/development/building/). Also check out our [contributing guide](CONTRIBUTING.md) and join the community on [Slack](https://join.slack.com/t/osquery/shared_invite/zt-1wipcuc04-DBXmo51zYJKBu3_EP3xZPA). ## Osquery fleet managers There are many osquery fleet managers out there. The osquery project does not endorse, recommend, or test these. They are provided as a starting point | Project | License | | ------------------------------------------------------- | ----------- | | [Fleet](https://github.com/fleetdm/fleet) | Open Core | | [Kolide](https://www.kolide.com) | Commercial | | [OSCTRL](https://github.com/jmpsec/osctrl) | Open Source | | [Zentral](https://github.com/zentralopensource/zentral) | Open Source | ## License By contributing to osquery you agree that your contributions will be licensed as defined on the LICENSE file. ## Vulnerabilities We keep track of security announcements in our tagged version release notes on GitHub. We aggregate these into [SECURITY.md](SECURITY.md) too. ## Learn more The osquery documentation is available [online](https://osquery.readthedocs.org). Documentation for older releases can be found by version number, [as well](https://readthedocs.org/projects/osquery/). If you're interested in learning more about osquery read the [launch blog post](https://code.facebook.com/posts/844436395567983/introducing-osquery/) for background on the project, visit the [users guide](https://osquery.readthedocs.org/). Development and usage discussion is happening in the osquery Slack, grab an invite [here](https://join.slack.com/t/osquery/shared_invite/zt-1wipcuc04-DBXmo51zYJKBu3_EP3xZPA)! ", Assign "at most 3 tags" to the expected json: {"id":"1200","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"