base on Apache Ranger - To enable, monitor and manage comprehensive data security across the Hadoop platform and beyond <!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> # Apache Ranger [](https://www.apache.org/licenses/LICENSE-2.0.txt) [](https://pypi.org/project/apache-ranger/) [](https://ranger.apache.org) [](https://cwiki.apache.org/confluence/display/RANGER/Index) #### NOTE Apache Ranger allows contributions via pull requests (PRs) on GitHub. Alternatively, use [this](https://reviews.apache.org) to submit changes for review using the Review Board. Also create a [ranger jira](https://issues.apache.org/jira/browse/RANGER) to go along with the review and mention it in the review board review. ## Building Ranger in Docker (Sandbox Install) Ranger is built using [Apache Maven](https://maven.apache.org/). To run Ranger: 1. Check out the code from GIT [repository](https://github.com/apache/ranger.git) 2. Ensure that docker & docker-compose is installed and running on your system. 3. Ensure that JDK 1.8+ is installed on your system. 4. Ensure that Apache Maven is installed on your system. 5. Run the following command to build & run Ranger from Docker `./ranger_in_docker up` 6. After successful completion of the above command, you should be able to view Ranger Admin Console by using URL: ``` http://<hostname-of-system>:6080/ UserName: admin Password: rangerR0cks! ``` ## Regular Build Process 1. Check out the code from GIT repository 2. On the root folder, please execute the following Maven command: `mvn clean compile package install` `mvn eclipse:eclipse` Ranger Admin UI tests depend on PhantomJS. If the build fails with npm or Karma errors you can either: - install PhantomJS dependencies for your platform (bzip2 and fontconfig) - skip JavaScript test execution: mvn -DskipJSTests ... 3. After the above build command execution, you should see the following TAR files in the target folder: ``` ranger-<version>-admin.tar.gz ranger-<version>-atlas-plugin.tar.gz ranger-<version>-hbase-plugin.tar.gz ranger-<version>-hdfs-plugin.tar.gz ranger-<version>-hive-plugin.tar.gz ranger-<version>-kafka-plugin.tar.gz ranger-<version>-kms.tar.gz ranger-<version>-knox-plugin.tar.gz ranger-<version>-migration-util.tar.gz ranger-<version>-ranger-tools.tar.gz ranger-<version>-solr-plugin.tar.gz ranger-<version>-sqoop-plugin.tar.gz ranger-<version>-src.tar.gz ranger-<version>-storm-plugin.tar.gz ranger-<version>-tagsync.tar.gz ranger-<version>-usersync.tar.gz ranger-<version>-yarn-plugin.tar.gz ranger-<version>-kylin-plugin.tar.gz ranger-<version>-elasticsearch-plugin.tar.gz ``` ## Importing Apache Ranger Project into Eclipse 1. Create an Eclipse workspace called 'ranger' 2. Import maven project from the root directory where ranger source code is downloaded (and build) ## Deployment Process ### Installation Host Information 1. Ranger Admin Tool Component (ranger-<version-number>-admin.tar.gz) should be installed on a host where Policy Admin Tool web application runs on port 6080 (default). 2. Ranger User Synchronization Component (ranger-<version-number>-usersync.tar.gz) should be installed on a host to synchronize the external user/group information into Ranger database via Ranger Admin Tool. 3. Ranger Component plugin should be installed on the component boxes: - HDFS Plugin needs to be installed on Name Node hosts. - Hive Plugin needs to be installed on HiveServer2 hosts. - HBase Plugin needs to be installed on both Master and Regional Server nodes. - Knox Plugin needs to be installed on Knox gateway host. - Storm Plugin needs to be installed on Storm hosts. - Kafka/Solr Plugin needs to be installed on their respective component hosts. - YARN plugin needs to be installed on YARN Resource Manager hosts. - Sqoop plugin needs to be installed on Sqoop2 hosts. - Kylin plugin needs to be installed on Kylin hosts. - Elasticsearch plugin needs to be installed on Elasticsearch hosts. ### Installation Process 1. Download the tar.gz file into a temporary folder in the box where it needs to be installed. 2. Expand the tar.gz file into /usr/lib/ranger/ folder 3. Go to the component name under the expanded folder (e.g. /usr/lib/ranger/ranger-<version-number>-admin/) 4. Modify the install.properties file with appropriate variables 5. - If the module has setup.sh, execute ./setup.sh - If the install.sh file does not exists, execute ./enable-<component>-plugin.sh ", Assign "at most 3 tags" to the expected json: {"id":"5644","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"