base on Open weights LLM from Google DeepMind. # Gemma <!-- TODO(epot): Restore [](https://github.com/google-deepmind/gemma/actions/workflows/pytest_and_autopublish.yml) [](https://badge.fury.io/py/gemma) --> [Gemma](https://ai.google.dev/gemma) is a family of open-weights Large Language Model (LLM) by [Google DeepMind](https://deepmind.google/), based on Gemini research and technology. This repository contains an inference implementation and examples, based on the [Flax](https://github.com/google/flax) and [JAX](https://github.com/google/jax). ### Learn more about Gemma - The Gemma technical report ([v1](https://ai.google.dev/gemma/technical-report), [v2](http://goo.gle/gemma2report)) details the models' capabilities. - For tutorials, reference implementations in other ML frameworks, and more, visit https://ai.google.dev/gemma. ## Quick start ### Installation 1. To install Gemma you need to use Python 3.10 or higher. 2. Install JAX for CPU, GPU or TPU. Follow instructions at [the JAX website](https://jax.readthedocs.io/en/latest/installation.html). 3. Run ``` python -m venv gemma-demo . gemma-demo/bin/activate pip install git+https://github.com/google-deepmind/gemma.git ``` ### Downloading the models The model checkpoints are available through Kaggle at http://kaggle.com/models/google/gemma. Select one of the **Flax** model variations, click the ⤓ button to download the model archive, then extract the contents to a local directory. The archive contains both the model weights and the tokenizer, for example the 2b Flax variation contains: ``` 2b/ # Directory containing model weights tokenizer.model # Tokenizer ``` ### Running the unit tests To run the unit tests, install the optional `[test]` dependencies (e.g. using `pip install -e .[test]` from the root of the source tree), then: ``` pytest . ``` Note that the tests in `sampler_test.py` are skipped by default since no tokenizer is distributed with the Gemma sources. To run these tests, download a tokenizer following the instructions above, and update the `_VOCAB` constant in `sampler_test.py` with the path to `tokenizer.model`. ## Examples To run the example sampling script, pass the paths to the weights directory and tokenizer: ``` python examples/sampling.py \ --path_checkpoint=/path/to/archive/contents/2b/ \ --path_tokenizer=/path/to/archive/contents/tokenizer.model ``` There are also several Colab notebook tutorials: - [`colabs/sampling_tutorial.ipynb`](https://colab.sandbox.google.com/github/google-deepmind/gemma/blob/main/colabs/sampling_tutorial.ipynb) contains a [Colab](http://colab.google) notebook with a sampling example. - [`colabs/fine_tuning_tutorial.ipynb`](https://colab.sandbox.google.com/github/google-deepmind/gemma/blob/main/colabs/fine_tuning_tutorial.ipynb) contains a [Colab](http://colab.google) with a basic tutorial on how to fine tune Gemma for a task, such as English to French translation. - [`colabs/gsm8k_eval.ipynb`](https://colab.sandbox.google.com/github/google-deepmind/gemma/blob/main/colabs/gsm8k_eval.ipynb) is a [Colab](http://colab.google) with a reference GSM8K eval implementation. To run these notebooks you will need to download a local copy of the weights and tokenizer (see above), and update the `ckpt_path` and `vocab_path` variables with the corresponding paths. ## System Requirements Gemma can run on a CPU, GPU and TPU. For GPU, we recommend a 8GB+ RAM on GPU for the 2B checkpoint and 24GB+ RAM on GPU for the 7B checkpoint. ## Contributing We are open to bug reports, pull requests (PR), and other contributions. Please see [CONTRIBUTING.md](CONTRIBUTING.md) for details on PRs. ## License Copyright 2024 DeepMind Technologies Limited This code is licensed under the Apache License, Version 2.0 (the \"License\"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. ## Disclaimer This is not an official Google product. ", Assign "at most 3 tags" to the expected json: {"id":"8020","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"