base on A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more. <h1 align="center"> <img src="https://github.com/darrenburns/elia/assets/5740731/4037b91a-1ad8-4d5b-884d-b3f1b495acf4" width="126px"> </h1> <p align="center"> <i align="center">A snappy, keyboard-centric terminal user interface for interacting with large language models.</i><br> <i align="center">Chat with Claude 3, ChatGPT, and local models like Llama 3, Phi 3, Mistral and Gemma.</i> </p>  ## Introduction `elia` is an application for interacting with LLMs which runs entirely in your terminal, and is designed to be keyboard-focused, efficient, and fun to use! It stores your conversations in a local SQLite database, and allows you to interact with a variety of models. Speak with proprietary models such as ChatGPT and Claude, or with local models running through `ollama` or LocalAI. ## Installation Install Elia with [pipx](https://github.com/pypa/pipx): ```bash pipx install --python 3.11 elia-chat ``` Depending on the model you wish to use, you may need to set one or more environment variables (e.g. `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, `GEMINI_API_KEY` etc). ## Quickstart Launch Elia from the command line: ```bash elia ``` Launch a new chat inline (under your prompt) with `-i`/`--inline`: ```bash elia -i "What is the Zen of Python?" ``` Launch a new chat in full-screen mode: ```bash elia "Tell me a cool fact about lizards!" ``` Specify a model via the command line using `-m`/`--model`: ```bash elia -m gpt-4o ``` Options can be combined - here's how you launch a chat with Gemini 1.5 Flash in inline mode (requires `GEMINI_API_KEY` environment variable). ```bash elia -i -m gemini/gemini-1.5-flash-latest "How do I call Rust code from Python?" ``` ## Running local models 1. Install [`ollama`](https://github.com/ollama/ollama). 2. Pull the model you require, e.g. `ollama pull llama3`. 3. Run the local ollama server: `ollama serve`. 4. Add the model to the config file (see below). ## Configuration The location of the configuration file is noted at the bottom of the options window (`ctrl+o`). The example file below shows the available options, as well as examples of how to add new models. ```toml # the ID or name of the model that is selected by default on launch default_model = "gpt-4o" # the system prompt on launch system_prompt = "You are a helpful assistant who talks like a pirate." # choose from "nebula", "cobalt", "twilight", "hacker", "alpine", "galaxy", "nautilus", "monokai", "textual" theme = "galaxy" # change the syntax highlighting theme of code in messages # choose from https://pygments.org/styles/ # defaults to "monokai" message_code_theme = "dracula" # example of adding local llama3 support # only the `name` field is required here. [[models]] name = "ollama/llama3" # example of a model running on a local server, e.g. LocalAI [[models]] name = "openai/some-model" api_base = "http://localhost:8080/v1" api_key = "api-key-if-required" # example of add a groq model, showing some other fields [[models]] name = "groq/llama2-70b-4096" display_name = "Llama 2 70B" # appears in UI provider = "Groq" # appears in UI temperature = 1.0 # high temp = high variation in output max_retries = 0 # number of retries on failed request # example of multiple instances of one model, e.g. you might # have a 'work' OpenAI org and a 'personal' org. [[models]] id = "work-gpt-3.5-turbo" name = "gpt-3.5-turbo" display_name = "GPT 3.5 Turbo (Work)" [[models]] id = "personal-gpt-3.5-turbo" name = "gpt-3.5-turbo" display_name = "GPT 3.5 Turbo (Personal)" ``` ## Custom themes Add a custom theme YAML file to the themes directory. You can find the themes directory location by pressing `ctrl+o` on the home screen and looking for the `Themes directory` line. Here's an example of a theme YAML file: ```yaml name: example # use this name in your config file primary: '#4e78c4' secondary: '#f39c12' accent: '#e74c3c' background: '#0e1726' surface: '#17202a' error: '#e74c3c' # error messages success: '#2ecc71' # success messages warning: '#f1c40f' # warning messages ``` ## Changing keybindings Right now, keybinds cannot be changed. Terminals are also rather limited in what keybinds they support. For example, pressing <kbd>Cmd</kbd>+<kbd>Enter</kbd> to send a message is not possible (although we may support a protocol to allow this in some terminals in the future). For now, I recommend you map whatever key combo you want at the terminal emulator level to send `\n`. Here's an example using iTerm: <img width="848" alt="image" src="https://github.com/darrenburns/elia/assets/5740731/94b6e50c-429a-4d17-99c2-affaa828f35b"> With this mapping in place, pressing <kbd>Cmd</kbd>+<kbd>Enter</kbd> will send a message to the LLM, and pressing <kbd>Enter</kbd> alone will create a new line. ## Import from ChatGPT Export your conversations to a JSON file using the ChatGPT UI, then import them using the `import` command. ```bash elia import 'path/to/conversations.json' ``` ## Wiping the database ```bash elia reset ``` ## Uninstalling ```bash pipx uninstall elia-chat ``` ", Assign "at most 3 tags" to the expected json: {"id":"10345","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"