Trendshift - Ask AI

base on Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) # Jan - Local AI Assistant ![Jan banner](./JanBanner.png)  <img alt="GitHub commit activity" src="https://img.shields.io/github/commit-activity/m/janhq/jan"/> <img alt="Github Last Commit" src="https://img.shields.io/github/last-commit/janhq/jan"/> <img alt="Github Contributors" src="https://img.shields.io/github/contributors/janhq/jan"/> <img alt="GitHub closed issues" src="https://img.shields.io/github/issues-closed/janhq/jan"/> <img alt="Discord" src="https://img.shields.io/discord/1107178041848909847?label=discord"/> <a href="https://jan.ai/docs/quickstart">Getting Started</a> - <a href="https://jan.ai/docs">Docs</a> - <a href="https://github.com/janhq/jan/releases">Changelog</a> - <a href="https://github.com/janhq/jan/issues">Bug reports</a> - <a href="https://discord.gg/AsJ8krTT3N">Discord</a> ⚠️ Jan is currently in Development: Expect breaking changes and bugs! Jan is a ChatGPT-alternative that runs 100% offline on your device. Our goal is to make it easy for a layperson to download and run LLMs and use AI with **full control** and **privacy**. Jan is powered by [Cortex](https://github.com/janhq/cortex.cpp), our embeddable local AI engine that runs on any hardware. From PCs to multi-GPU clusters, Jan & Cortex supports universal architectures: - [x] NVIDIA GPUs (fast) - [x] Apple M-series (fast) - [x] Apple Intel - [x] Linux Debian - [x] Windows x64 #### Features: - [Model Library](https://jan.ai/docs/models/manage-models#add-models) with popular LLMs like Llama, Gemma, Mistral, or Qwen - Connect to [Remote AI APIs](https://jan.ai/docs/remote-models/openai) like Groq and OpenRouter - Local API Server with OpenAI-equivalent API - [Extensions](https://jan.ai/docs/extensions) for customizing Jan ## Download <table> <tr style="text-align:center"> <td style="text-align:center">Version Type</td> <td style="text-align:center">Windows</td> <td style="text-align:center">MacOS Universal</td> <td colspan="2" style="text-align:center">Linux</td> </tr> <tr style="text-align:center"> <td style="text-align:center">Stable (Recommended)</td> <td style="text-align:center"> <a href='https://app.jan.ai/download/latest/win-x64'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/windows.png' style="height:14px; width: 14px" /> jan.exe </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/latest/mac-universal'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/mac.png' style="height:15px; width: 15px" /> jan.dmg </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/latest/linux-amd64-deb'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/linux.png' style="height:14px; width: 14px" /> jan.deb </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/latest/linux-amd64-appimage'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/linux.png' style="height:14px; width: 14px" /> jan.AppImage </a> </td> </tr> <tr style="text-align:center"> <td style="text-align:center">Beta (Preview)</td> <td style="text-align:center"> <a href='https://app.jan.ai/download/beta/win-x64'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/windows.png' style="height:14px; width: 14px" /> jan.exe </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/beta/mac-universal'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/mac.png' style="height:15px; width: 15px" /> jan.dmg </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/beta/linux-amd64-deb'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/linux.png' style="height:14px; width: 14px" /> jan.deb </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/beta/linux-amd64-appimage'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/linux.png' style="height:14px; width: 14px" /> jan.AppImage </a> </td> </tr> <tr style="text-align:center"> <td style="text-align:center">Nightly Build (Experimental)</td> <td style="text-align:center"> <a href='https://app.jan.ai/download/nightly/win-x64'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/windows.png' style="height:14px; width: 14px" /> jan.exe </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/nightly/mac-universal'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/mac.png' style="height:15px; width: 15px" /> jan.dmg </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/nightly/linux-amd64-deb'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/linux.png' style="height:14px; width: 14px" /> jan.deb </a> </td> <td style="text-align:center"> <a href='https://app.jan.ai/download/nightly/linux-amd64-appimage'> <img src='https://github.com/janhq/jan/blob/dev/docs/static/img/linux.png' style="height:14px; width: 14px" /> jan.AppImage </a> </td> </tr> </table> Download the latest version of Jan at https://jan.ai/ or visit the [GitHub Releases](https://github.com/janhq/jan/releases) to download any previous release. ## Demo https://github.com/user-attachments/assets/c3592fa2-c504-4d9d-a885-7e00122a50f3 *Real-time Video: Jan v0.5.7 on a Mac M2, 16GB Sonoma 14.2* ## Quicklinks ### Jan - [Jan Website](https://jan.ai/) - [Jan GitHub](https://github.com/janhq/jan) - [Documentation](https://jan.ai/docs) - [Jan Changelog](https://jan.ai/changelog) - [Jan Blog](https://jan.ai/blog) ### Cortex.cpp Jan is powered by **Cortex.cpp**. It is a C++ command-line interface (CLI) designed as an alternative to [Ollama](https://ollama.com/). By default, it runs on the llama.cpp engine but also supports other engines, including ONNX and TensorRT-LLM, making it a multi-engine platform. - [Cortex Website](https://cortex.so/) - [Cortex GitHub](https://github.com/janhq/cortex.cpp) - [Documentation](https://cortex.so/docs/) - [Models Library](https://cortex.so/models) - API Reference: *Under development* ## Requirements for running Jan - **MacOS**: 13 or higher - **Windows**: - Windows 10 or higher - To enable GPU support: - Nvidia GPU with CUDA Toolkit 11.7 or higher - Nvidia driver 470.63.01 or higher - **Linux**: - glibc 2.27 or higher (check with `ldd --version`) - gcc 11, g++ 11, cpp 11 or higher, refer to this [link](https://jan.ai/guides/troubleshooting/gpu-not-used/#specific-requirements-for-linux) for more information - To enable GPU support: - Nvidia GPU with CUDA Toolkit 11.7 or higher - Nvidia driver 470.63.01 or higher ## Troubleshooting As Jan is in development mode, you might get stuck on a some common issues: - [Troubleshooting a broken build](https://jan.ai/docs/troubleshooting#broken-build) - [Troubleshooting NVIDIA GPU](https://jan.ai/docs/troubleshooting#troubleshooting-nvidia-gpu) - [Troubleshooting Something's Amiss](https://jan.ai/docs/troubleshooting#somethings-amiss) If you can't find what you need in our troubleshooting guide, feel free reach out to us for extra help: 1. Copy your [error logs & device specifications](https://jan.ai/docs/troubleshooting#how-to-get-error-logs). 2. Go to our [Discord](https://discord.com/invite/FTk2MvZwJH) & send it to **#🆘|get-help** channel for further support. *Check the logs to ensure the information is what you intend to send. Note that we retain your logs for only 24 hours, so report any issues promptly.* ## Contributing Contributions are welcome! Please read the [CONTRIBUTING.md](CONTRIBUTING.md) file ### Pre-requisites - node >= 20.0.0 - yarn >= 1.22.0 - make >= 3.81 ### Instructions 1. **Clone the repository and prepare:** ```bash git clone https://github.com/janhq/jan cd jan git checkout -b DESIRED_BRANCH ``` 2. **Run development and use Jan Desktop** ```bash make dev ``` This will start the development server and open the desktop app. ### For production build ```bash # Do steps 1 and 2 in the previous section # Build the app make build ``` This will build the app MacOS m1/m2 for production (with code signing already done) and put the result in `dist` folder. ## Acknowledgements Jan builds on top of other open-source projects: - [llama.cpp](https://github.com/ggerganov/llama.cpp) - [LangChain](https://github.com/langchain-ai) - [TensorRT](https://github.com/NVIDIA/TensorRT) - [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) ## Contact - Bugs & requests: file a GitHub ticket - For discussion: join our Discord [here](https://discord.gg/FTk2MvZwJH) - For business inquiries: email [email protected] - For jobs: please email [email protected] ## Trust & Safety Beware of scams! - We will never request your personal information. - Our product is completely free; no paid version exists. - We do not have a token or ICO. - We are a [bootstrapped company](https://en.wikipedia.org/wiki/Bootstrapping), and don't have any external investors (*yet*). We're open to exploring opportunities with strategic partners want to tackle [our mission](https://jan.ai/about#mission) together. ## License Jan is free and open source, under the **AGPLv3** license. ", Assign "at most 3 tags" to the expected json: {"id":"6525","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"

AI prompts

AI prompts