base on 🐙 Guides, papers, lecture, notebooks and resources for prompt engineering # Prompt Engineering Guide Prompt engineering is a relatively new discipline for developing and optimizing prompts to efficiently use language models (LMs) for a wide variety of applications and research topics. Prompt engineering skills help to better understand the capabilities and limitations of large language models (LLMs). Researchers use prompt engineering to improve the capacity of LLMs on a wide range of common and complex tasks such as question answering and arithmetic reasoning. Developers use prompt engineering to design robust and effective prompting techniques that interface with LLMs and other tools. Motivated by the high interest in developing with LLMs, we have created this new prompt engineering guide that contains all the latest papers, learning guides, lectures, references, and tools related to prompt engineering for LLMs. 🌐 [Prompt Engineering Guide (Web Version)](https://www.promptingguide.ai/) 🎉 We are excited to launch our brand new prompt engineering courses under the DAIR.AI Academy. [Join Now](https://dair-ai.thinkific.com/bundles/pro)! Use code BLACKFRIDAY to get an extra 35% off. This offer ends on 29th November 2024. Happy Prompting! --- ## Announcements / Updates - 🎓 We now offer self-paced prompt engineering courses under our DAIR.AI Academy. [Join Now](https://dair-ai.thinkific.com/bundles/pro)! - 🎓 New course on Prompt Engineering for LLMs announced! [Enroll here](https://maven.com/dair-ai/prompt-engineering-llms)! - 💼 We now offer several [services](https://www.promptingguide.ai/services) like corporate training, consulting, and talks. - 🌐 We now support 13 languages! Welcoming more translations. - 👩‍🎓 We crossed 3 million learners in January 2024! - 🎉 We have launched a new web version of the guide [here](https://www.promptingguide.ai/) - 🔥 We reached #1 on Hacker News on 21 Feb 2023 - 🎉 The First Prompt Engineering Lecture went live [here](https://youtu.be/dOxUroR57xs) [Join our Discord](https://discord.com/invite/SKgkVT8BGJ) [Follow us on Twitter](https://twitter.com/dair_ai) [Subscribe to our YouTube](https://www.youtube.com/channel/UCyna_OxOWL7IEuOwb7WhmxQ) [Subscribe to our Newsletter](https://nlpnews.substack.com/) --- ## Guides You can also find the most up-to-date guides on our new website [https://www.promptingguide.ai/](https://www.promptingguide.ai/). - [Prompt Engineering - Introduction](https://www.promptingguide.ai/introduction) - [Prompt Engineering - LLM Settings](https://www.promptingguide.ai/introduction/settings) - [Prompt Engineering - Basics of Prompting](https://www.promptingguide.ai/introduction/basics) - [Prompt Engineering - Prompt Elements](https://www.promptingguide.ai/introduction/elements) - [Prompt Engineering - General Tips for Designing Prompts](https://www.promptingguide.ai/introduction/tips) - [Prompt Engineering - Examples of Prompts](https://www.promptingguide.ai/introduction/examples) - [Prompt Engineering - Techniques](https://www.promptingguide.ai/techniques) - [Prompt Engineering - Zero-Shot Prompting](https://www.promptingguide.ai/techniques/zeroshot) - [Prompt Engineering - Few-Shot Prompting](https://www.promptingguide.ai/techniques/fewshot) - [Prompt Engineering - Chain-of-Thought Prompting](https://www.promptingguide.ai/techniques/cot) - [Prompt Engineering - Self-Consistency](https://www.promptingguide.ai/techniques/consistency) - [Prompt Engineering - Generate Knowledge Prompting](https://www.promptingguide.ai/techniques/knowledge) - [Prompt Engineering - Prompt Chaining](https://www.promptingguide.ai/techniques/prompt_chaining) - [Prompt Engineering - Tree of Thoughts (ToT)](https://www.promptingguide.ai/techniques/tot) - [Prompt Engineering - Retrieval Augmented Generation](https://www.promptingguide.ai/techniques/rag) - [Prompt Engineering - Automatic Reasoning and Tool-use (ART)](https://www.promptingguide.ai/techniques/art) - [Prompt Engineering - Automatic Prompt Engineer](https://www.promptingguide.ai/techniques/ape) - [Prompt Engineering - Active-Prompt](https://www.promptingguide.ai/techniques/activeprompt) - [Prompt Engineering - Directional Stimulus Prompting](https://www.promptingguide.ai/techniques/dsp) - [Prompt Engineering - Program-Aided Language Models](https://www.promptingguide.ai/techniques/pal) - [Prompt Engineering - ReAct Prompting](https://www.promptingguide.ai/techniques/react) - [Prompt Engineering - Multimodal CoT Prompting](https://www.promptingguide.ai/techniques/multimodalcot) - [Prompt Engineering - Graph Prompting](https://www.promptingguide.ai/techniques/graph) - [Prompt Engineering - Applications](https://www.promptingguide.ai/applications) - [Prompt Engineering - Function Calling](https://www.promptingguide.ai/applications/function_calling) - [Prompt Engineering - Generating Data](https://www.promptingguide.ai/applications/generating) - [Prompt Engineering - Generating Synthetic Dataset for RAG](https://www.promptingguide.ai/applications/synthetic_rag) - [Prompt Engineering - Takling Generated Datasets Diversity](https://www.promptingguide.ai/applications/generating_textbooks) - [Prompt Engineering - Generating Code](https://www.promptingguide.ai/applications/coding) - [Prompt Engineering - Graduate Job Classification Case Study](https://www.promptingguide.ai/applications/workplace_casestudy) - [Prompt Engineering - Prompt Hub](https://www.promptingguide.ai/prompts) - [Prompt Engineering - Classification](https://www.promptingguide.ai/prompts/classification) - [Prompt Engineering - Coding](https://www.promptingguide.ai/prompts/coding) - [Prompt Engineering - Creativity](https://www.promptingguide.ai/prompts/creativity) - [Prompt Engineering - Evaluation](https://www.promptingguide.ai/prompts/evaluation) - [Prompt Engineering - Information Extraction](https://www.promptingguide.ai/prompts/information-extraction) - [Prompt Engineering - Image Generation](https://www.promptingguide.ai/prompts/image-generation) - [Prompt Engineering - Mathematics](https://www.promptingguide.ai/prompts/mathematics) - [Prompt Engineering - Question Answering](https://www.promptingguide.ai/prompts/question-answering) - [Prompt Engineering - Reasoning](https://www.promptingguide.ai/prompts/reasoning) - [Prompt Engineering - Text Summarization](https://www.promptingguide.ai/prompts/text-summarization) - [Prompt Engineering - Truthfulness](https://www.promptingguide.ai/prompts/truthfulness) - [Prompt Engineering - Adversarial Prompting](https://www.promptingguide.ai/prompts/adversarial-prompting) - [Prompt Engineering - Models](https://www.promptingguide.ai/models) - [Prompt Engineering - ChatGPT](https://www.promptingguide.ai/models/chatgpt) - [Prompt Engineering - Code Llama](https://www.promptingguide.ai/models/code-llama) - [Prompt Engineering - Flan](https://www.promptingguide.ai/models/flan) - [Prompt Engineering - Gemini](https://www.promptingguide.ai/models/gemini) - [Prompt Engineering - GPT-4](https://www.promptingguide.ai/models/gpt-4) - [Prompt Engineering - LLaMA](https://www.promptingguide.ai/models/llama) - [Prompt Engineering - Mistral 7B](https://www.promptingguide.ai/models/mistral-7b) - [Prompt Engineering - Mixtral](https://www.promptingguide.ai/models/mixtral) - [Prompt Engineering - OLMo](https://www.promptingguide.ai/models/olmo) - [Prompt Engineering - Phi-2](https://www.promptingguide.ai/models/phi-2) - [Prompt Engineering - Model Collection](https://www.promptingguide.ai/models/collection) - [Prompt Engineering - Risks and Misuses](https://www.promptingguide.ai/risks) - [Prompt Engineering - Adversarial Prompting](https://www.promptingguide.ai/risks/adversarial) - [Prompt Engineering - Factuality](https://www.promptingguide.ai/risks/factuality) - [Prompt Engineering - Biases](https://www.promptingguide.ai/risks/biases) - [Prompt Engineering - Papers](https://www.promptingguide.ai/papers) - [Prompt Engineering - Overviews](https://www.promptingguide.ai/papers#overviews) - [Prompt Engineering - Approaches](https://www.promptingguide.ai/papers#approaches) - [Prompt Engineering - Applications](https://www.promptingguide.ai/papers#applications) - [Prompt Engineering - Collections](https://www.promptingguide.ai/papers#collections) - [Prompt Engineering - Tools](https://www.promptingguide.ai/tools) - [Prompt Engineering - Notebooks](https://www.promptingguide.ai/notebooks) - [Prompt Engineering - Datasets](https://www.promptingguide.ai/datasets) - [Prompt Engineering - Additional Readings](https://www.promptingguide.ai/readings) --- ## Lecture We have published a 1 hour lecture that provides a comprehensive overview of prompting techniques, applications, and tools. - [Video Lecture](https://youtu.be/dOxUroR57xs) - [Notebook with code](https://github.com/dair-ai/Prompt-Engineering-Guide/blob/main/notebooks/pe-lecture.ipynb) - [Slides](https://github.com/dair-ai/Prompt-Engineering-Guide/blob/main/lecture/Prompt-Engineering-Lecture-Elvis.pdf) --- ## Running the guide locally To run the guide locally, for example to check the correct implementation of a new translation, you will need to: 1. Install Node >=18.0.0 1. Install `pnpm` if not present in your system. Check [here](https://pnpm.io/installation) for detailed instructions. 1. Install the dependencies: `pnpm i next react react-dom nextra nextra-theme-docs` 1. Boot the guide with `pnpm dev` 2. Browse the guide at `http://localhost:3000/` --- ## Appearances Some places where we have been featured: - Wall Street Journal - [ChatGPT Can Give Great Answers. But Only If You Know How to Ask the Right Question](https://www.wsj.com/articles/chatgpt-ask-the-right-question-12d0f035) - Forbes - [Mom, Dad, I Want To Be A Prompt Engineer](https://www.forbes.com/sites/craigsmith/2023/04/05/mom-dad-i-want-to-be-a-prompt-engineer/?sh=7f1213159c8e) - Markettechpost - [Best Free Prompt Engineering Resources (2023)](https://www.marktechpost.com/2023/04/04/best-free-prompt-engineering-resources-2023/) --- If you are using the guide for your work or research, please cite us as follows: ``` @article{Saravia_Prompt_Engineering_Guide_2022, author = {Saravia, Elvis}, journal = {https://github.com/dair-ai/Prompt-Engineering-Guide}, month = {12}, title = {{Prompt Engineering Guide}}, year = {2022} } ``` ## License [MIT License](https://github.com/dair-ai/Prompt-Engineering-Guide/blob/main/LICENSE.md) Feel free to open a PR if you think something is missing here. Always welcome feedback and suggestions. Just open an issue! ", Assign "at most 3 tags" to the expected json: {"id":"4695","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"