base on ZenML 🙏: The bridge between ML and Ops. https://zenml.io. <div align="center"> <img referrerpolicy="no-referrer-when-downgrade" src="https://static.scarf.sh/a.png?x-pxid=0fcbab94-8fbe-4a38-93e8-c2348450a42e" /> <h1 align="center">Connecting data science teams seamlessly to cloud infrastructure. </h1> </div> <!-- PROJECT SHIELDS --> <!-- *** I'm using markdown "reference style" links for readability. *** Reference links are enclosed in brackets [ ] instead of parentheses ( ). *** See the bottom of this document for the declaration of the reference variables *** for contributors-url, forks-url, etc. This is an optional, concise syntax you may use. *** https://www.markdownguide.org/basic-syntax/#reference-style-links --> <div align="center"> <!-- PROJECT LOGO --> <br /> <a href="https://zenml.io"> <img alt="ZenML Logo" src="docs/book/.gitbook/assets/header.png" alt="ZenML Logo"> </a> <br /> [![PyPi][pypi-shield]][pypi-url] [![PyPi][pypiversion-shield]][pypi-url] [![PyPi][downloads-shield]][downloads-url] [![Contributors][contributors-shield]][contributors-url] [![License][license-shield]][license-url] <!-- [![Build][build-shield]][build-url] --> <!-- [![CodeCov][codecov-shield]][codecov-url] --> </div> <!-- MARKDOWN LINKS & IMAGES --> <!-- https://www.markdownguide.org/basic-syntax/#reference-style-links --> [pypi-shield]: https://img.shields.io/pypi/pyversions/zenml?color=281158 [pypi-url]: https://pypi.org/project/zenml/ [pypiversion-shield]: https://img.shields.io/pypi/v/zenml?color=361776 [downloads-shield]: https://img.shields.io/pypi/dm/zenml?color=431D93 [downloads-url]: https://pypi.org/project/zenml/ [codecov-shield]: https://img.shields.io/codecov/c/gh/zenml-io/zenml?color=7A3EF4 [codecov-url]: https://codecov.io/gh/zenml-io/zenml [contributors-shield]: https://img.shields.io/github/contributors/zenml-io/zenml?color=7A3EF4 [contributors-url]: https://github.com/zenml-io/zenml/graphs/contributors [license-shield]: https://img.shields.io/github/license/zenml-io/zenml?color=9565F6 [license-url]: https://github.com/zenml-io/zenml/blob/main/LICENSE [linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555 [linkedin-url]: https://www.linkedin.com/company/zenml/ [twitter-shield]: https://img.shields.io/twitter/follow/zenml_io?style=for-the-badge [twitter-url]: https://twitter.com/zenml_io [slack-shield]: https://img.shields.io/badge/-Slack-black.svg?style=for-the-badge&logo=linkedin&colorB=555 [slack-url]: https://zenml.io/slack-invite [build-shield]: https://img.shields.io/github/workflow/status/zenml-io/zenml/Build,%20Lint,%20Unit%20&%20Integration%20Test/develop?logo=github&style=for-the-badge [build-url]: https://github.com/zenml-io/zenml/actions/workflows/ci.yml --- ## ⭐️ Show Your Support If you find ZenML helpful or interesting, please consider giving us a star on GitHub. Your support helps promote the project and lets others know that it's worth checking out. Thank you for your support! 🌟 [](https://github.com/zenml-io/zenml/stargazers) ## 🤸 Quickstart [](https://colab.research.google.com/github/zenml-io/zenml/blob/main/examples/quickstart/quickstart.ipynb) [Install ZenML](https://docs.zenml.io/getting-started/installation) via [PyPI](https://pypi.org/project/zenml/). Python 3.9 - 3.12 is required: ```bash pip install "zenml[server]" notebook ``` Take a tour with the guided quickstart by running: ```bash zenml go ``` ## 🪄 Simple, integrated, End-to-end MLOps ### Create machine learning pipelines with minimal code changes ZenML is a MLOps framework intended for data scientists or ML engineers looking to standardize machine learning practices. Just add `@step` and `@pipeline` to your existing Python functions to get going. Here is a toy example: ```python from zenml import pipeline, step @step # Just add this decorator def load_data() -> dict: training_data = [[1, 2], [3, 4], [5, 6]] labels = [0, 1, 0] return {'features': training_data, 'labels': labels} @step def train_model(data: dict) -> None: total_features = sum(map(sum, data['features'])) total_labels = sum(data['labels']) print(f"Trained model using {len(data['features'])} data points. " f"Feature sum is {total_features}, label sum is {total_labels}") @pipeline # This function combines steps together def simple_ml_pipeline(): dataset = load_data() train_model(dataset) if __name__ == "__main__": run = simple_ml_pipeline() # call this to run the pipeline ```  ### Easily provision an MLOps stack or reuse your existing infrastructure The framework is a gentle entry point for practitioners to build complex ML pipelines with little knowledge required of the underlying infrastructure complexity. ZenML pipelines can be run on AWS, GCP, Azure, Airflow, Kubeflow and even on Kubernetes without having to change any code or know underlying internals. ZenML provides different features to aid people to get started quickly on a remote setting as well. If you want to deploy a remote stack from scratch on your selected cloud provider, you can use the 1-click deployment feature either through the dashboard:  Or, through our CLI command: ```bash zenml stack deploy --provider aws ``` Alternatively, if the necessary pieces of infrastructure is already deployed, you can register a cloud stack seamlessly through the stack wizard: ```bash zenml stack register <STACK_NAME> --provider aws ``` Read more about [ZenML stacks](https://docs.zenml.io/user-guide/production-guide/understand-stacks). ### Run workloads easily on your production infrastructure Once you have your MLOps stack configured, you can easily run workloads on it: ```bash zenml stack set <STACK_NAME> python run.py ``` ```python from zenml.config import ResourceSettings, DockerSettings @step( settings={ "resources": ResourceSettings(memory="16GB", gpu_count="1", cpu_count="8"), "docker": DockerSettings(parent_image="pytorch/pytorch:1.12.1-cuda11.3-cudnn8-runtime") } ) def training(...): ... ```  ### Track models, pipeline, and artifacts Create a complete lineage of who, where, and what data and models are produced. You’ll be able to find out who produced which model, at what time, with which data, and on which version of the code. This guarantees full reproducibility and auditability. ```python from zenml import Model @step(model=Model(name="classification")) def trainer(training_df: pd.DataFrame) -> Annotated["model", torch.nn.Module]: ... ```  ### Purpose built for machine learning with integration to you favorite tools While ZenML brings a lot of value of the box, it also integrates into your existing tooling and infrastructure without you having to be locked in. ```python from bentoml._internal.bento import bento @step(on_failure=alert_slack, experiment_tracker="mlflow") def train_and_deploy(training_df: pd.DataFrame) -> bento.Bento mlflow.autolog() ... return bento ```  ## 🖼️ Learning The best way to learn about ZenML is the [docs](https://docs.zenml.io/). We recommend beginning with the [Starter Guide](https://docs.zenml.io/user-guide/starter-guide) to get up and running quickly. If you are a visual learner, this 11-minute video tutorial is also a great start: [](https://www.youtube.com/watch?v=wEVwIkDvUPs) And finally, here are some other examples and use cases for inspiration: 1. [E2E Batch Inference](examples/e2e/): Feature engineering, training, and inference pipelines for tabular machine learning. 2. [Basic NLP with BERT](examples/e2e_nlp/): Feature engineering, training, and inference focused on NLP. 3. [LLM RAG Pipeline with Langchain and OpenAI](https://github.com/zenml-io/zenml-projects/tree/main/llm-agents): Using Langchain to create a simple RAG pipeline. 4. [Huggingface Model to Sagemaker Endpoint](https://github.com/zenml-io/zenml-projects/tree/main/huggingface-sagemaker): Automated MLOps on Amazon Sagemaker and HuggingFace 5. [LLMops](https://github.com/zenml-io/zenml-projects/tree/main/llm-complete-guide): Complete guide to do LLM with ZenML ## 📚 Learn from Books <div align="center"> <a href="https://www.amazon.com/LLM-Engineers-Handbook-engineering-production/dp/1836200072"> <img src="docs/book/.gitbook/assets/llm_engineering_handbook_cover.jpg" alt="LLM Engineer's Handbook Cover" width="200"/></img> </a>&nbsp;&nbsp;&nbsp;&nbsp; <a href="https://www.amazon.com/-/en/Andrew-McMahon/dp/1837631964"> <img src="docs/book/.gitbook/assets/ml_engineering_with_python.jpg" alt="Machine Learning Engineering with Python Cover" width="200"/></img> </a> </br></br> </div> ZenML is featured in these comprehensive guides to modern MLOps and LLM engineering. Learn how to build production-ready machine learning systems with real-world examples and best practices. ## 🔋 Deploy ZenML For full functionality ZenML should be deployed on the cloud to enable collaborative features as the central MLOps interface for teams. Read more about various deployment options [here](https://docs.zenml.io/getting-started/deploying-zenml). Or, sign up for [ZenML Pro to get a fully managed server on a free trial](https://cloud.zenml.io/?utm_source=readme&utm_medium=referral_link&utm_campaign=cloud_promotion&utm_content=signup_link). ## Use ZenML with VS Code ZenML has a [VS Code extension](https://marketplace.visualstudio.com/items?itemName=ZenML.zenml-vscode) that allows you to inspect your stacks and pipeline runs directly from your editor. The extension also allows you to switch your stacks without needing to type any CLI commands. <details> <summary>🖥️ VS Code Extension in Action!</summary> <div align="center"> <img width="60%" src="/docs/book/.gitbook/assets/zenml-extension-shortened.gif" alt="ZenML Extension"> </div> </details> ## 🗺 Roadmap ZenML is being built in public. The [roadmap](https://zenml.io/roadmap) is a regularly updated source of truth for the ZenML community to understand where the product is going in the short, medium, and long term. ZenML is managed by a [core team](https://zenml.io/company) of developers that are responsible for making key decisions and incorporating feedback from the community. The team oversees feedback via various channels, and you can directly influence the roadmap as follows: - Vote on your most wanted feature on our [Discussion board](https://zenml.io/discussion). - Start a thread in our [Slack channel](https://zenml.io/slack). - [Create an issue](https://github.com/zenml-io/zenml/issues/new/choose) on our GitHub repo. ## 🙌 Contributing and Community We would love to develop ZenML together with our community! The best way to get started is to select any issue from the `[good-first-issue` label](https://github.com/issues?q=is%3Aopen+is%3Aissue+archived%3Afalse+user%3Azenml-io+label%3A%22good+first+issue%22) and open up a Pull Request! If you would like to contribute, please review our [Contributing Guide](CONTRIBUTING.md) for all relevant details. ## 🆘 Getting Help The first point of call should be [our Slack group](https://zenml.io/slack-invite/). Ask your questions about bugs or specific use cases, and someone from the [core team](https://zenml.io/company) will respond. Or, if you prefer, [open an issue](https://github.com/zenml-io/zenml/issues/new/choose) on our GitHub repo. ## ⭐️ Show Your Support If you find ZenML helpful or interesting, please consider giving us a star on GitHub. Your support helps promote the project and lets others know that it's worth checking out. Thank you for your support! 🌟 [](https://github.com/zenml-io/zenml/stargazers) ## 📜 License ZenML is distributed under the terms of the Apache License Version 2.0. A complete version of the license is available in the [LICENSE](LICENSE) file in this repository. Any contribution made to this project will be licensed under the Apache License Version 2.0. <div> <p align="left"> <div align="left"> Join our <a href="https://zenml.io/slack" target="_blank"> <img width="18" src="https://cdn3.iconfinder.com/data/icons/logos-and-brands-adobe/512/306_Slack-512.png" alt="Slack"/> <b>Slack Community</b> </a> and be part of the ZenML family. </div> <br /> <a href="https://zenml.io/features">Features</a> · <a href="https://zenml.io/roadmap">Roadmap</a> · <a href="https://github.com/zenml-io/zenml/issues">Report Bug</a> · <a href="https://zenml.io/pro">Sign up for ZenML Pro</a> · <a href="https://www.zenml.io/blog">Read Blog</a> · <a href="https://github.com/issues?q=is%3Aopen+is%3Aissue+archived%3Afalse+user%3Azenml-io+label%3A%22good+first+issue%22">Contribute to Open Source</a> · <a href="https://github.com/zenml-io/zenml-projects">Projects Showcase</a> <br /> <br /> 🎉 Version 0.71.0 is out. Check out the release notes <a href="https://github.com/zenml-io/zenml/releases">here</a>. <br /> 🖥️ Download our VS Code Extension <a href="https://marketplace.visualstudio.com/items?itemName=ZenML.zenml-vscode">here</a>. <br /> </p> </div> ", Assign "at most 3 tags" to the expected json: {"id":"12377","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"