Cloud-CV/EvalAI

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

ModelScope: bring the notion of Model-as-a-Service to life.

1 API key. 220,000+ AI models. Bytez is the largest serverless Model Inference API on the internet. Let's build ✨

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Gemini, Ollama, etc supported. 🎆 Code RAG

Give your agents the power of the Hugging Face ecosystem

AI agent microservice