mlco2/ecologits

Can I Run AI

Track emissions from Compute and recommend ways to reduce their impact on the environment.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Collection of evals for Inspect AI

Evaluate your LLM's response with Prometheus and GPT4 💯

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

TUI and CLI for browsing models.dev, benchmarks, coding agents, and statuses for AI providers.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Track and predict the energy consumption and carbon footprint of training deep learning models.