aiagent.club
English

可观测性与评测

追踪、评测、监控、成本控制与 Agent 质量系统。

规则推断分类 · 同一项目可属于多个分类

可观测性与评测 · 2

主榜项目至少要有两个当前有效的评分维度,且覆盖两种数据源。综合分 = 可观测采用度(45%)+动量(30%)+关注度(25%);过期或缺失信号不计分。

  1. 2
    litellm GHPyPI

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    341.6M 可观测/月 58.5k ▲ 450 ★/周 3/3 当前信号

    93
  2. 42
    agentops GHPyPI

    Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

    183.5k 可观测/月 5.8k ▲ 7 ★/周 3/3 当前信号

    27