Observability & traceability
Weights & Biases product for tracking LLM calls and application logic with automatic tracing and cost tracking, scorer-based evaluation and comparison tools, plus pre- and post-response safeguards. Platform controls include role-based access at team or project level, SSO via OIDC, SCIM provisioning and scoped service accounts.
commercial · generally available · Research snapshot 2026-09-06
Visit the official product source ↗Observability & traceability · Evaluation & testing · Model lifecycle & governance
Useful conversation with: ML platform lead, AI engineer, MLOps manager.
Show me a traced LLM application with cost tracking, and demonstrate restricting project access to a named team using SSO-provisioned users.
Support labels reflect the supplied research. Documentation and vendor claims are not independent product tests. “Not established” means the researcher did not find support; it does not prove a capability is absent.
Documented by provider
Weave tracks LLM calls and application logic to debug and analyse production systems, with automatic tracing and cost tracking when connected to existing LLM providers, and supports evaluation with custom or pre-built scorers plus comparison tools.
Limit: Docs home does not state capture of tool calls, multi-agent handoffs, sessions or token-level metrics.
Documented by provider
Platform documentation states role-based access control configurable at team or project level, SSO with public and enterprise identity providers over OIDC, a SCIM API and Python SDK for user and team management, team-based logical separation, a restricted project scope, scoped service accounts, SOC 2 Type II compliance for both platforms and HIPAA compliance for Dedicated Cloud.
Limit: Audit logs, retention settings and PII masking are not stated, and the secure storage connector (BYOB) is explicitly unavailable for Weave.
Documented by provider
Weave supports pre- and post-safeguards for content moderation and prompt safety.
Limit: No documented policy authoring model, enforcement guarantees or logging of blocked calls.
Listing does not imply partnership, supplier status, a working DutyGraph integration, or a compliance certification.
Suggest a correction