Coinbase says it cut a 90-case AI support test from 1–2 weeks to 30–45 minutes

Key Summary

Coinbase has reduced its support-testing cycle for its Autopilot AI system from 1-2 weeks to 30-45 minutes, as disclosed by its engineers on September 21. This system, which tests procedures for support bots handling customer problems, uses adversarial conversations and expected behavior tests to evaluate its performance. The AI model scores conversations and human review is required before procedure changes reach production. The company has also implemented permission checks and authorization systems to ensure customer data is accessed only with proper authority. While automation has reduced repetitive work, customer response times and staffing savings remain unmeasured.