Mercor Optimizes Internal AI Workloads Using Vercel Tools

What happened

Mercor significantly improved its internal application workflows by integrating Vercel AI Gateway and Passport. The company reduced the time needed for batch jobs from 12 hours to just 2 hours. This optimization allowed for faster processing of 18 million requests and 63 billion tokens within 10 days.

Internal teams at Mercor now have quicker access to applications, enabling experts to interact with tools in seconds. This shift supports the company's need for tailored applications that allow for real-time task monitoring without waiting for platform updates.

Why it matters

The efficiency gains from Vercel's tools help Mercor manage large-scale AI operations more effectively. By streamlining internal workflows, the company can better allocate resources and respond to business demands without delays. This is especially critical for time-sensitive tasks that previously exceeded 24-hour deadlines.

Key details

Mercor's internal development has grown dramatically, with over 2,000 projects created by hundreds of internal builders on Vercel. This represents a jump from fewer than a dozen projects to a much larger scale, highlighting the platform's flexibility for different use cases.

The company also uses agents for various internal functions, such as answering questions and automating workflows. These agents have narrow permissions and can be scoped to limit model access, set expiration dates, and cap spending.