{"id":272382,"date":"2025-11-05T05:23:09","date_gmt":"2025-11-05T05:23:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/272382\/"},"modified":"2025-11-05T05:23:09","modified_gmt":"2025-11-05T05:23:09","slug":"building-more-efficient-ai-agents-anthropic","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/272382\/","title":{"rendered":"building more efficient AI agents \\ Anthropic"},"content":{"rendered":"

The Model Context Protocol (MCP)<\/a> is an open standard for connecting AI agents to external systems. Connecting agents to tools and data traditionally requires a custom integration for each pairing, creating fragmentation and duplicated effort that makes it difficult to scale truly connected systems. MCP provides a universal protocol\u2014developers implement MCP once in their agent and it unlocks an entire ecosystem of integrations.<\/p>\n

Since launching MCP in November 2024, adoption has been rapid: the community has built thousands of MCP servers<\/a>, SDKs<\/a> are available for all major programming languages, and the industry has adopted MCP as the de-facto standard for connecting agents to tools and data.<\/p>\n

Today developers routinely build agents with access to hundreds or thousands of tools across dozens of MCP servers. However, as the number of connected tools grows, loading all tool definitions upfront and passing intermediate results through the context window slows down agents and increases costs.<\/p>\n

In this blog we’ll explore how code execution can enable agents to interact with MCP servers more efficiently, handling more tools while using fewer tokens.<\/p>\n

Excessive token consumption from tools makes agents less efficient<\/p>\n

As MCP usage scales, there are two common patterns that can increase agent cost and latency:<\/p>\n

Tool definitions overload the context window;Intermediate tool results consume additional tokens.1. Tool definitions overload the context window<\/p>\n

Most MCP clients load all tool definitions upfront directly into context, exposing them to the model using a direct tool-calling syntax. These tool definitions might look like: <\/p>\n

gdrive.getDocument
\n Description: Retrieves a document from Google Drive
\n Parameters:
\n documentId (required, string): The ID of the document to retrieve
\n fields (optional, string): Specific fields to return
\n Returns: Document object with title, body content, metadata, permissions, etc.salesforce.updateRecord
\n Description: Updates a record in Salesforce
\n Parameters:
\n objectType (required, string): Type of Salesforce object (Lead, Contact, Account, etc.)
\n recordId (required, string): The ID of the record to update
\n data (required, object): Fields to update with their new values
\n Returns: Updated record object with confirmation<\/p>\n

Tool descriptions occupy more context window space, increasing response time and costs. In cases where agents are connected to thousands of tools, they\u2019ll need to process hundreds of thousands of tokens before reading a request.<\/p>\n

2. Intermediate tool results consume additional tokens<\/p>\n

Most MCP clients allow models to directly call MCP tools. For example, you might ask your agent: “Download my meeting transcript from Google Drive and attach it to the Salesforce lead.”<\/p>\n

The model will make calls like:<\/p>\n

TOOL CALL: gdrive.getDocument(documentId: “abc123”)
\n \u2192 returns “Discussed Q4 goals…\\n[full transcript text]”
\n (loaded into model context)<\/p>\n

TOOL CALL: salesforce.updateRecord(
\n\t\t\tobjectType: “SalesMeeting”,
\n\t\t\trecordId: “00Q5f000001abcXYZ”,
\n \t\t\tdata: { “Notes”: “Discussed Q4 goals…\\n[full transcript text written out]” }
\n\t\t)
\n\t\t(model needs to write entire transcript into context again)<\/p>\n

Every intermediate result must pass through the model. In this example, the full call transcript flows through twice. For a 2-hour sales meeting, that could mean processing an additional 50,000 tokens. Even larger documents may exceed context window limits, breaking the workflow.<\/p>\n

With large documents or complex data structures, models may be more likely to make mistakes when copying data between tool calls.<\/p>\n

\"ImageThe MCP client loads tool definitions into the model’s context window and orchestrates a message loop where each tool call and result passes through the model between operations.Code execution with MCP improves context efficiency<\/p>\n

With code execution environments becoming more common for agents, a solution is to present MCP servers as code APIs rather than direct tool calls. The agent can then write code to interact with MCP servers. This approach addresses both challenges: agents can load only the tools they need and process data in the execution environment before passing results back to the model.<\/p>\n

There are a number of ways to do this. One approach is to generate a file tree of all available tools from connected MCP servers. Here’s an implementation using TypeScript:<\/p>\n

servers
\n\u251c\u2500\u2500 google-drive
\n\u2502 \u251c\u2500\u2500 getDocument.ts
\n\u2502 \u251c\u2500\u2500 … (other tools)
\n\u2502 \u2514\u2500\u2500 index.ts
\n\u251c\u2500\u2500 salesforce
\n\u2502 \u251c\u2500\u2500 updateRecord.ts
\n\u2502 \u251c\u2500\u2500 … (other tools)
\n\u2502 \u2514\u2500\u2500 index.ts
\n\u2514\u2500\u2500 … (other servers)<\/p>\n

Then each tool corresponds to a file, something like:<\/p>\n

\/\/ .\/servers\/google-drive\/getDocument.ts
\nimport { callMCPTool } from “..\/..\/..\/client.js”;<\/p>\n

interface GetDocumentInput {
\n documentId: string;
\n}<\/p>\n

interface GetDocumentResponse {
\n content: string;
\n}<\/p>\n

\/* Read a document from Google Drive *\/
\nexport async function getDocument(input: GetDocumentInput): Promise {
\n return callMCPTool(‘google_drive__get_document’, input);
\n}<\/p>\n

Our Google Drive to Salesforce example above becomes the code:<\/p>\n

\/\/ Read transcript from Google Docs and add to Salesforce prospect
\nimport * as gdrive from ‘.\/servers\/google-drive’;
\nimport * as salesforce from ‘.\/servers\/salesforce’;<\/p>\n

const transcript = (await gdrive.getDocument({ documentId: ‘abc123’ })).content;
\nawait salesforce.updateRecord({
\n objectType: ‘SalesMeeting’,
\n recordId: ’00Q5f000001abcXYZ’,
\n data: { Notes: transcript }
\n});<\/p>\n

The agent discovers tools by exploring the filesystem: listing the .\/servers\/ directory to find available servers (like google-drive and salesforce), then reading the specific tool files it needs (like getDocument.ts and updateRecord.ts) to understand each tool’s interface. This lets the agent load only the definitions it needs for the current task. This reduces the token usage from 150,000 tokens to 2,000 tokens\u2014a time and cost saving of 98.7%.<\/p>\n

Cloudflare published similar findings<\/a>, referring to code execution with MCP as \u201cCode Mode.” The core insight is the same: LLMs are adept at writing code and developers should take advantage of this strength to build agents that interact with MCP servers more efficiently.<\/p>\n

Benefits of code execution with MCP<\/p>\n

Code execution with MCP enables agents to use context more efficiently by loading tools on demand, filtering data before it reaches the model, and executing complex logic in a single step. There are also security and state management benefits to using this approach.<\/p>\n

Progressive disclosure<\/p>\n

Models are great at navigating filesystems. Presenting tools as code on a filesystem allows models to read tool definitions on-demand, rather than reading them all up-front.<\/p>\n

Alternatively, a search_tools tool can be added to the server to find relevant definitions. For example, when working with the hypothetical Salesforce server used above, the agent searches for “salesforce” and loads only those tools that it needs for the current task. Including a detail level parameter in the search_tools tool that allows the agent to select the level of detail required (such as name only, name and description, or the full definition with schemas) also helps the agent conserve context and find tools efficiently.<\/p>\n

Context efficient tool results<\/p>\n

When working with large datasets, agents can filter and transform results in code before returning them. Consider fetching a 10,000-row spreadsheet:<\/p>\n

\/\/ Without code execution – all rows flow through context
\nTOOL CALL: gdrive.getSheet(sheetId: ‘abc123’)
\n \u2192 returns 10,000 rows in context to filter manually<\/p>\n

\/\/ With code execution – filter in the execution environment
\nconst allRows = await gdrive.getSheet({ sheetId: ‘abc123’ });
\nconst pendingOrders = allRows.filter(row =>
\n row[“Status”] === ‘pending’
\n);
\nconsole.log(`Found ${pendingOrders.length} pending orders`);
\nconsole.log(pendingOrders.slice(0, 5)); \/\/ Only log first 5 for review<\/p>\n

The agent sees five rows instead of 10,000. Similar patterns work for aggregations, joins across multiple data sources, or extracting specific fields\u2014all without bloating the context window.<\/p>\n

More powerful and context-efficient control flow<\/p>\n

Loops, conditionals, and error handling can be done with familiar code patterns rather than chaining individual tool calls. For example, if you need a deployment notification in Slack, the agent can write:<\/p>\n

let found = false;
\nwhile (!found) {
\n const messages = await slack.getChannelHistory({ channel: ‘C123456’ });
\n found = messages.some(m => m.text.includes(‘deployment complete’));
\n if (!found) await new Promise(r => setTimeout(r, 5000));
\n}
\nconsole.log(‘Deployment notification received’);<\/p>\n

This approach is more efficient than alternating between MCP tool calls and sleep commands through the agent loop.<\/p>\n

Additionally, being able to write out a conditional tree that gets executed also saves on \u201ctime to first token\u201d latency: rather than having to wait for a model to evaluate an if-statement, the agent can let the code execution environment do this.<\/p>\n

Privacy-preserving operations<\/p>\n

When agents use code execution with MCP, intermediate results stay in the execution environment by default. This way, the agent only sees what you explicitly log or return, meaning data you don\u2019t wish to share with the model can flow through your workflow without ever entering the model’s context.<\/p>\n

For even more sensitive workloads, the agent harness can tokenize sensitive data automatically. For example, imagine you need to import customer contact details from a spreadsheet into Salesforce. The agent writes:<\/p>\n

const sheet = await gdrive.getSheet({ sheetId: ‘abc123’ });
\nfor (const row of sheet.rows) {
\n await salesforce.updateRecord({
\n objectType: ‘Lead’,
\n recordId: row.salesforceId,
\n data: {
\n Email: row.email,
\n Phone: row.phone,
\n Name: row.name
\n }
\n });
\n}
\nconsole.log(`Updated ${sheet.rows.length} leads`);<\/p>\n

The MCP client intercepts the data and tokenizes PII before it reaches the model:<\/p>\n

\/\/ What the agent would see, if it logged the sheet.rows:
\n[
\n { salesforceId: ’00Q…’, email: ‘[EMAIL_1]’, phone: ‘[PHONE_1]’, name: ‘[NAME_1]’ },
\n { salesforceId: ’00Q…’, email: ‘[EMAIL_2]’, phone: ‘[PHONE_2]’, name: ‘[NAME_2]’ },
\n …
\n]<\/p>\n

Then, when the data is shared in another MCP tool call, it is untokenized via a lookup in the MCP client. The real email addresses, phone numbers, and names flow from Google Sheets to Salesforce, but never through the model. This prevents the agent from accidentally logging or processing sensitive data. You can also use this to define deterministic security rules, choosing where data can flow to and from.<\/p>\n

State persistence and skills<\/p>\n

Code execution with filesystem access allows agents to maintain state across operations. Agents can write intermediate results to files, enabling them to resume work and track progress:<\/p>\n

const leads = await salesforce.query({
\n query: ‘SELECT Id, Email FROM Lead LIMIT 1000’
\n});
\nconst csvData = leads.map(l => `${l.Id},${l.Email}`).join(‘\\n’);
\nawait fs.writeFile(‘.\/workspace\/leads.csv’, csvData);<\/p>\n

\/\/ Later execution picks up where it left off
\nconst saved = await fs.readFile(‘.\/workspace\/leads.csv’, ‘utf-8’);<\/p>\n

Agents can also persist their own code as reusable functions. Once an agent develops working code for a task, it can save that implementation for future use:<\/p>\n

\/\/ In .\/skills\/save-sheet-as-csv.ts
\nimport * as gdrive from ‘.\/servers\/google-drive’;
\nexport async function saveSheetAsCsv(sheetId: string) {
\n const data = await gdrive.getSheet({ sheetId });
\n const csv = data.map(row => row.join(‘,’)).join(‘\\n’);
\n await fs.writeFile(`.\/workspace\/sheet-${sheetId}.csv`, csv);
\n return `.\/workspace\/sheet-${sheetId}.csv`;
\n}<\/p>\n

\/\/ Later, in any agent execution:
\nimport { saveSheetAsCsv } from ‘.\/skills\/save-sheet-as-csv’;
\nconst csvPath = await saveSheetAsCsv(‘abc123’);<\/p>\n

This ties in closely to the concept of Skills<\/a>, folders of reusable instructions, scripts, and resources for models to improve performance on specialized tasks. Adding a SKILL.md file to these saved functions creates a structured skill that models can reference and use. Over time, this allows your agent to build a toolbox of higher-level capabilities, evolving the scaffolding that it needs to work most effectively.<\/p>\n

Note that code execution introduces its own complexity. Running agent-generated code requires a secure execution environment with appropriate sandboxing<\/a>, resource limits, and monitoring. These infrastructure requirements add operational overhead and security considerations that direct tool calls avoid. The benefits of code execution\u2014reduced token costs, lower latency, and improved tool composition\u2014should be weighed against these implementation costs.<\/p>\n

Summary<\/p>\n

MCP provides a foundational protocol for agents to connect to many tools and systems. However, once too many servers are connected, tool definitions and results can consume excessive tokens, reducing agent efficiency.<\/p>\n

Although many of the problems here feel novel\u2014context management, tool composition, state persistence\u2014they have known solutions from software engineering. Code execution applies these established patterns to agents, letting them use familiar programming constructs to interact with MCP servers more efficiently. If you implement this approach, we encourage you to share your findings with the MCP community<\/a>.<\/p>\n

Acknowledgments <\/p>\n

This article was written by Adam Jones and Conor Kelly. Thanks to Jeremy Fox, Jerome Swannack, Stuart Ritchie, Molly Vorwerck, Matt Samuels, and Maggie Vo for feedback on drafts of this post.<\/p>\n","protected":false},"excerpt":{"rendered":"The Model Context Protocol (MCP) is an open standard for connecting AI agents to external systems. Connecting agents…\n","protected":false},"author":2,"featured_media":272383,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,74],"class_list":{"0":"post-272382","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/272382","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=272382"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/272382\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/272383"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=272382"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=272382"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=272382"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}