Suda All posts
context-engineering

What is context engineering, and why it decides whether AI agents work

Context engineering is the practice of designing what an AI agent knows at the moment it acts. Here is what it means, how it differs from prompting, and how to do it.

Context engineering is the practice of designing and managing the information an AI agent has at the moment it acts: what it knows, where that knowledge comes from, and how current it is. It has quietly become the thing that decides whether an agent is reliable or not. Suda is built for the hardest part of it. This piece explains what context engineering is, how it differs from prompt engineering, and how to do it without drowning the model.

The short answer

A model is fixed. What changes from one answer to the next is the context you put in front of it. Context engineering is the discipline of getting that context right: pulling the relevant facts, keeping them current, resolving contradictions, and passing only what the task needs.

The field grew out of a simple realization. Most agent failures are not the model being dumb. They are the model being fed stale, conflicting, or incomplete context and doing its best with it. Fix the context and the same model becomes reliable.

Context engineering vs prompt engineering

Prompt engineering is about wording: phrasing the instruction so the model does the right thing. It matters, but it operates on the static part of the request.

Context engineering is about substance: which facts reach the model, from which of your systems, and whether they are true right now. A perfectly worded prompt over stale data still gives a stale answer. The deeper comparison is in context engineering vs prompt engineering, but the short version is that prompting shapes the question and context engineering supplies the truth.

What good context engineering actually involves

In production, context engineering spans a handful of jobs:

  • Retrieval. Find the facts that bear on this specific task, not everything that looks similar. Over-retrieval is as harmful as under-retrieval.
  • Freshness. Make sure what you pass reflects the present state. A fact that was true last quarter is a liability now.
  • Conflict resolution. When two sources disagree, decide which is current instead of handing the model both and hoping.
  • Compression and budgeting. Pass the least context that fully answers the question. More tokens mean more cost and more noise for the model to wade through.
  • Permission. Only surface context the requester is allowed to see.

Do these by hand for one prompt and it is tedious. Do them across a whole company, for every agent, on data that changes hourly, and it becomes infrastructure.

Why unifying knowledge is the hard part

The reason context engineering is hard in a real company is that the knowledge is scattered. It lives across Notion, Slack, Linear, drives, CRMs, and databases, and none of them agree on what is current. Stitching that into one coherent, up-to-date view is the actual work.

This is where a context graph earns its place. Instead of re-solving retrieval and freshness for every agent, you build one living map of your facts and their relationships, keep it current, and let agents query it. Suda does this over MCP, the Model Context Protocol, so the agents in your stack read real context directly. Because the graph sends only the context a question needs, it passes far less text to the model, about 85% less per answer in Suda’s case, which cuts token cost and noise at the same time.

Context engineering solutions: how to start

You do not need a research team to practice context engineering. Start by treating context as infrastructure rather than something you paste into a prompt:

  1. Connect your sources so the facts live in one place instead of ten.
  2. Make freshness and conflict resolution automatic, not manual.
  3. Expose that context to your agents over a standard interface like MCP.
  4. Pass the minimum context per task, and measure token cost as a signal of noise.

With Suda that is close to one command:

npx suda connect

The takeaway

Context engineering is where AI agents are won or lost. The model is a constant; the context is the variable you control. Get retrieval, freshness, and permission right and an ordinary model becomes dependable. The scalable way to get them right is to build the context once, as a graph, and let every agent read from it.

See how Suda does it on the home page.