Campus AI Development From experiment to production

8.1 — Capacity and pathways

From experiment to production

When building is cheap, the hard part is people and judgment: who writes the spec, who checks the output, who owns the result. Here is what it takes to move an idea from one person’s experiment to something others rely on, with gates scaled to the risk.

Competencies

What matters once building is cheap

Effort moves from writing code to deciding what to build and checking it. This builds on the skills table; the right-hand column says where each skill matters most.

CompetencyWhat it looks likeMatters most for
Writing specs and acceptance criteriaWhat it does, what it doesn’t, how you’ll know it works, written before the agent startsFunctional analysts, enterprise teams, platform makers
Designing verification when not every line is readTests from the spec, protected test files, and diff review for what was removed as well as added. Spec-drivenEnterprise teams, research software engineers
Scoping agentsPermissions, context, budgets and stop conditions set before a runPlatform makers, IT, anyone running agents
Reviewing AI output criticallyIf you can’t explain it, don’t ship itEveryone; faculty teaching it
Knowing the dataIts classification, authoritative source and stewardBusiness users, analysts, researchers
Knowing when not to use an agentHigh stakes, unfamiliar systems, regulated data or no way to check the resultEveryone

Environments

Safe places to experiment

Three tracks, each with its own data rules. Moving between them is the promotion step.

Personal · T1–T2

A sandbox for one person

  • Campus-licensed account, not a personal one
  • Public or synthetic data only
  • No production credentials
  • Throw away or promote
Shared · T2–T3

A team or unit environment

  • Internal data; confidential only with steward approval
  • Version control and a registry entry
  • Named owner and review date
  • Scoped, revocable credentials
Institutional · T3 and up

A managed platform

  • Data as classified, in an approved environment
  • CI gates, tests and security checks
  • Audit logs the builder can’t edit
  • Support path and offboarding plan

Data rules for pilots

  1. 01Synthetic or de-identified firstProve the idea before real records enter it.
  2. 02Real data only where approvedUse the track approved for the data’s level, with steward sign-off at confidential and above.
  3. 03Outputs inherit the classificationA report or export built from confidential data stays confidential.
  4. 04Pilots end cleanlyAt the review date, pilot data is deleted or kept on the retention schedule.

Make the sanctioned path the easy one

People use personal accounts when the approved path is slower. Licensed access granted in days, starter templates, provided hosting and a review that is quicker than working around it do more than a policy can. Over-governing has its own cost; see proportionality and the shadow tool case.

Patterns

Pairings that work in practice

None of these needs a new office. Each puts domain knowledge and technical judgment in the same room.

Pairing

Domain expert + platform partner

The person who knows the work builds; IT or a platform team supplies the environment, credentials, integration and review.

Community

A lightweight community of practice

Builders across units share specs, prompts, guardrails and mistakes. It also shows where tools overlap before they multiply.

Review

Paired review

A second person reviews diffs, tests and data access before others use the tool, scaled to the tier. A research software engineer plays this role for research code.

On campus

Emerson’s shared environment and doctrine

At Emerson, the people building knew the operations; none needed to be programmers. IT leadership supplied a shared approach: a written development plan, the “doctrine,” fed into every AI session, with architecture decisions recorded back into it, and a schema designed before features.

That combination let seven systems reach production. Read the case

Pathway

Experiment → pilot → production

Each step adds the least structure that’s still safe. Most experiments should end as experiments; the gates are for the ones others come to rely on.

ExperimentPilotProduction
Who uses itThe builderA defined group, for a set timeOthers depend on it
DataPublic or syntheticInternal; confidential with steward approvalAs classified, in an approved environment
Control tierT1–T2T2–T3T3–T5, set by data and audience
ValidationDoes it do the job?Acceptance criteria tested with real usersTests from the spec in CI; accessibility testing; protected test files
Security for AI-generated codeNo secrets in code; no production credentialsDependency and secret scanning; scoped credentialsStatic analysis, dependency checks, human review of every diff including removals; security review at tier
Data protectionNothing leaves the sandboxMinimum necessary data; access loggedRetention, role-based access and audit logs outside the builder’s control
OwnershipThe builderNamed owner, review date, registry entryNamed owner and backup, support path, offboarding plan
Gate to the next stepSomeone else wants to use itPilot measures met and an owner accepts itReviewed against the tier on a schedule

The gates draw on the promotion signals and quick test, the control tiers, shared responsibility and the governance checklist.