SystemAccreditation, Institutional Research & Accountability

Academic Program Review

Academic program review with five cited lenses per program, the self-study checked against the data, and the options modeled before the Provost decides

Each program review assembled in two days, not six weeks, every figure cited.

See one case, screen by screen ↓
demo27reviewsfull program reviews this cycle at the demo university, of 190 programs on a seven-year cycle
target2daysto assemble a program review with every figure cited, not five to six weeks
demo$1.31M a yearlower instructional cost by year three, as the Scenario agent modeled one merger
target190of 190programs checked against the federal earnings test every year
In short

What is Academic Program Review?

Academic program review is the cyclical evaluation of each degree program in higher education, usually every five to seven years, in which the department writes a self-study, a faculty committee reviews it with the program's figures, and the provost decides whether to grow, redesign, merge or teach out the program. Academic Program Review gives each program one cited page: five lenses built by agents from the systems of record, the self-study checked claim by claim, and the options modeled, with the committee approving before the Provost decides.

AI in education: a buyer's guide to agentic AI for colleges, universities and school districts →

Updated

The problem

Why an academic program review takes weeks, and its numbers are still argued

An academic program review is the cyclical look a university takes at each degree program, usually every five to seven years: the department writes a self-study, institutional research pulls enrollment, cost, completion and earnings figures from four or five systems, a committee of faculty reads it all, and the provost decides whether to grow, redesign, merge or teach out the program. In the academic program review process as most campuses run it today, the figures arrive as spreadsheets weeks after the self-study is written, so nobody checks the self-study's claims against the data.

Departments, institutional research and the budget office each count majors and credit hours their own way, and the committee spends its meetings reconciling whose number is right. Options such as a merger or a teach-out are proposed without the students affected, the shared credits, the approvals or the money. Meanwhile the stakes have risen: state laws now close low enrollment programs, and from July 2027 a program whose graduates earn too little can lose federal student loans. Academic Program Review puts eight agents in front of the assembly, checking and modeling, so the committee and the Provost spend their time on program viability, not on the numbers.

typical5degrees a yearover three years: under that, Ohio law now requires a state institution to eliminate an undergraduate program
typical2of 3 yearsfailing the federal earnings test costs a program its Direct Loan eligibility, from July 2027
Where one program review's working days goestimated
By hand27 days
With the solution2 days
  • Pulling majors, new students and credit hours from the student information system12 → 0.5 d
  • Joining instructor assignments to cost lines for cost per credit hour5 → 0.3 d
  • Reconciling the department's, institutional research's and the budget office's counts4 → 0.3 d
  • Checking the self-study's claims against the figures2 → 0.3 d
  • Pulling peer completions and regional job demand2 → 0.3 d
  • Modeling the options with their students, faculty, money and approvals2 → 0.5 d

Estimated split of one program review's assembly, by hand and with the agents. The 'before' column, about 27 working days, matches the demo university's own estimate of five to six weeks by hand; the 'after' column totals two days, the design goal. Our arithmetic, kept modest.

How it works

How one program's review comes together

Five agents build the lenses, a Critic checks the self-study, a Peer and a Scenario agent compare and model; the committee approves and the Provost decides.

What comes in
What the agents read7 systems · read only, counts never students
Agents at work
Enrollment agentmajors and credit hours
Cost agentcost per credit hour
Then
Completion agentgraduation and degrees
Earnings agentearnings test
Job demand agentregional postings
Then
Critic agentself-study against the data
Peer agentpublic completions data
Then
Scenario agentgrow, redesign, merge, teach out
A person decides
Committee chair approves, Provost decidesreason codes, recusal, then the senate
What comes out
Decision with a reason
Faculty senate record
Record pack for the board
One case, step by step

One academic program review, from the overnight build to the faculty senate's record

The BS in Industrial Technology at Halden State University, CIP 15.0612, was last reviewed in 2019. Its department chair submitted the self-study on September 18, 2026. On Wednesday, October 14, the review is with the Provost, with 6 days left on her clock. Here is what happens to it, screen by screen, in the working solution.

  1. 01Morning

    The day in one sentence, and the three reviews that wait for her

    Joan Whitcombe · Provost

    27 programs are in full review this cycle and 3 wait for the Provost, the soonest in 6 days. The queue shows what the agents found on each one: the BA in French confers 3.7 degrees a year, and the MS in Applied Statistics has 38% more majors.

    Labor market data has not answered since 6:10 AM, so one job demand strip is held rather than built from old figures.

  2. 022:04–2:11 AM

    One program as five lenses, each against the university

    Five lens agents

    Enrollment is 184 majors, down 41% since fall 2021 while the university fell 3%. A credit hour costs $612 against the university's $388, six-year graduation is 52% against 64%, graduates earn a median $58,400 against $52,900, and regional postings for related roles rose 22% to 2,245. Each strip names its system of record, an as-of date and a confidence score.

  3. 03One click

    Every figure opens its rows, its method and its source

    Cost agent

    Cost per credit hour climbed from $431 to $612 over fall 2021–2025, while the average section shrank from 15 students to 11 and sections under 10 students rose from 21% to 38%. The method is direct instructional cost by section divided by credit hours, from ERP cost lines joined to HR assignments, as of October 9, confidence 0.97.

    Counts only; no student-level record leaves the student information system.

  4. 042:08 AM

    The self-study, checked claim by claim against the data

    Critic agent

    The Critic agent tested 7 claims: 3 supported, 1 partly supported, 2 not supported and 1 that cannot be checked. "Enrollment has stabilized" is not supported: majors fell from 246 to 184 since fall 2023. The two partner letters cannot be checked, and on October 12 the department chair answered that one partner is renewing its letter with an amount.

    "Strong job placement" rests on an 18% survey response: 7 of 39 graduates.

  5. 052:09 AM

    What the board-approved peers did with the same program

    Peer agent

    Of eight peer universities, five offer the program. From public completions data, Halden's completions fell 36%, from 61 to 39; Peer A rose 7% after adding an automation concentration, and Peer D finished a teach-out in 2024. Peers are labeled, never named.

    Peer B merged the same program into engineering technology in 2023, and combined completions rose 19%, from 64 to 76.

  6. 062:11 AM

    Grow, redesign, merge or teach out, modeled to fall 2030

    Scenario agent

    A merger with Engineering Technology brings a credit hour to $419 and instructional cost down an estimated $1,310,000 a year; all 184 current majors finish under their catalog, and two retirements are not refilled, with no layoffs. A teach-out saves more by 2031 but leaves 2,245 regional postings with no local program. The merge rests on 23 shared credits, and the Provost can change that assumption and watch the figures move.

    The Scenario agent never recommends; the person picks.

  7. 0710:42 AM

    The Provost picks an option and sends it to the committee

    Joan Whitcombe

    Joan picks the merger in the recommendation box. The Scenario agent drafts it with every figure linked to its source: an Industrial Technology concentration within the BS in Engineering Technology from fall 2028, 23 of 41 required credits shared. She sends it to the academic program review committee, and its 30-day clock starts.

  8. 08The same day

    The committee chair approves before the Provost can decide

    Leah Sorensen · Program Review Committee Chair

    Leah approves the review with reason CR-02, approve with the department's response attached. Until then the Provost's decision stays locked, and the screen tells Joan the Provost cannot approve for the committee. A committee reader from the department under review is recused and cannot vote. Joan then decides with reason PR-04: merge, from fall 2028.

  9. 094:05 PM

    The faculty senate receives the whole record

    Daniel Achebe · Vice Provost for Academic Programs

    Daniel releases version 4 of the record to Priya Venkataraman, Faculty Senate President: the summary, the five lenses, the self-study and its check, the options modeled, the approvals and the decision, and the department's response. Every count under 10 is suppressed.

  10. 10Audit-ready

    Every send, approval, decision and release on the record

    Calvin Rhee · Internal auditor

    The send, the committee's approval with one member recused, the decision and the release sit on a trail that names who, what, when, why and the evidence, for people and agents alike. Entries are kept 10 years after the decision, longer under legal hold, and the record pack exports for the board, the accreditor or a state reviewer.

Who it’s for

Built for everyone who carries a program review.

The same review, seen by the five people who write it, check it, decide it and receive it: what their cycle looked like, and what it looks like now.

JW
Joan WhitcombeProvost and Executive Vice President · decides on 27 reviews a year
Provost
Before
Decides with figures that arrived weeks late, then defends each decision to the senate and the board without the record behind it.
Now
Reads one program as five cited lenses, weighs four modeled options, and decides after the committee chair approves.
LS
Leah SorensenProfessor of Economics · leads nine faculty readers
Program Review Committee Chair
Before
Spends committee meetings reconciling whose enrollment number is right, with no time to test a claim against the data.
Now
Sees which self-study claims hold up, with the figure that settles each one, and approves with a reason code.
VA
Victor AlmeidaChair, Applied Engineering and Technology · writes the self-study
Department chair
Before
Learns which of his claims the data disagrees with when the committee raises it.
Now
Sees the Critic agent's check first, and answers it before the committee reads the review.
DA
Daniel AchebeVice Provost · runs the review cycle and the annual check-ins
Vice Provost for Academic Programs
Before
Loses half the cycle to building data books and arguing about counts.
Now
Sees all 190 programs checked each September, asks the flagged departments in bulk, and releases the record to the senate.
PV
Priya VenkataramanFaculty Senate President · receives the record for shared governance
Faculty Senate President
Before
Receives a decision without the record behind it.
Now
Receives every lens, claim, option, signature and the department's response, with counts under 10 suppressed.
Built on the engine

8 agents. Each with one job, and hard limits.

Five agents build the lenses, a Critic checks the self-study, a Peer and a Scenario agent compare and model; the committee approves and the Provost decides.

Enrollment agent

Builds the enrollment strip: fall-census majors, new majors and credit hours for five years, against the university.

  • Never reads a student-level record into the review; counts only
Cost agent

Builds cost per credit hour from instructor salary and benefits by section, joining HR assignments to ERP cost lines.

  • Never includes overhead the method excludes
  • Never changes the cost method; only the administrator can
Completion agent

Builds six-year graduation and degrees conferred for the program's entering cohorts.

  • Never shows a cohort count under the minimum cell size
Earnings agent

Builds graduates' median earnings four years after completion and runs the federal earnings test, with the small-cohort roll-up the rule requires.

  • Never estimates a missing cohort
  • Says when the rule rolls a cohort up
Job demand agent

Builds regional postings for the occupations linked to the program, and names the region.

  • Never counts an occupation the program-to-occupation map does not link
  • Holds the strip when its source is late, rather than use old figures
Critic agent

Finds every factual claim in the self-study and tests it against the five lenses and the attached evidence, with a verdict and the figure that settles it.

  • Never rewrites the self-study
  • Never marks a claim without the figure that settles it
  • Letters and promises are marked cannot be checked
Peer agent

Compares the program with the board-approved peer universities from public completions data, and notes what each peer did.

  • Only the board-approved peer set
  • Peers are labeled, never named
Scenario agent

Models grow, redesign, merge and teach out to five years, with the students, faculty, money and approvals each affects, and drafts the text for the option a person picks.

  • Never recommends on its own
  • Never models a layoff the option does not need
  • Every assumption is visible and can be changed
Provost

Decides after the committee chair approves. The agents propose; a named person decides.

Ask in plain words

Ask about any program, figure or claim

The assistant answers in plain words, cites the source of every figure, and opens the screen it is talking about.

Is the job placement claim supported?

Not by the data. The self-study says virtually every graduate works in the field, but the placement survey had an 18% response rate: 7 of 39 graduates of 2024–25. Six of the seven work in the field. State wage records find 31 of 39 employed in the state, with no occupation recorded. The department can answer the claim before the committee reads it.

What happens if we merge with Engineering Technology?

With 23 of 41 credits shared, a credit hour falls from $612 to $419 and instructional cost by an estimated $1,310,000 a year by year three. All 184 current majors finish under their catalog, and two retirements are not refilled, with no layoffs. It needs the curriculum committee, the senate, the Board of Trustees and notices to the state board and the accreditor.

Which programs fail the earnings test?

Three of 190: the BFA in Musical Theatre ($31,900) and the BA in Studio Art ($33,400) against the $36,200 benchmark, and the MFA in Creative Writing ($41,200) against the $47,600 graduate benchmark. Five more are within 10%. A first failure means warning current students within 30 days; two failures in three years cost Direct Loan eligibility.

Prepare the record for the faculty senate

The record is assembled: five lenses with their sources, the seven claims and their verdicts, the four options, the signatures and the department's response. Counts under 10 are suppressed, so the placement survey reads "fewer than 10 of 39". It stays a draft until the Provost decides and the Vice Provost releases it.

Every screen

The working solution, as it ships.

13 screens from the working solution, on its sample data. Pick one to see it large.

One program, five lenses, each against the university's benchmarkBS in Industrial Technology at Halden State University as five strips: enrollment, cost per credit hour, completion, graduates' earnings and regional job demand. Each shows the program's five-year line beside a dashed line for the university and names its system of record, as-of date and confidence, so no figure in the academic program review has to be argued.
The cycle's reviews, and the ones waiting for the ProvostThe day in one sentence, three numbers and the queue of this cycle's 27 full reviews: what the agents found, who each review waits on, and its clock. A notice says labor market data has not answered since 6:10 AM, so one job demand strip is held rather than built from old figures.
Every figure opens its source, its method and its confidenceCost per credit hour from $431 to $612 over five years against the university's $371 to $388, with the average section falling from 15 students to 11. Built by the Cost agent from ERP cost lines joined to HR assignments, as of October 9, confidence 0.97, with overhead excluded.
The department's self-study, checked claim by claim against the dataSeven claims, each highlighted and numbered with a verdict and the figure that settles it: 3 supported, 1 partly supported, 2 not supported, 1 cannot be checked. "Strong job placement" rests on an 18% survey response, 7 of 39 graduates.
Peers from public completions data, and what each one didThe eight board-approved peer universities, labeled and never named. Halden's completions fell 36%; Peer B merged the same program into engineering technology in 2023 and combined completions rose 19%; Peer D finished a teach-out in 2024.
Grow, redesign, merge or teach out, modeled to fall 2030Four options side by side with the students, faculty, money and approvals each affects. The merger: 212 majors in a 640-major degree, $419 a credit hour, $1,310,000 a year lower cost, every current major finishing under their catalog and no layoffs. The agent never recommends; the person picks.
A recommendation the Provost picks, drafted with its citationsThe page closes with the four options and the agent's modeled figures for each. For the option the Provost picks, the Scenario agent drafts the text with every figure linked to its source, and there is one next step: send to the committee.
The academic program review committee approves before the Provost can decideFour steps by four different people, each with a reason code. The Provost has sent the review and cannot approve it for the committee; her decision stays locked until the committee chair approves. A reader from the department under review is recused.
The faculty senate receives the whole recordReleased at 4:05 PM: what the Provost saw, the committee's approval, the decision to merge from fall 2028 and the department's response, section by section, with counts under 10 suppressed.
Every program checked every year, and only the flagged ones reach a personEach September the agents rebuild the five lenses for all 190 programs and test them against the university's thresholds: enrollment down more than 25%, fewer than 5 degrees a year, cost 1.40× the university's, earnings near the benchmark. 14 are flagged, and the Vice Provost asks the flagged departments in bulk.
Earnings test exposure for every program, a year earlyThe Earnings agent runs the federal earnings test on all 190 programs now: graduates' median earnings four years after completion against the benchmark, with the small-cohort roll-up the rule requires. 3 fall below the benchmark and 5 more are within 10%.
Every send, approval, decision and release on the recordWho did what, when, why and with which evidence, for people and agents alike, filtered here to decisions and releases. The record pack exports for the board, the accreditor or a state reviewer.
Approvals, thresholds, clocks, privacy and agent governance, set by the universityWho sends, approves, decides and releases, with "Nobody approves their own step" always on; the seven-year review cycle and the check-in thresholds, each with its effect this year; the clocks; student privacy; agent governance; and the systems of record.
Governance

Built for shared governance: cited, approved, on the record.

Seven roles, separated by dutyThe Provost or Vice Provost sends a review; the committee chair approves or returns it; the Provost decides; the Vice Provost releases the record; the department chair answers the Critic but cannot see committee notes; institutional research owns sources and agent versions with no decisions; the internal auditor reads and exports, changing nothing.
The committee approves before the Provost decidesEvery step needs a different person and a reason code. The Provost's decision stays locked until the committee chair approves, nobody approves their own step, and a decision that differs from the committee's needs a note (PR-07).
Every figure cites its sourceEach strip names its system of record, method, as-of date and confidence; each Critic verdict cites the figure that settles it; peers cite public completions data.
Counts, never studentsThe agents read aggregate counts only, never a student-level record. Counts under the minimum cell size of 10 are suppressed, exports are redacted, and every release is logged, so the senate record never identifies a student under FERPA.
Pinned agents, human overridesAgent versions are pinned for each review cycle, a figure below the 0.90 confidence floor waits for a person to confirm it, and anyone setting an agent's verdict aside gives a reason code that goes on the record.
A full audit trail and a record packWho, what, when, why and which evidence, for people and agents alike, with nothing editable. Entries are kept 10 years after the decision, longer under legal hold, and the record pack exports for the board, the accreditor or a state reviewer.
Configuration

Your review policy, not ours

The approvals, thresholds, clocks and privacy rules every review runs on are settings the university owns, each change versioned.

SettingDefaultChoose from
Who approves the reviewProgram Review Committee ChairNobody approves their own step, always on
Full review cycleEvery 7 yearsStepped, versioned
Check-in flag: degrees a yearFewer than 5, averaged over three yearsThe effect this year is shown: 5 programs
Other check-in flagsEnrollment down 25%, cost 1.40× the university's, earnings within 10% of the benchmarkEach a stepper
ClocksSelf-study 60 days, committee 30, Provost 21, check-in response 45Escalation to the Vice Provost 5 days before a clock runs out
Minimum cell size10Counts below it read "fewer than 10"; redaction on export
Record retention10 years after the decisionLegal hold
Agent confidence floor0.90Below it, a person confirms the figure; versions pinned per cycle
Connections

Works with the systems the figures already live in

Student information systemmajors, new students, credit hours and census dates
ERP and HR systeminstructional cost lines joined to instructor assignments, salary and benefits
Institutional research data warehousecohorts, completions and federal earnings data
Labor market dataregional job postings by occupation
Document managementself-studies, appendices and the record pack
Public completions datapeer completions by program and award year
What it changes

The difference, in numbers.

Every figure is labelled: a target the solution is built to, an estimate, a typical published result, or a proven one.

target
2days
to assemble a program review, every figure cited
By hand5–6 weeks
With agents≈ 2 days
estimated
$1.3M
a year lower instructional cost from one merger, by year three
target
190programs
checked against the earnings test every year
Every program
a year before sanctions apply

Sources: One Big Beautiful Bill Act earnings accountability, HEA §454 as amended (final rule July 1, 2026; effective July 1, 2027) · Ohio SB 1, ORC 3345.454 (fewer than five degrees a year over three years) · Kentucky Council on Postsecondary Education program review process · "target" = design goal, measured in the live solution · "demo" = seen in the working solution, on its sample data · "typical" = published rules · "estimated" = our arithmetic. Halden State University, its programs, its peers and the people named on this page are fictional: characters and sample data in the working solution.

Questions

What provosts ask about academic program review.

What is academic program review?

Academic program review is the cyclical evaluation of each degree program in higher education, usually every five to seven years, in which the department writes a self-study, a faculty committee reviews it with the program's figures, and the provost decides whether to grow, redesign, merge or teach out the program. Academic Program Review gives each program one cited page: five lenses built by agents from the systems of record, the self-study checked claim by claim, and the options modeled, with the committee approving before the Provost decides.

What is the academic program review process?

The department writes a self-study; the figures for enrollment, cost, completion and earnings are assembled; the academic program review committee reads both and recommends; the provost decides; and the faculty senate receives the record. Here the agents assemble the five lenses overnight and check the self-study, the department answers the check, the Provost sends an option to the committee, the chair approves with a reason code, and only then can the Provost decide.

How long does an academic program review take?

At the demo university, assembling one review's figures by hand takes an estimated five to six weeks, so they arrive after the self-study is written. The design goal for Academic Program Review is two days to assemble a review with every figure cited, measured in the live solution.

How does it check the department's self-study?

The Critic agent finds every factual claim in the self-study and tests it against the five lenses and the attached evidence, marking it supported, partly supported, not supported or cannot be checked, with the figure that settles it. The department chair sees the check and can answer it before the committee reads the review, and a person can set any verdict aside with a reason code.

Does it support program prioritization across the whole portfolio?

Yes. Between full reviews, the agents rebuild the five lenses for every program each September and test them against the university's own thresholds for degrees a year, enrollment, cost and earnings; on the sample data, 14 of 190 programs are flagged. The Vice Provost asks the flagged departments in bulk or moves a program into next year's full reviews.

What happens to a program that fails the earnings test?

Under the earnings test added to the Higher Education Act in 2025, graduates' median earnings four years after completion must beat a benchmark. After a first failure the institution must warn current students within 30 days and prospective students before they enroll, and two failures in three years cost the program its Direct Loan eligibility, from July 1, 2027. The Earnings agent runs the test on every program a year early, including the small-cohort roll-up.

Do people stay in control of the decision?

Yes. The agents build, check and model; they never decide, recommend on their own, send, release, or bring a student-level record into the review. The committee chair approves the review with a reason code, the Provost decides with a reason code only after that, and the Vice Provost releases the record to the senate. Nobody approves their own step.

How long does it take to go live?

The Agentic Solution Engine builds and deploys it from your requirements and documents, such as your review policy, past self-studies and the systems your figures come from, and it goes live once every quality gate has passed. We will walk you through it on one of your own programs first.

See it on
your programs.

We'll run Academic Program Review on one of your programs, from your own systems and self-study.