SAST THU CST SAST Homepage ↗

DiabAgentToward Agentic Physiological Control

A treatment plays out in a body over hours, so a medical agent should be judged by what its actions do. In Agentic Physiological Control, an agent controls a physiological system through medical-device tools and is scored on the resulting trajectory.

Tsinghua University · Sweetie Online Community · Einsia AI · 2026

Benchmark Paper · soon Code · soon

DiabAgent

the agent

  • States its reasons
  • Chooses what to sense
  • Wakes itself up
  • Keeps a personal record

DiabetSim

the world

  • Meals
  • Exercise
  • Illness
  • Faults
PumpPenCGMMeter

SweetBench

the score

COGI 212 tasks

One day, start to finish

Something happens that nobody reports. The agent receives a reading, acts through a device, and glucose answers. Every reading and quote comes from the recorded run.

Open this run →

APC: treatment as a control problem

The agent reaches the body only through devices. It separates deciding from operating a device, so one agent can serve different devices, scenarios and people.

DiabAgent observe act Monitoring Decision Device tools Personal record Devices: pump, pen, CGM, meter Body: hidden state Score
  1. Sensor readings and any reports reach the agent through monitoring.

  2. It weighs readings, insulin still acting and its personal record, then states why.

  3. One operation goes through a device tool, within what that device allows.

  4. The body answers over hours. Its true state stays hidden, and that is what gets scored.

  5. It chooses when to look again and what should wake it sooner, and updates its notes.

DiabetSim: a world in four dimensions

The devices decide what the agent can see and do, so the same scenario can run with a pump or pens, and with more or less information.

  • 8

    People

    Child to older adult, male and female.

  • 29

    Devices

    5 pumps, 10 pens, 8 sensors and 6 meters.

  • 7

    Event groups

    Meals, past doses, exercise, changing needs, pump faults, sensor errors, illness.

  • 3

    Observation levels

    From free-text reports down to sensor and device alone.

Scenario coverage

Each filled cell is one of the 212 tasks. Open any of them.

ABCDEFH Boy, 9Girl, 9Teen boy, 15Teen girl, 15Man, 39Woman, 39Older man, 70Older woman, 70
  • AMeal timing and absorption
  • BInsulin from earlier doses
  • CExercise
  • DChanging insulin needs
  • EPump under-delivery
  • FSensor errors
  • HIllness and recovery

SweetBench: scored on the body

Each task runs for 72 hours with meals and activity unreported. COGI combines time in range, hypoglycemia and variability of a true glucose trajectory the agent never sees. Four of five models beat the simulated closed loop.

  1. Claude Opus 5.5 73.54
  2. Simulated oref1 (15 min) 71.19
  3. GPT 6.1 Sol 70.58
  4. DeepSeek 4.1 Flash 68.61
  5. Kimi K3.1 Pro 67.15
  6. GLM 5.3 Flash 66.25

Runs worth reading

Key findings

A personal record and a nightly review lift scores above 80 within a week

Model weights stay fixed. The gain comes from what the agent writes down about this one person.

  • Record + end-of-day plan
  • Cross-day record
  • No cross-day record
60 70 80 90 Day 1Day 2Day 3Day 4Day 5Day 6Day 7

What the agent is told matters more than how often it decides

With a leaking infusion site, a free-text report scores near 98 at any interval. Without it, deciding eight times as often does not close the gap.

Agent also gets 15 min30 min60 min120 min
Free-text reports 97.899.098.499.7
Meal times and carbs 66.769.660.156.0
Sensor and device only 62.159.955.251.6

The same agent does better with a pump than with pens

A temporary basal rate can be lowered as the need falls. An injected long-acting dose keeps acting.

  • Pens
  • Pump
  • Pump + closed loop
  • Slow-meal overlap

    74.6
    80.6
    85.2
  • Stress resolution

    72.3
    80.2
    82.8
  • Post-illness refeeding

    67.1
    74.7
    74.5