AMER.

ANALYSIS

Phi-4 reasoning: a small model can still think expensively

Microsoft’s April 2025 report shifted attention from parameter count to inference-time computation. Buyers need to test that trade-off in their own tasks.

PUBLISHED · · By

What Microsoft actually reported

The Phi-4-reasoning technical report, submitted on 30 April 2025, described a 14-billion-parameter model built from Phi-4 through supervised fine-tuning on curated prompts and reasoning demonstrations generated using o3-mini. It also introduced a reasoning-plus variant with an additional outcome-based reinforcement-learning phase. Microsoft reported strong results across selected reasoning evaluations. These are findings from the model developer, not a general certification of enterprise reliability. The key engineering idea was that carefully selected training examples and additional computation during answering could make a comparatively compact model useful on difficult tasks. 1

Do not collapse the family into one product

Phi-4, Phi-4-reasoning and Phi-4-reasoning-plus should not be treated as interchangeable names. A benchmark attached to one checkpoint does not establish the same behaviour for another. Record the exact artifact, serving configuration and generation settings in every trial. The report describes the plus variant as producing longer reasoning traces to improve performance. That difference matters when comparing latency and total token consumption. Procurement documents should name the tested version rather than promising that a vaguely specified Phi deployment will reproduce a research result under different prompts, hardware or output limits.

Count computation after the prompt arrives

A smaller weight set can reduce memory requirements without making every answer fast or cheap. Reasoning models deliberately spend computation during inference, sometimes generating substantial intermediate text. Measure completed-task cost alongside output length, waiting time and error rate. A short extraction task may not benefit from extended reasoning, while a constrained planning problem might. Use a routing experiment rather than enabling the most elaborate mode for all requests. This is also why a parameter-count comparison with a larger ordinary model can mislead: it omits a different allocation of computation across the request.

Test Swedish reasoning separately

A strong score on mathematical or scientific benchmarks does not establish competence with Swedish administrative language, local abbreviations or incomplete business records. Build bilingual task pairs and ask domain reviewers to score the final answer without seeing the model name. Include contradictory premises, missing information and cases where clarification is preferable to a confident result. The correct output may be a request for a missing constraint, not an elaborate explanation. Link this evaluation to company knowledge: retrieving the right policy is a separate capability from reasoning correctly about the policy once it is retrieved.

A reasoning trace is not an audit trail

Text that looks like step-by-step thinking is still generated output. It can contain unsupported assumptions, misleading rationalizations or sensitive details copied from input. Do not treat verbosity as proof that the result is correct. For auditable workflows, retain relevant source references, tool actions, version information and human approvals separately. Restrict what the model can execute regardless of how persuasive its explanation sounds. The relevant companions are agent permissions and AI security, because a model capable of planning still needs bounded authority, protected secrets and a tested stop path before it can act on business systems.

Use a bounded adoption decision

An appropriate pilot names a task, an acceptable error profile, a maximum waiting time and a fallback owner. Compare ordinary generation with reasoning under the same final-answer acceptance test. Inspect failures before expanding scope, especially when the model creates executable plans or handles regulated material. The research supports investigating compact reasoning models; it does not justify replacing every larger service. For publication on 25 October 2026, this article revisits the April 2025 report only. It does not verify current model hosting, licensing revisions, supported languages, prices or a continuing position on any leaderboard.

THE TAKEAWAY

Microsoft’s April 2025 report shifted attention from parameter count to inference-time computation. Buyers need to test that trade-off in their own tasks.

Want this as a keynote for your leadership team?

I turn the same material into a 45–60 minute keynote, customised for your industry and the decisions your room is facing.

BOOK AMER →
Hi! 👋Animerad avatar av Amer Mohammed