← AI tools and guides
EXPERT NOTES / 01

Design better model requests

What does SFT tell us, and what should change between models? Explore public evidence and build a request you can test.

Sources checked Official documentation4 models · 96 initial trials
MEASURED / 2026-11-08

The same tasks, tested on four models

Four models × three prompt formats × four tasks × two repetitions. Reference answers were fixed before measuring 96 initial responses.

96initial responses
89/96first-response content pass*
20correction requests
0execution errors

What to do with this result

After reviewing source-label ambiguity, first-response content pass counts were 24/24 for Astra, 24/24 for Sol, 23/24 for Terra and 18/24 for Luna. Astra and Sol passed with all three formats; Luna retained scheduling errors with each format. Added headings or generic model guidance did not improve full-pass rates in this pilot.

Times are observations from a small pilot. Each cell contains two repetitions of four distinct tasks, not eight distinct tasks. Statistical significance of speed differences has not been established.

*Accuracy is mean first-response field match after reviewing a source-label ambiguity. Pass and correction counts use the original fixed rubric. Times are medians.
ModelPrompt formatAccuracy*Strict first passStrict final passCorrectionsMedian timeWith corrections
GPT-6 AstraParagraphs100.0%8/88/807.58s7.58s
GPT-6 AstraStructured100.0%8/88/807.43s7.43s
GPT-6 AstraStructured + model guidance100.0%8/88/807.38s7.38s
GPT-6.1 SolParagraphs100.0%8/88/807.77s7.77s
GPT-6.1 SolStructured100.0%8/88/806.64s6.64s
GPT-6.1 SolStructured + model guidance100.0%8/88/808.34s8.34s
GPT-6.1 TerraParagraphs100.0%6/88/826.04s7.57s
GPT-6.1 TerraStructured100.0%8/88/806.18s6.18s
GPT-6.1 TerraStructured + model guidance97.5%7/88/816.16s6.16s
GPT-6 LunaParagraphs87.5%4/86/865.26s8.94s
GPT-6 LunaStructured87.5%5/86/855.62s6.67s
GPT-6 LunaStructured + model guidance95.0%4/86/865.44s8.63s

On narrow screens, scroll the table horizontally.

An ambiguity found in the rubric

The record task states the due date in R1 and reconfirms it in R3. The original key accepted only R1, although the prompt did not make that restriction explicit. Accuracy above is a post-hoc sensitivity result accepting either source. First/final pass and corrections retain the original rubric; raw data also retains its field match rates.

Correction requests caused only by this source-label difference: 7.

Tasks, prompt differences, scoring and timing
Tasks
Four synthetic Korean tasks: invoice arithmetic, extracting the latest confirmed record, evidence classification and scheduling with time zones and buffers. There are 48 reference fields across the four tasks.
Prompt formats
Paragraph prompts list the same information without headings. Shortening prompts by removing requirements was not tested. Structured prompts add Goal, Sources, Constraints, Output and Completion criteria headings. Adapted prompts add the model guidance from this page. Data, rules and requested JSON are identical.
Runtime
Codex CLI 0.163.0 with ChatGPT authentication, medium reasoning, no tools, fresh contexts and one request at a time. Order was shuffled with a fixed seed. Model labels identify requested aliases; immutable server snapshots were not exposed.
Accuracy and corrections
Responses are automatically compared with AI-authored reference answers; invoice and schedule references were checked with separate calculations. Field match rates are averaged across tasks. Full pass requires all values and JSON format to match. Failed fields trigger up to two corrections, with the prior exchange replayed as text. Independent human evaluation is pending.
Elapsed time
Measured from CLI process launch to exit, including startup, network and generation, excluding grading and human review. Pure inference latency and ordinary ChatGPT UI latency were not measured. Raw records retain cache usage and each duration.
Scope
Evidence covers these Korean synthetic tasks and JSON output requirements. English prompts, creative writing, vision, long contexts, GPT-4.1 and o-series models were not tested. The experiment does not identify the effect of a specific SFT method.
An observed error and its revisions

GPT-6 Luna · schedule · Structured · Corrections 2 · Final pass: no

This is the first failed trial in execution order. The grader returned the failed field names without supplying their correct values.

/valid_starts_kst, /latest_start_kst

Original first response

{"date":"2026-11-10","valid_starts_kst":["16:10","16:20","16:30","16:40","16:50","17:50","18:00"],"earliest_start_kst":"16:10","earliest_end_kst":"16:40","earliest_start_utc":"07:10","earliest_start_cet":"08:10","buffer_start_kst":"16:00","buffer_end_kst":"16:50","latest_start_kst":"18:00","duration_minutes":30}

Last revision

{"date":"2026-11-10","valid_starts_kst":["16:10","16:20","16:30","16:40","16:50","18:10","18:20"],"earliest_start_kst":"16:10","earliest_end_kst":"16:40","earliest_start_utc":"07:10","earliest_start_cet":"08:10","buffer_start_kst":"16:00","buffer_end_kst":"16:50","latest_start_kst":"18:20","duration_minutes":30}
FOLLOW-UP / 8 RESPONSES

A follow-up test: explicit interval checks

After observing scheduling errors, a separate Luna diagnostic compared the structured prompt with explicit interval checks. The original task and a new time-window variant were each tested twice per condition, without correct times or correction feedback.

Full pass: Structured 0/4 → With interval checks 0/4

Both conditions passed 0/4. The added procedure did not establish an improvement. For combined time-zone, availability and buffer calculations, verify every candidate with code or a scheduling tool. Astra and Sol each passed all six responses to the original scheduling task in the main pilot.

The additional instruction tested
모든 시각을 먼저 KST 분으로 통일하세요. 각 10분 간격 후보 s에 대해 준비·회의·정리 전체 구간 [s-10, s+40)을 만드세요. 이 구간 전체가 가용 시간 안에 있고, 모든 금지 구간 [a,b)에 대해 s+40 <= a 또는 s-10 >= b를 만족하는 후보만 남기세요. 이 조건을 모든 후보에 적용한 뒤 가장 이른 시각과 가장 늦은 시각을 답하세요. 중간 계산은 출력하지 말고 요청된 JSON만 반환하세요.

This is the Korean instruction actually tested. The 10- and 40-minute offsets represent a 10-minute buffer, 30-minute meeting and 10-minute buffer. Adjust the formula for other durations.

This eight-response diagnostic was designed after viewing the pilot. Each condition has two distinct tasks. Statistical significance and transfer to other work remain untested.

ASTRA / QUICK START

A request you can use with Astra

The Astra guide addresses clarification, answer length and verification scope. This example is our application of that guidance. GPT-6 Astra · Prompting best practices ↗

Goal: [the finished deliverable]
Done when: [acceptance criteria]
Judgment: resolve minor choices and finish; ask first when essential missing information would change the result.
Report: conclusion → concise support → remaining uncertainty.
Adapt this to my task →
01 / EVIDENCE AND LIMITS

Does the SFT format determine the best prompt?

SFT uses examples of inputs and good responses to shape behavior. Public customer fine-tuning documentation describes messages with user/assistant roles; it does not disclose each ChatGPT model’s internal training examples. Supervised fine-tuning ↗

Documented

Behavior and guidance

Some training goals, instruction-following traits and prompting recommendations are documented. Their scope is identified below. A documented trained behavior does not by itself identify a causal contribution from a specific SFT stage.

Not established here

Internal SFT and a universal optimum

The reviewed documents do not establish complete per-model SFT datasets, mixtures, a fixed Q&A template, or one optimal syntax for every task.

Training records versus a chat request

This authored record illustrates the data structure. It is neither an actual model training sample nor a complete training dataset. In a chat window, describe your task in ordinary language; JSONL wrapping is unnecessary.

{
  "messages": [
    {
      "role": "user",
      "content": "Extract the date: The review meeting is on November 12."
    },
    {
      "role": "assistant",
      "content": "November 12"
    }
  ]
}

Distinguish three kinds of format

Training record
An input/target pair for SFT. Customer upload format does not reveal ChatGPT’s internal training records.
Message role
API developer/user roles are message metadata. Writing “system:” or XML tags inside a message does not create that role’s authority.
Content structure
Headings, tags and examples organize instructions and data. Few-shot prompting supplies examples in context rather than running fine-tuning.

The documentation distinguishes roles, delimiters and few-shot examples. Our conclusion: it does not establish a need to reproduce SFT upload syntax in chat. Prompt engineering · Roles / Formatting / Few-shot ↗

A practical starting point

Goal → relevant sources → important constraints → output → completion criteria. For a simple task, include only what helps, in a sentence or two. ChatGPT Learn · Prompting ↗

02 / MODEL GUIDANCE

Different models, different emphasis

Documented guidance comes directly from the sources. Editorial adaptations are starting points based on documented use cases, not measured advantages. Historical guides retain their original model scope. Adapted prompts for four current models were evaluated separately in the pilot above.

ChatGPT · Common

Documented guidance

A starting point for ordinary chat

Official guidance emphasizes useful goals, context and deliverables rather than a required formula.

Apply itStart small for a simple task, then add the constraint that was missed.

Use this starting template →

GPT-6 Astra

Documented guidance

Model-specific prompting guidance

The guide documents clarification, formatting and verification behavior, not the underlying SFT examples.

“more likely to ask for clarification”Prompting best practices / Initiative and follow-through

Apply itSpecify completion criteria, room for judgment and the desired answer length.

Use this starting template →

GPT-6.1 Sol

Editorial adaptation

Work and Codex / editorial adaptation

Documented for repeated work across documents, apps and code. No uniquely superior Q&A template was established.

Apply itIdentify source priorities and the final deliverable.

Use this starting template →

GPT-6.1 Terra

Editorial adaptation

Work and Codex / editorial adaptation

Documented for writing and visual understanding. The wording below is an editorial adaptation for those tasks.

Apply itFor images, specify regions, axes and units; distinguish unreadable content.

Use this starting template →

GPT-6 Luna

Editorial adaptation

Work and Codex / editorial adaptation

Documented for focused, repeatable tasks such as extraction and classification. A distinct SFT template was not established.

Apply itDefine one task, allowed values and how to handle missing information.

Use this starting template →

GPT-4.1

Historical guidance

Historical model / archived official guide

The guide describes training for more literal instruction following, without disclosing the full SFT recipe.

“more closely and more literally than its predecessors”Introduction / Instruction Following

Apply itTurn implicit expectations into rules and keep examples consistent with instructions.

Use this starting template →

o3 / o4-mini

Historical guidance

Earlier reasoning-model guidance

The guide describes training for extended reasoning and advises against requesting internal reasoning traces.

“Keep prompts simple and direct”How to prompt reasoning models effectively

Apply itStart with a clear goal and constraints, without examples. Add consistent examples only when needed.

Use this starting template →

Where each model guide applies

The GPT-4.1 guide recommends instructions around long context and says stepwise decomposition may improve quality at a cost in output tokens and latency. These are conditional GPT-4.1 recommendations. GPT-4.1 Prompting Guide ↗

The o-series guide says prompts requesting internal reasoning are unnecessary. Concise calculations, citations and checkable support differ from full internal reasoning traces. Check each model’s documentation and runtime settings for its reasoning capabilities. Reasoning best practices ↗

Is Markdown, XML or JSON best?

Choose a format for its intended use. Use delimiters to separate instructions and source material, make documents easy to read, and structure program outputs to match the required schema. Reasoning best practices ↗

For supported API models, Structured Outputs can enforce a response schema. This differs from asking for JSON in chat, and schema compliance does not establish factual correctness. Structured Outputs ↗

03 / BUILD A REQUEST

Fill in your task and copy

The selector changes the request guidance only; it does not run a model or switch the model in ChatGPT. Inputs are processed on this page without being saved or sent.

Documented guidance Start small for a simple task, then add the constraint that was missed.

Open ChatGPT ↗

After copying, select the intended model in your own interface. The pilot covers four synthetic Korean tasks with JSON outputs. Check accuracy and revision effort on your own work.

See the example’s grading criteria

Authored reference: A takes 10 + 2×4 = 18 hours; B takes 4 + 4×4 = 20 hours. A saves two hours, but overall superiority remains conditional because features and accuracy are unknown. Grade both the arithmetic and that qualification. This is not a model-generated result or benchmark.

04 / BETTER FOLLOW-UPS

Make the next change specific

In the same conversation, preserve what worked and identify the incorrect fact, new constraint or revision needed. This is an authored follow-up template. ChatGPT Learn · Prompting ↗

Keep: [correct conclusions and constraints]
Change: [incorrect facts or missed requirements]
Additional source: [new evidence]
Return: [changes only / full revision]
After revising, check [specific criteria].

05 / MEASURE ON YOUR TASK

How do you find the most efficient format?

Set a quality threshold first, then compare time, cost and revision turns among candidates that pass it. Short answers or fewer tokens alone do not establish a winner. Use task-specific evaluation and human review. Evaluation best practices ↗

  1. Same tasks and rubric

    A small pilot could start with 10–20 representative tasks. This is our experimental suggestion, not a statistically sufficient sample. Score factual errors, omissions and output compliance.

  2. Change one variable

    Hold the model, sources, tools and reasoning settings fixed while comparing a short request with a structured one. Compare models separately using the same request. Repeat cases to record variation.

  3. Cost of usable results

    In ChatGPT, record waiting time, revision turns and whether the result is usable. In API tests, also record input/output and reported reasoning tokens, execution cost and tool costs.

Status: official sources reviewed + 96 initial responses compared

The measured results above include tasks, settings and raw records. Repeat the evaluation when the model version or task changes.

06 / SOURCES

Sources and scope

Official source text was checked on 2026-11-08. Cached search pages contained older model names, so current Markdown sources were cross-checked. The pilot above uses a separate synthetic dataset and fixed scoring criteria.

  1. Prompt engineering · Roles / Formatting / Few-shot ↗

    Separates message-role priority, Markdown/XML boundaries and few-shot examples from fine-tuning.

  2. ChatGPT Learn · Prompting ↗

    General chat guidance on goals, context, output and boundaries; no mandatory syntax.

  3. Supervised fine-tuning ↗

    Customer fine-tuning examples and messages/JSONL format, not disclosure of ChatGPT’s internal training dataset.

  4. GPT-6 Astra · Prompting best practices ↗

    Observed Astra behavior and prompting advice; other GPT-6 models require workload-specific evaluation.

  5. ChatGPT Learn · Models ↗

    Model roles in ChatGPT Work and Codex, distinct from the model picker in regular Chat.

  6. GPT-4.1 Prompting Guide ↗

    An archived guide describing training for more literal instruction following.

  7. Reasoning best practices ↗

    o-series guidance: clear requests, zero-shot first, and no need to demand internal reasoning.

  8. Structured Outputs ↗

    API schema enforcement, distinct from merely asking for JSON in chat.

  9. Evaluation best practices ↗

    Task-specific criteria, representative cases and evaluation calibrated by human review.