Exit Exam Studio
Student guide

Faculty guide

The Exit Exam Studio, step by step

Everything a program needs for its graduating cohort's exit exam: the outcomes framework and blueprint, a reviewed question bank, the paper, a defensible pass mark, on-screen and OSCE sittings, results and the reports accreditors ask for. Open it from AI Tools → Exit Exam Studio.

What is your role?

Committee chair: Runs the program's exit exam from start to finish and adds the committee.

  1. 1.Start an exit exam
  2. 2.Add your committee
  3. 3.Setup: the exam and its parts
  4. 4.Framework: outcomes and courses
  5. 5.Blueprint: what the paper must cover
  6. 6.Write questions
  7. 7.Assemble and lock the paper
  8. 8.Set the pass mark
  9. 9.Run a computer-based sitting
  10. 10.Results
  11. 11.Reports and the accreditation pack

The journey of one exit exam

Each step has its own tab in the exam. Click a step to jump to it.

  1. Step 1StartAny faculty
  2. Step 2SetupChair
  3. Step 3FrameworkChair
  4. Step 4BlueprintChair
  5. Step 5QuestionsWriters, reviewers
  6. Step 6PaperChair
  7. Step 7Pass markChair, panelists
  8. Step 8SittingsCoordinators, examiners
  9. Step 9ResultsChair
  10. Step 10ReportsChair
A program's framework, question bank and committee are shared by every cohort's exam. Next year you start a new exam for the new cohort and keep everything you built.

Step 1

Start an exit exam

Who: any faculty member

Whoever first starts a program's exit exam becomes its committee chair. After that, the chair adds colleagues and starts each new cohort's exam.

scibayan.com/exit-exam-studio

Exit Exam Studio

+ Start an exit exam1

Start an exit exam

University2

Cairo University

Program2

Bachelor of Pharmacy

Exam name

Exit Exam

Cohort3

Cohort 2022

Academic year

2026/2027
Start4
AI Tools → Exit Exam Studio → Start an exit exam
  1. 1
    Open AI Tools, choose Exit Exam Studio, then press Start an exit exam.
  2. 2
    On scibayan.com, type your university and program. On your university's own site (for example effectiveness.dmu.ae), the university is filled in for you: pick your program from the list.
  3. 3
    Name the exam and the cohort that sits it (for example Cohort 2022), and the academic year.
  4. 4
    Press Start. The exam opens with all its tabs. If nobody ran this program's exit exams before, you are now its committee chair.
Colleagues who type the same university and program on scibayan.com share one committee, so agree who starts it. If the program already has a chair, the form tells you who to ask.
A new cohort's exam copies the previous exam's parts, weights and targets, so you only adjust what changed.

Find your exam

Who: everyone you add

Committee members do not need to start anything. Once the chair adds you, the exam appears in your Studio.

scibayan.com/exit-exam-studio

Cairo University · Bachelor of Pharmacy

Exit Exam · Cohort 2022

2026/2027 · Draft · You: Writer, Reviewer

Open1
Your exams, with your role on each
  1. 1
    Sign in with the same email the chair added, on the same site. Open AI Tools → Exit Exam Studio and press Open on the exam. You see only the tabs your role needs.
You can only be added after you have signed in to that site at least once. If the chair gets “no account”, sign in once, then ask again.

Chair

Add your committee

Who: chair, university manager

Roles belong to the program, so they carry over to every cohort's exam.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Add someone

Email1

colleague@university.edu

Role2

Question writer▾

Courses: ☑ Pharmacology ☐ Pharmaceutics 3

Add4
Staff tab → Add someone
  1. 1
    Type the colleague's email.
  2. 2
    Pick a role. Committee chair can do everything. Question writer writes questions. Reviewer approves them. Pass-mark panelist rates the locked paper. Sitting coordinator runs sittings. OSCE examiner scores stations.
  3. 3
    For writers and reviewers, tick the courses they work on (none ticked means all courses).
  4. 4
    Press Add. One person can hold several roles; add them once per role.
Copy the Studio link from the Where staff work box and send it with your invitation.

Step 2 · Chair

Setup: the exam and its parts

Who: chair

The parts make up the final result, for example a written paper and an OSCE.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Parts of the exam1

PartMethodWeight %Max marksBlueprint
Written examMCQ70100☑ 2
OSCEOSCE3030☐

Blueprint targets3

Minimum items per program outcome: 3 · Bloom targets: Application 40% …

Save exam settings4
Setup tab
  1. 1
    Add each part with Add a part: its name, method, weight (all weights should add up to 100%) and maximum marks.
  2. 2
    Tick Has a blueprint on the written paper. That is the part built from the question bank.
  3. 3
    Optionally set Blueprint targets: the fewest questions per outcome, and the share of questions at each Bloom level. The blueprint checks warn when the plan drifts from them.
  4. 4
    Press Save exam settings. Later, set Status to Blueprint approved: locked once the committee agrees the blueprint.

Step 3 · Chair

Framework: outcomes and courses

Who: chair

The framework lists the program's learning outcomes, courses and their outcomes, competencies and accreditor domains. Questions and the blueprint are tagged with these lists, which is what makes the reports possible.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Profession1

PharmacyMedicineDentistryNursing…

Fill from a program document (AI)2

Paste the program specification → Read the document → Use these lists

Program learning outcomes (PLOs)3

A1 · Apply pharmaceutical knowledge …

Save framework4
Framework tab
  1. 1
    Pick the profession. It fills the starting competencies, accreditor domains and assessment methods, which you can edit.
  2. 2
    Fastest start: open Fill from a program document (AI), paste the program specification or study plan, press Read the document, check the proposed lists and press Use these lists.
  3. 3
    Check and edit the outcomes (with the codes your program uses, such as A1), the courses with their department, credit hours and course outcomes, and the competencies.
  4. 4
    Press Save framework. Every exit exam of this program uses it.
Paste only planning documents into the AI here, never exam questions.

Step 4 · Chair

Blueprint: what the paper must cover

Who: chair

One line per part of the paper: which course and topics, how many questions and marks, and how they spread over Bloom levels, outcomes, competencies and domains.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Draft the blueprint with AI1

Total items 100 · marks 100 → Draft the blueprint

PharmacologyItems 20Marks 20Application 12 · Analysis 8 2

Checks3

● PLO B3 has no questions

● Application is 8 points below its target

● 100 items, 100 marks

Blueprint tab, with live checks
  1. 1
    Optionally press Draft the blueprint with AI with the total items and marks; it weights courses by credit hours. Check every line it proposes.
  2. 2
    Edit each line: course, topics, course outcomes, items, marks, and how the items spread over Bloom levels, outcomes, competencies and domains. Use the arrows to move, copy or remove lines.
  3. 3
    Read the Checks panel as you type. Red must be fixed, amber is worth a look, and blue is for information.
  4. 4
    Save the blueprint. The download gives the blueprint workbook for the committee and accreditors.
You are done when the checks show no red, the committee agrees the blueprint, and Setup's status is Blueprint approved: locked.

Step 5 · Writers

Write questions

Who: question writers, chair

Coverage of the blueprint shows, line by line, how many approved questions exist against how many are needed. Write where the bar is short.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Coverage of the blueprint1

Pharmacology7 / 20Write

New question

Stem2

A 58-year-old man on warfarin is started on…

○ A. Paracetamol   ● B. Clarithromycin (correct)   ○ C. … 3

Course · PLO · Bloom · Miller · Competency · Domain 4

SaveSend for review5
Questions tab: coverage and the question editor
  1. 1
    Press Write on a coverage line (the tags are filled in for you) or New question.
  2. 2
    Write the stem. A short clinical vignette is best, and the question should be answerable without seeing the options. Add a picture if needed.
  3. 3
    Write the options and tick the one correct answer. Add the rationale: why the answer is right and why each other option is wrong.
  4. 4
    Check the tags: course, outcome, Bloom and Miller level, competency, domain. The automatic checks warn about common item-writing flaws.
  5. 5
    Press Send for review. Two different reviewers must approve it, and never its writer.
Where the university has its own AI server, AI draft on a coverage line writes drafts for you, and AI check answers a question without seeing the key, to catch wrong keys and ambiguity. Every AI draft still needs a writer's edit and two reviewers.
Mark questions that must not appear on the same paper as enemies (for example two that give each other away). Each saved version is kept in History.

Writers

Import an old Word paper

Who: question writers, chair

Turn an existing paper into draft questions instead of retyping them. The file is read in your browser; nothing is sent to any AI.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff
Choose a Word file (.docx)1

paper.docx: 40 questions found, 37 with an answer marked; 3 need a look. 2

Course (all these questions) *3

Pharmacology▾

Question 12

⚠ No answer was marked: pick it below.

Answer B was taken from a * mark. ☑ Answer checked 4

Add 37 checked questions as drafts5
Questions → Import a Word paper
  1. 1
    Press Import a Word paper in the Questions list and choose the .docx (save an old .doc as .docx first).
  2. 2
    Questions numbered 1. or with Word's numbering, and options lettered A., a) or (a), are found. The answer is taken from a *, an Answer: B line, an answer key at the end, or the only underlined or bold option.
  3. 3
    Pick the course for the batch (optionally a topic, Bloom level and outcome).
  4. 4
    Read each question, fix anything flagged, pick the answer if none was found, and tick Answer checked.
  5. 5
    Press Add … checked questions as drafts. They appear as drafts marked Imported; send them for review like any other.

Reviewers

Review questions

Who: reviewers

scibayan.com/exit-exam-studio
QuestionsStaff

Status1

Waiting for my review▾

Q14 · In review · version 2

Stem, options, the answer and rationale…

Approve2Send back for changes3Add comment
Questions → Waiting for my review
  1. 1
    Filter the list by Waiting for my review.
  2. 2
    Read the question as a graduate would: one clearly best answer, current guidelines, no clues, units given. If it is right, press Approve.
  3. 3
    If not, press Send back for changes with a comment saying what to fix.
You are done when the question shows Approved, which needs two different reviewers. Only approved questions can go on the paper.

Step 6 · Chair

Assemble and lock the paper

Who: chair

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Assemble the paper

Versions1

2

Seed

1
Assemble paper2

Questions on the paper (version A order) · swap one with Use this 3

Lock the paper4
Candidate booklet (Word)Examiner copy with keys (Word)Item map and answer keys (Excel)5
Paper tab
  1. 1
    Choose how many versions you want (A, B…). Each has the same questions in a different order, with shuffled options.
  2. 2
    Press Assemble paper. It picks approved questions to match each blueprint line, keeps enemy questions apart and spreads the correct answers evenly over the letters. If some lines are short, it says which.
  3. 3
    Read the paper. Swap any question with Use this on an alternative, or press Assemble again for a fresh selection.
  4. 4
    Press Lock the paper. The questions are frozen exactly as they will be printed, so later edits in the bank cannot change them.
  5. 5
    Download the booklets, examiner copies and item map for printing, or deliver the paper on screen (Sittings).
Booklets and examiner copies are separate files on purpose: never print or send them together. Keep the item map confidential.

Step 7 · Chair

Set the pass mark

Who: chair (panelists rate)

Instead of a fixed 60%, set the pass mark by expert judgement. The written paper uses a panel (modified Angoff, checked with Hofstee); an OSCE uses the examiners' overall ratings (borderline regression).

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

The panel1

Dr A · Dr B · Dr C (on paper) Type in ratings

Start round 12Close round 13

The panel's pass mark

58.4% · SD 4.1 · 6 questions to discuss 4

Sign the pass mark

Your full name

Prof. …
Sign5Use as the overall pass mark
Pass mark tab
  1. 1
    Add panelists as Pass-mark panelist in Staff (they rate online), or add people who rate on paper by name and Type in ratings for them. Five or more is best.
  2. 2
    With the paper locked, press Start round 1. Panelists rate each question and hand in.
  3. 3
    Press Close round. Discuss the questions flagged for wide disagreement, then press Start round 2 (up to 3 rounds). Panelists see their earlier rating and the panel's average and range.
  4. 4
    Read the pass mark, its spread and the Hofstee check (once real scores exist). Set aside an outlying panelist with a reason if the committee agrees.
  5. 5
    Type your full name and Sign. The record is frozen for the accreditation pack. Then use it as the overall pass mark or a part's minimum.
OSCE: send the station scores from the OSCE board with To Pass mark, or upload them (ID, station, score, out of, overall rating 1 to 5). Each station's pass mark is read where its line crosses "borderline".

Panelists

Rate questions for the pass mark

Who: pass-mark panelists

scibayan.com/exit-exam-studio
Rate for the pass markStaff

Question 3

A 64-year-old woman with…

Borderline graduates correct, out of 1001

60

Hofstee check (optional)2

Lowest / highest acceptable pass mark and fail rate

SaveHand in round 13
Rate for the pass mark
  1. 1
    For each question, picture 100 borderline graduates, those who only just deserve to pass and practise safely, and type how many would answer it correctly (0 to 100). Think about the graduate, not about how hard it is for you.
  2. 2
    Optionally fill the four Hofstee values: the lowest and highest pass mark, and fail rate, you would accept for this paper.
  3. 3
    Save as you go, and press Hand in when every question is rated. Answers are hidden until you hand in round 1, so your first judgement is your own.

Step 8 · Coordinators

Run a computer-based sitting

Who: sitting coordinators, chair

Deliver the locked written paper on screen. Graduates need no account.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff
New computer sitting1New OSCE

Name

Written paper, morning

Length (minutes)2

120

Room

Computer lab 2

Planned start

20 Nov, 09:00

Graduates in this sitting: ☑ 2201 Sara ☑ 2202 Omar … 3

Save sitting4
Sittings → New computer sitting
  1. 1
    Press New computer sitting. It delivers the written part.
  2. 2
    Give the length in minutes. Each graduate's clock starts when they press Start; extra time is given per graduate on the day.
  3. 3
    Tick the graduates who sit in this room. Add candidates first in Results → 1. Candidates. Versions are dealt A, B, A, B… so neighbours differ.
  4. 4
    Press Save sitting. You can set it up before the paper is locked, but it opens only once the paper is locked.

On the day

The live board

Who: sitting coordinators, invigilators

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Sitting code

K7MQ2P 1

Graduates go to …/exit-exam-sitting

IDNameStateLeftTime2201SaraSitting–1:12:402202OmarOut of fullscreen 22×1:10:05
+ Time3NoteHand inReopenClose the sitting4
Open board → Open the sitting
  1. 1
    When graduates are seated, open the board and press Open the sitting. Read out the code and the address shown. Each graduate types the code and their university ID number.
  2. 2
    Watch the states: Sitting, Out of fullscreen, Not responding (no contact for 45 seconds; check the computer) and Handed in. The board refreshes every 10 seconds; every event is in the incident log.
  3. 3
    Use + Time for agreed accommodations or a computer fault, Note to log an incident, Hand in for a graduate, or Reopen to let someone continue. Each asks for a reason, which is kept.
  4. 4
    At the end press Close the sitting. Everyone still sitting is handed in, and those who never started are marked absent. Their answers become answer sheets in Results automatically.
If a computer fails, the graduate signs in on another one with the same code and ID. Nothing is lost, because every answer is saved as it is picked.

Coordinators

Run an OSCE

Who: sitting coordinators, chair

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

First circuit starts at1

09:00

Minutes at each station

8

Minutes to change over

2

Station 1 · History taking2

Introduces self | 1
Asks about allergies | 2

Draft with AI: what should this station assess? 3

Rotation: circuit 1 · slot 1 09:00 · slot 2 09:10 … missing scores in red 4

To Results5To Pass mark
Sittings → New OSCE
  1. 1
    Press New OSCE: pick the OSCE part, the start time, the minutes at each station and to change over, and the graduates in rotation order.
  2. 2
    Add stations. Give each a maximum score, or a checklist with one item per line and its marks after a bar (Asks about allergies | 2). Open Station details to add the door instructions, the patient script, the equipment, examiner notes and what each overall rating looks like.
  3. 3
    Where the university has its own AI server, Draft with AI fills a station from one line. Read and edit it before saving.
  4. 4
    On the day, open the OSCE. The board shows the rotation, and each visit turns green when scored or red if the score is still missing 5 minutes after it ended.
  5. 5
    After the OSCE, To Results stores each complete total as the part's mark; To Pass mark sends the scores and ratings for borderline regression.

Examiners

Score the OSCE on your phone

Who: OSCE examiners

Score the OSCE

History taking · 3 of 12 scored

09:20 · circuit 1 · now 1

Sara Ahmed

Not doneDone2
1
Clear fail
2
Borderline
3
Clear pass
4
Good
5
Excellent

Save score3

On a phone
  1. 1
    Open the exam in the Studio, choose Score the OSCE and pick your station once (it is remembered). Graduates are listed in the order they arrive, and the one due now is highlighted. Tap them.
  2. 2
    Tick the checklist, or type the score. Open Station details for the door instructions and notes.
  3. 3
    Give your overall rating, your own judgement apart from the score (tap one to see what it means at this station). Add a comment if useful, then press Save score.
The overall rating sets the station's pass mark, so use "2 Borderline" for a graduate who only just reaches safe practice.

Before the exam

OSCE practice for students

Who: chair, coordinators

Graduating students can practise OSCE-style consultations with the platform's Virtual Patient, inside a course they are enrolled in.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

Course the graduating students are in1

Exit exam preparation▾

In this course (3)

“My inhaler has stopped working” · 14 attempts · average 71%

Ready-made in the library

“Just something for these bruises” Add2

Write a new practice patient3Students' results
Sittings → OSCE practice for students
  1. 1
    Pick a course you teach that the graduating students are in (create one such as Exit exam preparation if needed).
  2. 2
    Press Add on ready-made library patients for your profession.
  3. 3
    Or Write a new practice patient in the Virtual Patient builder. Its Exam mode makes a timed, one-try mock station. Watch attempts and average scores here, and full results under Students' results.
Never use the real exam stations as practice patients. Practice patients are played by a general AI and students see them.

Step 9 · Chair

Results

Who: chair, university manager

Work through the six sections in order. Marks are always worked out from what is stored, so a committee decision re-marks everyone at once.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff
1. Candidates12. Answer sheets23. Other parts' marks34. Question review45. Pass rules and grades56. Results6

Question review

Q17 · 12% right · flagged → Drop it · Accept another answer as well · Correct the key

Release results
Results tab
  1. 1
    Candidates: add graduates from a file (ID number, name, email), from the university's students, or one by one.
  2. 2
    Answer sheets: on-screen sittings arrive automatically. For paper, upload the scanner's file or type in a sheet (use - for blank, * for two marks).
  3. 3
    Other parts' marks: OSCE totals arrive with To Results; type or upload any other part's marks.
  4. 4
    Question review: look at questions that behaved badly and decide: drop it, accept another answer as well, or correct the key, with a reason. Everyone is re-marked.
  5. 5
    Pass rules and grades: set the overall pass mark (or use the signed one), any part's minimum, and the letter grades, then press Save rules.
  6. 6
    Results: check every graduate is complete and press Release results. Results are frozen; send each graduate their personal link (copy it, or take all links from the Excel).
To correct anything after release, press Withdraw release with a reason, fix it and release again. The reason is kept in the record.

Step 10 · Chair

Reports and the accreditation pack

Who: chair, university manager

Available after release, from the frozen results, so the figures never shift.

scibayan.com/exit-exam-studio
SetupFrameworkBlueprintQuestionsPaperPass markSittingsScore the OSCEResultsReportsStaff

KR-20 0.86

Pass rate 82%

PLO A3 at target

Dean's one-page summary (PDF)1Quality reportResult sheetAccreditation pack (ZIP)2

Share a read-only report3

Who it is for: Dean's office · expires in 30 days → Copy

Reports tab
  1. 1
    Read exam quality (each question's difficulty and discrimination with a plain verdict, and the paper's reliability), outcome attainment against your target, and trends across cohorts. Download the Dean's one-page summary, the Quality report and the Result sheet.
  2. 2
    Accreditation pack (ZIP): the blueprint, quality report, attainment and trends, committee decisions, results by ID number, dean's summary and the signed pass-mark record, with a README. It contains no question text.
  3. 3
    Share a read-only report with the dean or quality office: a link with an expiry date that shows no names. You can withdraw it at any time.

Help: messages, questions and terms

Type a word from the message you see, or your question.

If you see this message

“This program's exit exams are run by …”

The program already has a chair. Ask them to add you in the Staff tab.

“Lock the paper first (Paper tab)”

Answer sheets, on-screen sittings and the written pass mark all need the locked paper. Assemble it, check it, then press Lock the paper.

“Not enough approved questions”

Some blueprint lines need more approved questions. Write and approve more for those courses, then press Assemble again.

“Results are released. Withdraw the release first…”

Released results are frozen. Go to Results → 6. Results → Withdraw release, give a reason, make the change, release again.

“A computer sitting is still open”

Close the sitting on the live board first, so every graduate's answers are handed in, then release results.

“The DMU AI server can't be reached right now”

The university's AI server is offline. Write or check by hand, or try later. Nothing was changed.

“Save your changes in Setup, Framework and Blueprint first”

Press the Save button on the tab with the amber dot ●, then come back.

“Only the program's committee chair and the university's manager…”

Your role does not include this part. Ask the chair if you need it.

Questions people ask

›Do graduates need an account?

No. For an on-screen sitting they sign in with the sitting code the invigilator reads out and their university ID number. Their result reaches them through a personal link the chair sends.

›Someone else is already chair of my program. How do I join?

Ask that chair to add you in the Staff tab with your email and the role you need. The Start form tells you who the chair is.

›I was added but I cannot see the exam.

Sign in with the same email the chair added, on the same site (for example effectiveness.dmu.ae for DMU). You must have signed in to that site at least once before you can be added. Then open AI Tools → Exit Exam Studio.

›Does any question text go to Gemini or another public AI?

No. AI drafting and AI checking of questions and OSCE stations use only the university's own AI server. Where a university has no such server, those buttons are hidden and everything else works by hand. The Framework and Blueprint AI helpers read only planning documents; never paste exam questions into them.

›Why can't I change a question that was approved?

You can, but a change to the wording, options or answer makes a new version and sends it back to draft, because the earlier approvals were for different words. Changing only the tags does not.

›Who can see the answer keys?

Writers, reviewers and the chair see them in the bank. Pass-mark panelists see them only after handing in their first round. Coordinators and examiners never see questions. The examiner copies and the item map are marked confidential.

›Can I reuse a question in next year's exam?

Yes. The bank belongs to the program, so every cohort's exam draws on it. After results are released, each question's statistics are written back to the bank to help the next assembly.

›A graduate's computer froze during the exam.

Nothing is lost: every answer is saved as it is picked. They sign in again on another computer with the same sitting code and ID number and carry on. Their clock keeps running; give extra time on the live board if it is fair.

›Can results be changed after release?

Not while they are released. Withdraw the release (with a reason, kept in the record), make the change, then release again.

›Where are the old admin-area pages?

Exit exams moved out of the admin area. Old links forward to the Exit Exam Studio, which is under AI Tools.

Terms

PLO / CLO
Program / course learning outcome. Questions and blueprint lines are tagged with them, so reports show attainment per outcome.
Blueprint
The plan of the paper: how many questions each course and outcome gets, at which Bloom level.
Version (A, B…)
The same questions in a different order with shuffled options. Neighbours get different versions.
Modified Angoff
Panelists estimate, for each question, how many of 100 borderline graduates would answer correctly. The average becomes the pass mark.
Hofstee check
A sanity check on the pass mark: the panel's acceptable range of pass marks and fail rates, drawn against the real scores.
Borderline regression
The OSCE pass mark method: each station's score is plotted against the examiners' overall ratings and read at 'borderline'.
p and discrimination
How many got a question right, and how well it separated stronger from weaker graduates. Shown in Question review and the quality report.
KR-20
How consistent the whole paper was as a measure (reliability). Shown in the quality report.
Everything in the Studio is confidential: do not copy questions outside it. Every view, edit, download, lock and release is kept in the exam's record. Graduates have their own guide: Student guide.