Faculty guide
The Exit Exam Studio, step by step
Everything a program needs for its graduating cohort's exit exam: the outcomes framework and blueprint, a reviewed question bank, the paper, a defensible pass mark, on-screen and OSCE sittings, results and the reports accreditors ask for. Open it from AI Tools → Exit Exam Studio.
What is your role?
Committee chair: Runs the program's exit exam from start to finish and adds the committee.
The journey of one exit exam
Each step has its own tab in the exam. Click a step to jump to it.
- Step 1StartAny faculty
- Step 2SetupChair
- Step 3FrameworkChair
- Step 4BlueprintChair
- Step 5QuestionsWriters, reviewers
- Step 6PaperChair
- Step 7Pass markChair, panelists
- Step 8SittingsCoordinators, examiners
- Step 9ResultsChair
- Step 10ReportsChair
Step 1
Start an exit exam
Who: any faculty member
Whoever first starts a program's exit exam becomes its committee chair. After that, the chair adds colleagues and starts each new cohort's exam.
Exit Exam Studio
+ Start an exit exam1Start an exit exam
University2
Program2
Exam name
Cohort3
Academic year
- 1Open AI Tools, choose Exit Exam Studio, then press Start an exit exam.
- 2On scibayan.com, type your university and program. On your university's own site (for example effectiveness.dmu.ae), the university is filled in for you: pick your program from the list.
- 3Name the exam and the cohort that sits it (for example Cohort 2022), and the academic year.
- 4Press Start. The exam opens with all its tabs. If nobody ran this program's exit exams before, you are now its committee chair.
Find your exam
Who: everyone you add
Committee members do not need to start anything. Once the chair adds you, the exam appears in your Studio.
Cairo University · Bachelor of Pharmacy
Exit Exam · Cohort 2022
2026/2027 · Draft · You: Writer, Reviewer
- 1Sign in with the same email the chair added, on the same site. Open AI Tools → Exit Exam Studio and press Open on the exam. You see only the tabs your role needs.
Chair
Add your committee
Who: chair, university manager
Roles belong to the program, so they carry over to every cohort's exam.
Add someone
Email1
Role2
Courses: ☑ Pharmacology ☐ Pharmaceutics 3
Add4- 1Type the colleague's email.
- 2Pick a role. Committee chair can do everything. Question writer writes questions. Reviewer approves them. Pass-mark panelist rates the locked paper. Sitting coordinator runs sittings. OSCE examiner scores stations.
- 3For writers and reviewers, tick the courses they work on (none ticked means all courses).
- 4Press Add. One person can hold several roles; add them once per role.
Step 2 · Chair
Setup: the exam and its parts
Who: chair
The parts make up the final result, for example a written paper and an OSCE.
Parts of the exam1
Blueprint targets3
Minimum items per program outcome: 3 · Bloom targets: Application 40% …
- 1Add each part with Add a part: its name, method, weight (all weights should add up to 100%) and maximum marks.
- 2Tick Has a blueprint on the written paper. That is the part built from the question bank.
- 3Optionally set Blueprint targets: the fewest questions per outcome, and the share of questions at each Bloom level. The blueprint checks warn when the plan drifts from them.
- 4Press Save exam settings. Later, set Status to Blueprint approved: locked once the committee agrees the blueprint.
Step 3 · Chair
Framework: outcomes and courses
Who: chair
The framework lists the program's learning outcomes, courses and their outcomes, competencies and accreditor domains. Questions and the blueprint are tagged with these lists, which is what makes the reports possible.
Profession1
Fill from a program document (AI)2
Paste the program specification → Read the document → Use these lists
Program learning outcomes (PLOs)3
A1 · Apply pharmaceutical knowledge …
- 1Pick the profession. It fills the starting competencies, accreditor domains and assessment methods, which you can edit.
- 2Fastest start: open Fill from a program document (AI), paste the program specification or study plan, press Read the document, check the proposed lists and press Use these lists.
- 3Check and edit the outcomes (with the codes your program uses, such as A1), the courses with their department, credit hours and course outcomes, and the competencies.
- 4Press Save framework. Every exit exam of this program uses it.
Step 4 · Chair
Blueprint: what the paper must cover
Who: chair
One line per part of the paper: which course and topics, how many questions and marks, and how they spread over Bloom levels, outcomes, competencies and domains.
Draft the blueprint with AI1
Total items 100 · marks 100 → Draft the blueprint
Checks3
● PLO B3 has no questions
● Application is 8 points below its target
● 100 items, 100 marks
- 1Optionally press Draft the blueprint with AI with the total items and marks; it weights courses by credit hours. Check every line it proposes.
- 2Edit each line: course, topics, course outcomes, items, marks, and how the items spread over Bloom levels, outcomes, competencies and domains. Use the arrows to move, copy or remove lines.
- 3Read the Checks panel as you type. Red must be fixed, amber is worth a look, and blue is for information.
- 4Save the blueprint. The download gives the blueprint workbook for the committee and accreditors.
Step 5 · Writers
Write questions
Who: question writers, chair
Coverage of the blueprint shows, line by line, how many approved questions exist against how many are needed. Write where the bar is short.
Coverage of the blueprint1
New question
Stem2
○ A. Paracetamol ● B. Clarithromycin (correct) ○ C. … 3
Course · PLO · Bloom · Miller · Competency · Domain 4
- 1Press Write on a coverage line (the tags are filled in for you) or New question.
- 2Write the stem. A short clinical vignette is best, and the question should be answerable without seeing the options. Add a picture if needed.
- 3Write the options and tick the one correct answer. Add the rationale: why the answer is right and why each other option is wrong.
- 4Check the tags: course, outcome, Bloom and Miller level, competency, domain. The automatic checks warn about common item-writing flaws.
- 5Press Send for review. Two different reviewers must approve it, and never its writer.
Writers
Import an old Word paper
Who: question writers, chair
Turn an existing paper into draft questions instead of retyping them. The file is read in your browser; nothing is sent to any AI.
paper.docx: 40 questions found, 37 with an answer marked; 3 need a look. 2
Course (all these questions) *3
Question 12
⚠ No answer was marked: pick it below.
Answer B was taken from a * mark. ☑ Answer checked 4
- 1Press Import a Word paper in the Questions list and choose the .docx (save an old .doc as .docx first).
- 2Questions numbered 1. or with Word's numbering, and options lettered A., a) or (a), are found. The answer is taken from a *, an Answer: B line, an answer key at the end, or the only underlined or bold option.
- 3Pick the course for the batch (optionally a topic, Bloom level and outcome).
- 4Read each question, fix anything flagged, pick the answer if none was found, and tick Answer checked.
- 5Press Add … checked questions as drafts. They appear as drafts marked Imported; send them for review like any other.
Reviewers
Review questions
Who: reviewers
Status1
Q14 · In review · version 2
Stem, options, the answer and rationale…
- 1Filter the list by Waiting for my review.
- 2Read the question as a graduate would: one clearly best answer, current guidelines, no clues, units given. If it is right, press Approve.
- 3If not, press Send back for changes with a comment saying what to fix.
Step 6 · Chair
Assemble and lock the paper
Who: chair
Assemble the paper
Versions1
Seed
Questions on the paper (version A order) · swap one with Use this 3
Lock the paper4- 1Choose how many versions you want (A, B…). Each has the same questions in a different order, with shuffled options.
- 2Press Assemble paper. It picks approved questions to match each blueprint line, keeps enemy questions apart and spreads the correct answers evenly over the letters. If some lines are short, it says which.
- 3Read the paper. Swap any question with Use this on an alternative, or press Assemble again for a fresh selection.
- 4Press Lock the paper. The questions are frozen exactly as they will be printed, so later edits in the bank cannot change them.
- 5Download the booklets, examiner copies and item map for printing, or deliver the paper on screen (Sittings).
Step 7 · Chair
Set the pass mark
Who: chair (panelists rate)
Instead of a fixed 60%, set the pass mark by expert judgement. The written paper uses a panel (modified Angoff, checked with Hofstee); an OSCE uses the examiners' overall ratings (borderline regression).
The panel1
Dr A · Dr B · Dr C (on paper) Type in ratings
The panel's pass mark
58.4% · SD 4.1 · 6 questions to discuss 4
Sign the pass mark
Your full name
- 1Add panelists as Pass-mark panelist in Staff (they rate online), or add people who rate on paper by name and Type in ratings for them. Five or more is best.
- 2With the paper locked, press Start round 1. Panelists rate each question and hand in.
- 3Press Close round. Discuss the questions flagged for wide disagreement, then press Start round 2 (up to 3 rounds). Panelists see their earlier rating and the panel's average and range.
- 4Read the pass mark, its spread and the Hofstee check (once real scores exist). Set aside an outlying panelist with a reason if the committee agrees.
- 5Type your full name and Sign. The record is frozen for the accreditation pack. Then use it as the overall pass mark or a part's minimum.
Panelists
Rate questions for the pass mark
Who: pass-mark panelists
Question 3
A 64-year-old woman with…
Borderline graduates correct, out of 1001
Hofstee check (optional)2
Lowest / highest acceptable pass mark and fail rate
- 1For each question, picture 100 borderline graduates, those who only just deserve to pass and practise safely, and type how many would answer it correctly (0 to 100). Think about the graduate, not about how hard it is for you.
- 2Optionally fill the four Hofstee values: the lowest and highest pass mark, and fail rate, you would accept for this paper.
- 3Save as you go, and press Hand in when every question is rated. Answers are hidden until you hand in round 1, so your first judgement is your own.
Step 8 · Coordinators
Run a computer-based sitting
Who: sitting coordinators, chair
Deliver the locked written paper on screen. Graduates need no account.
Name
Length (minutes)2
Room
Planned start
Graduates in this sitting: ☑ 2201 Sara ☑ 2202 Omar … 3
Save sitting4- 1Press New computer sitting. It delivers the written part.
- 2Give the length in minutes. Each graduate's clock starts when they press Start; extra time is given per graduate on the day.
- 3Tick the graduates who sit in this room. Add candidates first in Results → 1. Candidates. Versions are dealt A, B, A, B… so neighbours differ.
- 4Press Save sitting. You can set it up before the paper is locked, but it opens only once the paper is locked.
On the day
The live board
Who: sitting coordinators, invigilators
Sitting code
K7MQ2P 1
Graduates go to …/exit-exam-sitting
- 1When graduates are seated, open the board and press Open the sitting. Read out the code and the address shown. Each graduate types the code and their university ID number.
- 2Watch the states: Sitting, Out of fullscreen, Not responding (no contact for 45 seconds; check the computer) and Handed in. The board refreshes every 10 seconds; every event is in the incident log.
- 3Use + Time for agreed accommodations or a computer fault, Note to log an incident, Hand in for a graduate, or Reopen to let someone continue. Each asks for a reason, which is kept.
- 4At the end press Close the sitting. Everyone still sitting is handed in, and those who never started are marked absent. Their answers become answer sheets in Results automatically.
Coordinators
Run an OSCE
Who: sitting coordinators, chair
First circuit starts at1
Minutes at each station
Minutes to change over
Station 1 · History taking2
Introduces self | 1
Asks about allergies | 2
Draft with AI: what should this station assess? 3
Rotation: circuit 1 · slot 1 09:00 · slot 2 09:10 … missing scores in red 4
- 1Press New OSCE: pick the OSCE part, the start time, the minutes at each station and to change over, and the graduates in rotation order.
- 2Add stations. Give each a maximum score, or a checklist with one item per line and its marks after a bar (Asks about allergies | 2). Open Station details to add the door instructions, the patient script, the equipment, examiner notes and what each overall rating looks like.
- 3Where the university has its own AI server, Draft with AI fills a station from one line. Read and edit it before saving.
- 4On the day, open the OSCE. The board shows the rotation, and each visit turns green when scored or red if the score is still missing 5 minutes after it ended.
- 5After the OSCE, To Results stores each complete total as the part's mark; To Pass mark sends the scores and ratings for borderline regression.
Examiners
Score the OSCE on your phone
Who: OSCE examiners
History taking · 3 of 12 scored
09:20 · circuit 1 · now 1
Sara Ahmed
Clear fail2
Borderline3
Clear pass4
Good5
Excellent
Save score3
- 1Open the exam in the Studio, choose Score the OSCE and pick your station once (it is remembered). Graduates are listed in the order they arrive, and the one due now is highlighted. Tap them.
- 2Tick the checklist, or type the score. Open Station details for the door instructions and notes.
- 3Give your overall rating, your own judgement apart from the score (tap one to see what it means at this station). Add a comment if useful, then press Save score.
Before the exam
OSCE practice for students
Who: chair, coordinators
Graduating students can practise OSCE-style consultations with the platform's Virtual Patient, inside a course they are enrolled in.
Course the graduating students are in1
In this course (3)
“My inhaler has stopped working” · 14 attempts · average 71%
Ready-made in the library
“Just something for these bruises” Add2
- 1Pick a course you teach that the graduating students are in (create one such as Exit exam preparation if needed).
- 2Press Add on ready-made library patients for your profession.
- 3Or Write a new practice patient in the Virtual Patient builder. Its Exam mode makes a timed, one-try mock station. Watch attempts and average scores here, and full results under Students' results.
Step 9 · Chair
Results
Who: chair, university manager
Work through the six sections in order. Marks are always worked out from what is stored, so a committee decision re-marks everyone at once.
Question review
Q17 · 12% right · flagged → Drop it · Accept another answer as well · Correct the key
- 1Candidates: add graduates from a file (ID number, name, email), from the university's students, or one by one.
- 2Answer sheets: on-screen sittings arrive automatically. For paper, upload the scanner's file or type in a sheet (use - for blank, * for two marks).
- 3Other parts' marks: OSCE totals arrive with To Results; type or upload any other part's marks.
- 4Question review: look at questions that behaved badly and decide: drop it, accept another answer as well, or correct the key, with a reason. Everyone is re-marked.
- 5Pass rules and grades: set the overall pass mark (or use the signed one), any part's minimum, and the letter grades, then press Save rules.
- 6Results: check every graduate is complete and press Release results. Results are frozen; send each graduate their personal link (copy it, or take all links from the Excel).
Step 10 · Chair
Reports and the accreditation pack
Who: chair, university manager
Available after release, from the frozen results, so the figures never shift.
KR-20 0.86
Pass rate 82%
PLO A3 at target
Share a read-only report3
Who it is for: Dean's office · expires in 30 days → Copy
- 1Read exam quality (each question's difficulty and discrimination with a plain verdict, and the paper's reliability), outcome attainment against your target, and trends across cohorts. Download the Dean's one-page summary, the Quality report and the Result sheet.
- 2Accreditation pack (ZIP): the blueprint, quality report, attainment and trends, committee decisions, results by ID number, dean's summary and the signed pass-mark record, with a README. It contains no question text.
- 3Share a read-only report with the dean or quality office: a link with an expiry date that shows no names. You can withdraw it at any time.
Help: messages, questions and terms
Type a word from the message you see, or your question.
If you see this message
“This program's exit exams are run by …”
The program already has a chair. Ask them to add you in the Staff tab.
“Lock the paper first (Paper tab)”
Answer sheets, on-screen sittings and the written pass mark all need the locked paper. Assemble it, check it, then press Lock the paper.
“Not enough approved questions”
Some blueprint lines need more approved questions. Write and approve more for those courses, then press Assemble again.
“Results are released. Withdraw the release first…”
Released results are frozen. Go to Results → 6. Results → Withdraw release, give a reason, make the change, release again.
“A computer sitting is still open”
Close the sitting on the live board first, so every graduate's answers are handed in, then release results.
“The DMU AI server can't be reached right now”
The university's AI server is offline. Write or check by hand, or try later. Nothing was changed.
“Save your changes in Setup, Framework and Blueprint first”
Press the Save button on the tab with the amber dot ●, then come back.
“Only the program's committee chair and the university's manager…”
Your role does not include this part. Ask the chair if you need it.
Questions people ask
›Do graduates need an account?
No. For an on-screen sitting they sign in with the sitting code the invigilator reads out and their university ID number. Their result reaches them through a personal link the chair sends.
›Someone else is already chair of my program. How do I join?
Ask that chair to add you in the Staff tab with your email and the role you need. The Start form tells you who the chair is.
›I was added but I cannot see the exam.
Sign in with the same email the chair added, on the same site (for example effectiveness.dmu.ae for DMU). You must have signed in to that site at least once before you can be added. Then open AI Tools → Exit Exam Studio.
›Does any question text go to Gemini or another public AI?
No. AI drafting and AI checking of questions and OSCE stations use only the university's own AI server. Where a university has no such server, those buttons are hidden and everything else works by hand. The Framework and Blueprint AI helpers read only planning documents; never paste exam questions into them.
›Why can't I change a question that was approved?
You can, but a change to the wording, options or answer makes a new version and sends it back to draft, because the earlier approvals were for different words. Changing only the tags does not.
›Who can see the answer keys?
Writers, reviewers and the chair see them in the bank. Pass-mark panelists see them only after handing in their first round. Coordinators and examiners never see questions. The examiner copies and the item map are marked confidential.
›Can I reuse a question in next year's exam?
Yes. The bank belongs to the program, so every cohort's exam draws on it. After results are released, each question's statistics are written back to the bank to help the next assembly.
›A graduate's computer froze during the exam.
Nothing is lost: every answer is saved as it is picked. They sign in again on another computer with the same sitting code and ID number and carry on. Their clock keeps running; give extra time on the live board if it is fair.
›Can results be changed after release?
Not while they are released. Withdraw the release (with a reason, kept in the record), make the change, then release again.
›Where are the old admin-area pages?
Exit exams moved out of the admin area. Old links forward to the Exit Exam Studio, which is under AI Tools.
Terms
- PLO / CLO
- Program / course learning outcome. Questions and blueprint lines are tagged with them, so reports show attainment per outcome.
- Blueprint
- The plan of the paper: how many questions each course and outcome gets, at which Bloom level.
- Version (A, B…)
- The same questions in a different order with shuffled options. Neighbours get different versions.
- Modified Angoff
- Panelists estimate, for each question, how many of 100 borderline graduates would answer correctly. The average becomes the pass mark.
- Hofstee check
- A sanity check on the pass mark: the panel's acceptable range of pass marks and fail rates, drawn against the real scores.
- Borderline regression
- The OSCE pass mark method: each station's score is plotted against the examiners' overall ratings and read at 'borderline'.
- p and discrimination
- How many got a question right, and how well it separated stronger from weaker graduates. Shown in Question review and the quality report.
- KR-20
- How consistent the whole paper was as a measure (reliability). Shown in the quality report.