Maya Patel·
Needed to decide our hybrid policy and got a full survey with bias controls and a real analysis plan
Design methodologically sound surveys with proper question types, flow logic, bias elimination, and analysis planning.
Research-Grade Survey Architect
You are a senior research methodologist specializing in survey design at a leading polling organization. Design a rigorous, bias-minimized survey instrument.\n\nSURVEY OBJECTIVE: {{what_decision_or_insight_this_survey_will_drive}}\nTARGET RESPONDENTS: {{target_audience_demographics_and_characteristics}}\nSURVEY LENGTH TARGET: {{desired_length — e.g., '5 minutes', '10 minutes', '15 minutes max'}}\nDISTRIBUTION METHOD: {{distribution — e.g., 'Email', 'In-app', 'Phone', 'Intercept', 'Panel'}}\n\nOUTPUT — A complete survey design package:\n\n## 1. SURVEY STRATEGY BRIEF\n- Research objectives (primary + secondary)\n- Hypotheses being tested (if applicable)\n- Analysis plan overview (what statistical tests will be run?)\n- Sample size recommendation with power justification\n\n## 2. QUESTIONNAIRE DESIGN\nOrganize questions into logical blocks with estimated timing per block:\n\n**BLOCK 1: SCREENER / CLASSIFICATION** [X min]\n(Questions to qualify respondents and establish segments)\n\n**BLOCK 2: [TOPIC AREA 1]** [X min]\n- Each question: Number | Question Text | Type | Response Options | Why This Question | Analysis Method\n- Question types to use: Single-select, Multi-select, Likert scale (5 or 7 point), NPS, Semantic differential, Open-ended, MaxDiff, Conjoint (if appropriate)\n\n**BLOCK 3: [TOPIC AREA 2]** [X min]\n(Continue pattern...)\n\n**BLOCK 4: DEMOGRAPHICS** [X min]\n(Age, gender, income, role, tenure, etc. relevant to {{target_audience}})\n\nTOTAL QUESTIONS: [Count]\nESTIMATED COMPLETION TIME: [Minutes]\n\n## 3. QUESTION QUALITY AUDIT\nFor each question, verify:\n- No double-barreled questions (one concept per question)\n- No leading or loaded language\n- Mutually exclusive and exhaustive response options\n- Balanced scales (no acquiescence bias)\n- Appropriate specificity level for respondent knowledge\n\n## 4. FLOW LOGIC MAP\n- Skip logic rules (if Q2=No, skip to Q5)\n- Branching for different respondent types\n- Termination criteria for unqualified respondents\n\n## 5. BIAS MITIGATION CHECKLIST\n- Order effects mitigation (randomization strategy)\n- Social desirability bias controls\n- Recall bias minimization (timeframe specification)\n- Anchoring bias prevention\n- Mode effects (if multi-channel)\n\n## 6. ANALYSIS PLAN\n- Cross-tabulation plan (which demographics × which questions)\n- Statistical tests for each hypothesis\n- Significance threshold (p < 0.05 default)\n- Open-ended coding framework\n\n## 7. PILOT TESTING PROTOCOL\n- Pilot sample size recommendation\n- What to measure in pilot (timing, dropout points, confusion)\n- Revision criteria
Ergebnisse
# Survey Design Package — Hybrid Work Policy
**Objective:** decide whether to make our 3-day office mandate permanent. **Respondents:** 1,200 full-time employees. **Target:** 8 min, in-app.
## 1. Strategy Brief
- Primary: does the current 3-day mandate predict retention intent and engagement?
- Secondary: which policy variant (2/3/4 days, fully flexible) maximizes both.
- Analysis: logistic regression on retention intent; ANOVA across tenure bands; MaxDiff on perks.
- Sample: n=385 for ±5% at 95% CI. With 1,200 invited, expect ~45% response.
## 2. Questionnaire (8 min, 22 questions)
| # | Question | Type | Why |
|---|----------|------|-----|
| 1 | Department | Single-select | Segmentation |
| 2 | Tenure | Single-select | Cohort split |
| 8 | "I can do my best work under the current policy" | 7-pt Likert | Core driver |
| 14 | How likely to recommend us as an employer (0–10) | eNPS | Outcome metric |
| 17 | Pick the office-day count you'd prefer most/least | MaxDiff | Preference, bias-resistant |
**Blocks:** Screener (1 min) · Current experience (3) · Productivity & wellbeing (2) · Preferences MaxDiff (1) · Demographics (1).
## 3. Quality Audit
- No double-barreled items (split "productive and happy" into two).
- Balanced 7-pt scales, neutral midpoint labeled.
- eNPS placed before preference questions to avoid anchoring.
## 4. Flow Logic
If Q1 = "Field/Remote-contract" → skip productivity block → demographics. Randomize Likert block order.
## 5. Bias Mitigation
Anonymous, aggregated reporting noted up front to cut social-desirability bias; "in a typical week" framing limits recall bias.
## 6. Pilot
n=30, measure median completion time and Q17 drop-off; revise any item with >10% "prefer not to answer."
Modell: Claude Sonnet 4
24 Likes7 SavesScore: 16
2 Kommentare
Julia Moser·
This is the first weekly review template that actually stuck.
Anna Hofmann·
My standups got shorter and clearer overnight.