Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
---
id: TASK-25
title: Tune minimum screen-size / device gate thresholds
status: To Do
assignee: []
created_date: '2026-05-22 16:10'
labels: []
dependencies: []
---

## Description

<!-- SECTION:DESCRIPTION:BEGIN -->
The study has a screen-size gate (ScreenSizeCheck) that blocks participants on screens smaller than MIN_SCREEN_WIDTH x MIN_SCREEN_HEIGHT (currently 600x500) or on mobile devices. These thresholds were carried over from the old study and never tuned. Determine the smallest screen the experiment can reasonably run on without breaking the layout (chat panel + writing area + AI panel), and update the constants in lib/studyConfig.ts accordingly.
<!-- SECTION:DESCRIPTION:END -->

## Acceptance Criteria
<!-- AC:BEGIN -->
- [ ] #1 Smallest usable viewport for TaskPage layout is empirically determined
- [ ] #2 MIN_SCREEN_WIDTH and MIN_SCREEN_HEIGHT in lib/studyConfig.ts reflect the determined values
- [ ] #3 Mobile detection in checkScreenSize() is reviewed against the old study's userAgent 'mobile' substring check
<!-- AC:END -->
51 changes: 51 additions & 0 deletions experiment/INCOMING-survey-questions.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@

"Can you recall a specific moment when you read the AI-generated draft and it affected what you wrote next? Be as specific as you can."


agreeLikert("easyToUnderstand", "The AI-generated draft was easy to understand", 5),
agreeLikert("helpedMe", "The AI-generated draft helped me with the writing task", 5),
agreeLikert("feltPressured", "I felt pressured to use what the AI suggested", 5),
agreeLikert("thinkCarefullyAppropriate", "I had to think carefully about whether the AI draft was appropriate", 5),
agreeLikert("thinkCarefullyHowToUse", "I had to think carefully about how to use the AI draft", 5),
agreeLikert("newAspects", "The AI draft made me consider aspects that I hadn't thought of", 5),
agreeLikert("aiShapedFinalText", "The AI draft significantly shaped the final text", 5),
{
text: "How would you describe the draft that the AI provided?",
responseType: "text",
name: "aiTextDescription",
flags: { multiline: true }
}
);
} else {
// Original questions for bullet-point conditions
postTaskSurveyQuestions.push(
{
},
{
text: "",
responseType: "text",
name: "suggestionNotUsed",
flags: { multiline: true }
},
{
text: "Can you recall a specific moment when you read a suggestion and it affected what you wrote next? Be as specific as you can.",
responseType: "text",
name: "suggestionRecall",
flags: { multiline: true }
},
agreeLikert("easyToUnderstand", "The AI text was easy to understand", 5),
agreeLikert("helpedMe", "The AI text helped me with the writing task", 5),
agreeLikert("feltPressured", "I felt pressured to do what the AI suggested", 5),
agreeLikert("thinkCarefullyAppropriate", "I had to think carefully about whether the AI text was appropriate", 5),
agreeLikert("thinkCarefullyHowToUse", "I had to think carefully about how to use the AI text", 5),
agreeLikert("newAspects", "The AI text made me consider aspects that I hadn't thought of", 5),
agreeLikert("aiShapedFinalText", "The AI text significantly shaped the final text", 5),
{
text: "How would you describe the text that the AI provided?",
responseType: "text",
name: "aiTextDescription",
flags: { multiline: true }
}
);
}

17 changes: 11 additions & 6 deletions experiment/components/study/IntroPage.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -33,12 +33,11 @@ export default function IntroPage() {
<div className="max-w-2xl mx-auto p-8">
<div className="space-y-6 mb-8">
<section>
<h2 className="text-2xl font-semibold mb-3">Overview</h2>
<p className="text-gray-700 mb-4">
Thank you for participating in this research study about AI writing
assistance. Your contributions will help us understand how writers
interact with AI tools.
</p>
<h2 className="text-2xl font-semibold mb-3">Hi!</h2>
<p>We&apos;re a group of students and one professor at Calvin University, a small mostly-undergrad school in Grand Rapids, Michigan.</p>
<p>We&apos;ve been interested in how different kinds of AI affect what&mdash;and how&mdash;people write.</p>
<p>In this study, we will explore how AI writing tools influence your writing process and outcomes.</p>
<p>Thank you for helping us out!</p>
</section>

<section>
Expand All @@ -50,6 +49,12 @@ export default function IntroPage() {
<li>Complete a follow-up questionnaire about your experience</li>
</ol>
</section>
<p className="text-gray-700 mb-4">
Thank you for participating in this research study about AI writing
assistance. Your contributions will help us understand how writers
interact with AI tools.
</p>
<p>Ready?</p>
</div>

<button
Expand Down
6 changes: 6 additions & 0 deletions experiment/components/study/StartTaskPage.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -55,6 +55,12 @@ export default function StartTaskPage() {
<li>
You may see AI-generated writing suggestions on the right side of the screen. If so, feel free to use them, edit them, or ignore them — it&apos;s entirely up to you.
</li>
<li>
<b>The AI can make mistakes. Check important info.</b>
</li>
<li>
Please don&apos;t use any <em>other</em> writing aids, like Grammarly or ChatGPT, for the writing task. (Normal text entry features like spell check and autocomplete are <em>allowed</em>.)
</li>
<li>
When you&apos;re satisfied with your response, click the
&ldquo;Send&rdquo; button
Expand Down
2 changes: 1 addition & 1 deletion experiment/components/survey/surveyData.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ export const postTaskCommonQuestions: Question[] = [
export const postTaskAIQuestions: Question[] = [
{
id: 'ai_decision_timing',
text: <>When did you decide <b>not</b> to use an AI suggestion?</>,
text: <>Can you recall a specific moment when you read a suggestion and decided not to use it? What made you decide that? Be as specific as you can.</>,
type: 'text',
placeholder: 'Describe when and why you decided not to use a suggestion',
required: false,
Expand Down