MechanisticInterpretabilityShowcase/index.html at main · PrecisionNeuroLab/MechanisticInterpretabilityShowcase · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="UTF-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Mechanistic Interpretability Showcase</title>
    <link rel="stylesheet" href="styles.css">
    <script src="https://cdn.plot.ly/plotly-3.3.0.min.js" charset="utf-8"></script>
</head>
<body>
<header>
    <nav class="navbar">
        <div class="container">
            <h1 class="logo">Precision Neurotherapeutics Lab</h1>
        </div>
    </nav>
</header>

<main>
    <section id="demos" class="demos-section">
        <div class="container">
            <h2 class="section-title">Selected Mechanistic Interpretability Tools Showcase</h2>
            <p class="section-description">
                At Precision Neurotherapeutics Lab, we analyze LLM residual streams from textual descriptions of depression symptoms.
                To navigate the high-dimensional structure of these residual streams, we have developed a suite of mechanistic interpretability tools.
                Our interactive data visualizations showcase these tools in action, using residual stream activations retrieved from google/gemma-2-2b, a model with an embedding length of 2304 across 26 transformer layers.
            </p>

            <div class="research-card">
                <h3>Vector Distances Between Emotions</h3>
                <p>We visualized the L2 Euclidean and Cosine distances of word embeddings in the input layer before they
                    went through the transformer layers. We found that words with similar meanings were sometimes close
                    together in the high-dimensional embedding space, although not always.</p><br>
                <div id="0f80a5c5-f246-4e76-90a3-6518e5ee6eb2" class="plotly-graph-div"
                     style="height:100%; width:100%;"></div>
                <script type="text/javascript">
                    window.PLOTLYENV=window.PLOTLYENV || {};                                if (document.getElementById("0f80a5c5-f246-4e76-90a3-6518e5ee6eb2")) {                    Plotly.newPlot(                        "0f80a5c5-f246-4e76-90a3-6518e5ee6eb2",                        [{"coloraxis":"coloraxis","name":"0","texttemplate":"%{z}","x":["happy","elated","peaceful","calm","content","relaxed","sad","anxious","fearful","scared","depressed","lonely","bitter","jealous","angry","guilty","passionate","brave","confident"],"y":["happy","elated","peaceful","calm","content","relaxed","sad","anxious","fearful","scared","depressed","lonely","bitter","jealous","angry","guilty","passionate","brave","confident"],"z":[[null,2.922785758972168,2.1715176105499268,2.1030538082122803,2.190687894821167,2.109285354614258,2.0164406299591064,2.6545960903167725,2.744584321975708,2.1226043701171875,2.714607000350952,2.1073460578918457,2.2111992835998535,2.7698893547058105,1.8836708068847656,2.254176378250122,2.6292803287506104,2.1319894790649414,2.0346643924713135],[2.922785758972168,null,3.291893720626831,3.0689382553100586,2.8085265159606934,3.144939661026001,2.8890933990478516,2.944986581802368,3.3822453022003174,3.2189292907714844,3.242658853530884,3.1563985347747803,3.2870731353759766,3.2143516540527344,3.0143258571624756,3.341740131378174,2.881408929824829,3.117797613143921,3.0504841804504395],[2.1715176105499268,3.291893720626831,null,1.8538960218429565,2.5442593097686768,1.9367337226867676,2.269886016845703,2.9303009510040283,2.8519153594970703,2.058788537979126,2.8934290409088135,2.087965250015259,2.143892765045166,2.9725663661956787,2.0214931964874268,2.1675517559051514,2.793980121612549,2.123033285140991,2.0990593433380127],[2.1030538082122803,3.0689382553100586,1.8538960218429565,null,2.309659242630005,1.8991672992706299,2.114664077758789,2.7262940406799316,2.7584495544433594,2.095673084259033,2.781320571899414,2.098707675933838,2.14228892326355,2.852358102798462,1.9752540588378906,2.212848663330078,2.6353249549865723,2.0732014179229736,2.019761800765991],[2.190687894821167,2.8085265159606934,2.5442593097686768,2.309659242630005,null,2.393984794616699,2.2615222930908203,2.7482285499572754,2.895418882369995,2.5075132846832275,2.8762638568878174,2.434088706970215,2.5075063705444336,2.8548741340637207,2.3098390102386475,2.5905661582946777,2.733661651611328,2.4323620796203613,2.3105812072753906],[2.109285354614258,3.144939661026001,1.9367337226867676,1.8991672992706299,2.393984794616699,null,2.2156524658203125,2.823286771774292,2.8450536727905273,2.1414239406585693,2.826615333557129,2.1069796085357666,2.193436622619629,2.865583658218384,2.074578046798706,2.211888313293457,2.7117063999176025,2.1442344188690186,1.998839259147644],[2.0164406299591064,2.8890933990478516,2.269886016845703,2.114664077758789,2.2615222930908203,2.2156524658203125,null,2.6925294399261475,2.758521318435669,2.1288342475891113,2.6761715412139893,2.095597743988037,2.219156503677368,2.7892093658447266,2.012683629989624,2.2977588176727295,2.6710572242736816,2.2006943225860596,2.171987295150757],[2.6545960903167725,2.944986581802368,2.9303009510040283,2.7262940406799316,2.7482285499572754,2.823286771774292,2.6925294399261475,null,3.009636878967285,2.8115320205688477,3.0873639583587646,2.7955944538116455,2.906667709350586,3.0690903663635254,2.6603074073791504,2.9589836597442627,3.0465898513793945,2.820909261703491,2.712186336517334],[2.744584321975708,3.3822453022003174,2.8519153594970703,2.7584495544433594,2.895418882369995,2.8450536727905273,2.758521318435669,3.009636878967285,null,2.6132278442382812,3.205214023590088,2.822482109069824,2.8801722526550293,3.2778875827789307,2.7335057258605957,2.934494972229004,3.0921146869659424,2.8352386951446533,2.7257659435272217],[2.1226043701171875,3.2189292907714844,2.058788537979126,2.095673084259033,2.5075132846832275,2.1414239406585693,2.1288342475891113,2.8115320205688477,2.6132278442382812,null,2.8436360359191895,2.061490297317505,2.1682231426239014,2.8515000343322754,1.9128150939941406,2.1309690475463867,2.7585153579711914,2.046260118484497,2.0620739459991455],[2.714607000350952,3.242658853530884,2.8934290409088135,2.781320571899414,2.8762638568878174,2.826615333557129,2.6761715412139893,3.0873639583587646,3.205214023590088,2.8436360359191895,null,2.7873191833496094,2.9263241291046143,3.2203338146209717,2.7276740074157715,2.954568862915039,3.151263475418091,2.864332675933838,2.7866363525390625],[2.1073460578918457,3.1563985347747803,2.087965250015259,2.098707675933838,2.434088706970215,2.1069796085357666,2.095597743988037,2.7955944538116455,2.822482109069824,2.061490297317505,2.7873191833496094,null,2.1427114009857178,2.8682034015655518,1.95352041721344,2.1756680011749268,2.733215570449829,2.083543062210083,2.117109775543213],[2.2111992835998535,3.2870731353759766,2.143892765045166,2.14228892326355,2.5075063705444336,2.193436622619629,2.219156503677368,2.906667709350586,2.8801722526550293,2.1682231426239014,2.9263241291046143,2.1427114009857178,null,2.9162285327911377,1.9794176816940308,2.2217373847961426,2.769282579421997,2.164991617202759,2.1928999423980713],[2.7698893547058105,3.2143516540527344,2.9725663661956787,2.852358102798462,2.8548741340637207,2.865583658218384,2.7892093658447266,3.0690903663635254,3.2778875827789307,2.8515000343322754,3.2203338146209717,2.8682034015655518,2.9162285327911377,null,2.73994779586792,2.945770025253296,3.0586111545562744,2.858949661254883,2.8049142360687256],[1.8836708068847656,3.0143258571624756,2.0214931964874268,1.9752540588378906,2.3098390102386475,2.074578046798706,2.012683629989624,2.6603074073791504,2.7335057258605957,1.9128150939941406,2.7276740074157715,1.95352041721344,1.9794176816940308,2.73994779586792,null,2.069660186767578,2.5659282207489014,1.9801998138427734,1.969745397567749],[2.254176378250122,3.341740131378174,2.1675517559051514,2.212848663330078,2.5905661582946777,2.211888313293457,2.2977588176727295,2.9589836597442627,2.934494972229004,2.1309690475463867,2.954568862915039,2.1756680011749268,2.2217373847961426,2.945770025253296,2.069660186767578,null,2.8417129516601562,2.20721697807312,2.2206974029541016],[2.6292803287506104,2.881408929824829,2.793980121612549,2.6353249549865723,2.733661651611328,2.7117063999176025,2.6710572242736816,3.0465898513793945,3.0921146869659424,2.7585153579711914,3.151263475418091,2.733215570449829,2.769282579421997,3.0586111545562744,2.5659282207489014,2.8417129516601562,null,2.6910696029663086,2.615077495574951],[2.1319894790649414,3.117797613143921,2.123033285140991,2.0732014179229736,2.4323620796203613,2.1442344188690186,2.2006943225860596,2.820909261703491,2.8352386951446533,2.046260118484497,2.864332675933838,2.083543062210083,2.164991617202759,2.858949661254883,1.9801998138427734,2.20721697807312,2.6910696029663086,null,2.026125431060791],[2.0346643924713135,3.0504841804504395,2.0990593433380127,2.019761800765991,2.3105812072753906,1.998839259147644,2.171987295150757,2.712186336517334,2.7257659435272217,2.0620739459991455,2.7866363525390625,2.117109775543213,2.1928999423980713,2.8049142360687256,1.969745397567749,2.2206974029541016,2.615077495574951,2.026125431060791,null]],"type":"heatmap","xaxis":"x","yaxis":"y","hovertemplate":"x: %{x}\u003cbr\u003ey: %{y}\u003cbr\u003eEuclidean Distance: %{z}\u003cextra\u003e\u003c\u002fextra\u003e"}],                        {"template":{"data":{"histogram2dcontour":[{"type":"histogram2dcontour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"choropleth":[{"type":"choropleth","colorbar":{"outlinewidth":0,"ticks":""}}],"histogram2d":[{"type":"histogram2d","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmap":[{"type":"heatmap","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"contourcarpet":[{"type":"contourcarpet","colorbar":{"outlinewidth":0,"ticks":""}}],"contour":[{"type":"contour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"surface":[{"type":"surface","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"mesh3d":[{"type":"mesh3d","colorbar":{"outlinewidth":0,"ticks":""}}],"scatter":[{"marker":{"line":{"color":"#283442"}},"type":"scatter"}],"parcoords":[{"type":"parcoords","line":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolargl":[{"type":"scatterpolargl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"bar":[{"error_x":{"color":"#f2f5fa"},"error_y":{"color":"#f2f5fa"},"marker":{"line":{"color":"rgb(17,17,17)","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"bar"}],"scattergeo":[{"type":"scattergeo","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolar":[{"type":"scatterpolar","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"histogram":[{"marker":{"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"histogram"}],"scattergl":[{"marker":{"line":{"color":"#283442"}},"type":"scattergl"}],"scatter3d":[{"type":"scatter3d","line":{"colorbar":{"outlinewidth":0,"ticks":""}},"marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattermap":[{"type":"scattermap","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattermapbox":[{"type":"scattermapbox","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterternary":[{"type":"scatterternary","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattercarpet":[{"type":"scattercarpet","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"carpet":[{"aaxis":{"endlinecolor":"#A2B1C6","gridcolor":"#506784","linecolor":"#506784","minorgridcolor":"#506784","startlinecolor":"#A2B1C6"},"baxis":{"endlinecolor":"#A2B1C6","gridcolor":"#506784","linecolor":"#506784","minorgridcolor":"#506784","startlinecolor":"#A2B1C6"},"type":"carpet"}],"table":[{"cells":{"fill":{"color":"#506784"},"line":{"color":"rgb(17,17,17)"}},"header":{"fill":{"color":"#2a3f5f"},"line":{"color":"rgb(17,17,17)"}},"type":"table"}],"barpolar":[{"marker":{"line":{"color":"rgb(17,17,17)","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"barpolar"}],"pie":[{"automargin":true,"type":"pie"}]},"layout":{"autotypenumbers":"strict","colorway":["#636efa","#EF553B","#00cc96","#ab63fa","#FFA15A","#19d3f3","#FF6692","#B6E880","#FF97FF","#FECB52"],"font":{"color":"#f2f5fa"},"hovermode":"closest","hoverlabel":{"align":"left"},"paper_bgcolor":"rgb(17,17,17)","plot_bgcolor":"rgb(17,17,17)","polar":{"bgcolor":"rgb(17,17,17)","angularaxis":{"gridcolor":"#506784","linecolor":"#506784","ticks":""},"radialaxis":{"gridcolor":"#506784","linecolor":"#506784","ticks":""}},"ternary":{"bgcolor":"rgb(17,17,17)","aaxis":{"gridcolor":"#506784","linecolor":"#506784","ticks":""},"baxis":{"gridcolor":"#506784","linecolor":"#506784","ticks":""},"caxis":{"gridcolor":"#506784","linecolor":"#506784","ticks":""}},"coloraxis":{"colorbar":{"outlinewidth":0,"ticks":""}},"colorscale":{"sequential":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"sequentialminus":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"diverging":[[0,"#8e0152"],[0.1,"#c51b7d"],[0.2,"#de77ae"],[0.3,"#f1b6da"],[0.4,"#fde0ef"],[0.5,"#f7f7f7"],[0.6,"#e6f5d0"],[0.7,"#b8e186"],[0.8,"#7fbc41"],[0.9,"#4d9221"],[1,"#276419"]]},"xaxis":{"gridcolor":"#283442","linecolor":"#506784","ticks":"","title":{"standoff":15},"zerolinecolor":"#283442","automargin":true,"zerolinewidth":2},"yaxis":{"gridcolor":"#283442","linecolor":"#506784","ticks":"","title":{"standoff":15},"zerolinecolor":"#283442","automargin":true,"zerolinewidth":2},"scene":{"xaxis":{"backgroundcolor":"rgb(17,17,17)","gridcolor":"#506784","linecolor":"#506784","showbackground":true,"ticks":"","zerolinecolor":"#C8D4E3","gridwidth":2},"yaxis":{"backgroundcolor":"rgb(17,17,17)","gridcolor":"#506784","linecolor":"#506784","showbackground":true,"ticks":"","zerolinecolor":"#C8D4E3","gridwidth":2},"zaxis":{"backgroundcolor":"rgb(17,17,17)","gridcolor":"#506784","linecolor":"#506784","showbackground":true,"ticks":"","zerolinecolor":"#C8D4E3","gridwidth":2}},"shapedefaults":{"line":{"color":"#f2f5fa"}},"annotationdefaults":{"arrowcolor":"#f2f5fa","arrowhead":0,"arrowwidth":1},"geo":{"bgcolor":"rgb(17,17,17)","landcolor":"rgb(17,17,17)","subunitcolor":"#506784","showland":true,"showlakes":true,"lakecolor":"rgb(17,17,17)"},"title":{"x":0.05},"updatemenudefaults":{"bgcolor":"#506784","borderwidth":0},"sliderdefaults":{"bgcolor":"#C8D4E3","borderwidth":1,"bordercolor":"rgb(17,17,17)","tickwidth":0},"mapbox":{"style":"dark"}}},"xaxis":{"anchor":"y","domain":[0.0,1.0]},"yaxis":{"anchor":"x","domain":[0.0,1.0],"autorange":"reversed"},"coloraxis":{"colorbar":{"title":{"text":"Euclidean Distance"}},"colorscale":[[0.0,"rgb(103,0,31)"],[0.1,"rgb(178,24,43)"],[0.2,"rgb(214,96,77)"],[0.3,"rgb(244,165,130)"],[0.4,"rgb(253,219,199)"],[0.5,"rgb(247,247,247)"],[0.6,"rgb(209,229,240)"],[0.7,"rgb(146,197,222)"],[0.8,"rgb(67,147,195)"],[0.9,"rgb(33,102,172)"],[1.0,"rgb(5,48,97)"]]},"title":{"text":"Euclidean Distance between Emotions"}},                        {"responsive": true}                    )                };
                </script>
            </div>

            <div class="research-card">
                <h3>Nearest Neighbors of the Centroids</h3>
                <p>We found the residual stream centroid and its neighbors for each transformer layer and Major Depression
                    Disorder diagnostic scale.
                    Interestingly, subject-specific nouns are the dominant nearest neighbors in the last two layers
                    under both cosine and Euclidean distance metrics. This suggests that the last two transformer layers
                    in google/gemma-2-2b are identifying the main entities or actors in the context.</p><br>
                <img src="neighbors.png" style="width:80%;"></div>

            <a href="/MechanisticInterpretabilityShowcase/26.normalized_semantic_cloud.html" class="card-link"
               target="_blank">
                <div class="research-card">
                    <h3>Residual Stream Visualizer</h3>
                    <p>We performed 2D and 3D Principal Component Analysis on the residual streams token by token and
                        inspected how the residual stream changes shape through each layer.
                        (Note: This interactive visualization is large and contains animation. Click to interact in a new tab.)</p><br>
                    <img src="cloud_2d.png" style="height:100%; width:47%;">
                    <img src="cloud_3d.png" style="height:100%; width:47%;">
                </div>
            </a>

            <div class="research-card">
                <a href="/MechanisticInterpretabilityShowcase/35.energy_distances_symptom_nl.html" class="card-link"
                   target="_blank">
                    <h3>Energy Distances</h3>
                    <p>Quantitative analysis using Energy Distance revealed statistically significant clustering of
                        descriptions within the same symptom categories (p < 0.05 for all comparisons), where
                        within-category distances were 50% smaller than between-category distances in specific layers.
                        This clustering was especially prominent in layers 19-24 of the 26-layer model. These findings
                        suggest that measuring statistical distances of residual streams in high-dimensional embedding
                        space could enable automated detection and severity assessment of depression symptoms from
                        naturalistic language samples. (Note: Click to inspect detailed findings in a new tab.)</p><br>
                    <img src="energy_1.png" style="height:100%; width:47%;">
                    <img src="energy_2.png" style="height:100%; width:47%;">
                </a>

                <details>
                    <summary>Click to expand text comparisons between the closest and furthest pairs.</summary>

                    <h4>Overall Furthest Text: Δ(Somatic Symptoms, Suicidality Symptoms) | PHQ-9</h4>
                    <p>PHQ-9 Somatic Symptoms:<br>
                        Sleep disturbances: Difficulty falling asleep at night, waking up frequently and struggling to
                        get back to sleep, or conversely, sleeping excessively beyond what feels normal or necessary.
                        Fatigue and low energy: Persistent tiredness throughout the day, feeling physically drained or
                        depleted, lacking the energy to complete routine tasks or activities.
                        Appetite changes: A noticeable decrease in appetite or loss of interest in food, or
                        alternatively, eating more than usual, often without feeling genuinely hungry.
                        Psychomotor changes: Physical movements and speech that have become noticeably slowed down—to
                        the point where others might observe it—or the opposite pattern: heightened restlessness,
                        fidgeting, an inability to sit still, or moving around considerably more than typical.</p><br>
                    <p>PHQ-9 Suicidality Symptoms:<br>
                        Experiencing thoughts about death, wishing you were dead, or having thoughts about harming
                        yourself.
                    </p>
                    <h4>Overall Closest Text: Δ(HAM-D, PROCEED) | Somatic Symptoms</h4>
                    <p>HAM-D Somatic Symptoms:<br>
                        Sleep Difficulties
                        Some people experience trouble falling asleep at the beginning of the night, ranging from
                        occasional difficulty to a persistent problem. Others find their sleep is disrupted in the
                        middle of the night—they feel restless, wake repeatedly, and have difficulty settling back down.
                        A third pattern involves waking very early in the morning, well before intended, and being
                        unable to return to sleep despite wanting to.
                        Changes in Movement and Energy
                        A person may notice a general slowing down—their thoughts seem to move sluggishly, their speech
                        becomes slower or more effortful, and even simple activities feel labored. This can range from
                        subtle hesitation to profound immobility where engaging in conversation or daily tasks becomes
                        extremely difficult.
                        Alternatively, some people experience the opposite: a restless, agitated state where they cannot
                        sit still and feel compelled to move, often accompanied by underlying anxiety.
                        Physical Symptoms of Anxiety
                        Anxiety can manifest throughout the body. This includes digestive upset or indigestion, a racing
                        or pounding heart, tension headaches, shortness of breath, or urinary frequency. These physical
                        signs can range from mildly noticeable to so severe they interfere with daily functioning.
                        Digestive and Appetite Changes
                        Appetite may diminish noticeably, sometimes accompanied by a heavy or uncomfortable sensation in
                        the abdomen and constipation. These symptoms can be mild or significantly affect eating and
                        digestion.
                        General Physical Symptoms
                        The body may feel heavy—particularly the limbs, back, or head. There may be diffuse aching,
                        especially in the back, along with a pervasive loss of energy and a tendency to tire easily from
                        minimal effort.
                        Changes in Sexual Function
                        Interest in sex may decrease or disappear. For those who menstruate, cycle irregularities may
                        occur.
                        Preoccupation with Health
                        Some individuals become increasingly focused on their bodies, ranging from heightened
                        self-awareness of physical sensations to persistent worry about illness, to an irritable
                        insistence that something is medically wrong, and in severe cases, fixed beliefs about having a
                        serious disease despite reassurance.
                        Weight Changes
                        Unintentional weight loss may occur, from barely perceptible to clearly visible and
                        significant.</p><br>
                    <p>PROCEED Somatic Symptoms:<br>
                        Physical discomfort and bodily changes
                        People may experience unexplained aches, pains, or other physical complaints. Changes in
                        appetite are common, leading to noticeable weight gain or loss. Interest in sexual activity
                        often diminishes or disappears entirely.
                        Sleep disturbances
                        Sleep patterns become disrupted in various ways. Some people sleep far more than usual,
                        struggling to get out of bed or napping excessively during the day. Others find their sleep
                        fragmented and unrefreshing, waking frequently throughout the night. Many experience difficulty
                        falling asleep or staying asleep, lying awake for hours.
                        Observable behavioral changes
                        Emotional expression may shift noticeably. Crying spells can occur frequently, sometimes without
                        clear triggers. In more severe cases, people may speak very little or stop talking altogether.
                        Facial expressions often appear flat, sad, or emotionally muted. Movements and speech may slow
                        down considerably, with people appearing to move through molasses.
                        Diminished vitality
                        Even simple daily tasks feel like they require enormous effort. A pervasive sense of physical
                        weakness sets in. Energy levels drop substantially, making it hard to initiate or complete
                        activities. Persistent fatigue lingers regardless of how much rest someone gets.
                    </p>
                </details>
            </div>
        </div>
    </section>

    <section id="about" class="about-section">
        <div class="container">
            <p class="about-text">
                Created by Fangyi Zhu and Ajay Subramanian at Stanford Precision Neurotherapeutics Lab
            </p>
        </div>
    </section>
</main>

</body>
</html>