This repository was archived by the owner on Apr 17, 2026. It is now read-only.
This repository was archived by the owner on Apr 17, 2026. It is now read-only.
Is the default layer to be edited in GPT-J chosen based on Causal Tracing results? #5
In page 4, your paper mentioned that "The default layer in GPT-J is layer 6, following from averaged Causal Tracing results". It seemed that the Causal Tracing results support to choose layer 6 to be edited. But according to Fig1 in your paper,
based on Causal Tracing effects, we seldom choose layer 6.
Dose that make sense?