Skip to content

Commit 8bb5676

Browse files
authored
link to official repository
1 parent 7af40d2 commit 8bb5676

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@
44

55
Explorations into <a href="https://arxiv.org/html/2405.20233v2">"Grokfast, Accelerated Grokking by Amplifying Slow Gradients"</a>, out of Seoul National University in Korea. In particular, will compare it with NAdam on modular addition as well as a few other tasks, since I am curious why those experiments are left out of the paper. If it holds up, will polish it up into a nice package for quick use.
66

7+
The official repository can be found <a href="https://github.com/ironjr/grokfast">here</a>
8+
79
## Install
810

911
```bash

0 commit comments

Comments
 (0)