Skip to content

Draft: inline gelu#16

Draft
certik wants to merge 6 commits into
mainfrom
gelu2
Draft

Draft: inline gelu#16
certik wants to merge 6 commits into
mainfrom
gelu2

Conversation

@certik

@certik certik commented Mar 8, 2023

Copy link
Copy Markdown
Owner

This gets to 0.594s, but it's not as readable as before, so I am going to keep it as a Draft for now, since the ideas are good, but ultimately this should be done by the compiler.

certik added 6 commits March 7, 2023 15:47
This provides about 4% speedup from 0.789 to 0.758s.
This provides about 20% speedup from 0.752s to 0.602s.
This gets from about 0.605s to 0.594s.
@certik

certik commented Mar 17, 2023

Copy link
Copy Markdown
Owner Author

I don't see any speed difference with caching enabled (both main and this PR at 0.288s). With caching disabled, this PR is 0.525s, main is 0.716s.

@certik certik marked this pull request as draft March 17, 2023 15:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants