Skip to content

add mistral7b model#392

Merged
mike-ferguson merged 2 commits intomainfrom
add_mistral_7b
Mar 16, 2026
Merged

add mistral7b model#392
mike-ferguson merged 2 commits intomainfrom
add_mistral_7b

Conversation

@mike-ferguson
Copy link
Copy Markdown
Member

Summary

  • Adds a new Brain-Score language model plugin for Mistral 7B (mistralai/Mistral-7B-v0.1), a 7.3B parameter causal language model with 32 transformer layers and hidden size 4096.
  • Registers the model via HuggingfaceSubject with the last transformer layer (model.layers.31) mapped to the language system.
  • Includes tests for model loading, neural representation shape (4096 neuroid dimensions), and next-word prediction.

Test plan

  • pytest brainscore_language/models/mistral7b/test.py -m memory_intense passes all three tests
  • Model loads successfully with a valid HuggingFace token
  • Neural recording returns representations with 4096 neuroid dimensions
  • Next-word prediction returns non-empty strings for all inputs

@mike-ferguson mike-ferguson added the submission_prepared Attached to a PR is metadata and layer mapping is successful. label Mar 16, 2026
@mike-ferguson mike-ferguson merged commit 59d2d22 into main Mar 16, 2026
10 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

submission_prepared Attached to a PR is metadata and layer mapping is successful.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant