Skip to content

Create a small example of how transformers and LLMs work #8

@dsblank

Description

@dsblank

Possible datasets:

  1. Only using two words: 0 and 1
  2. Using TinyStories: https://arxiv.org/abs/2305.07759
    a. Dataset: https://huggingface.co/datasets/roneneldan/TinyStories

Possible models:

  1. Not sure

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions