rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Language: Jupyter Notebook
106,805GitHub stars
16,449public forks
Observed star growth
+49 stars24h growth
Observed OpenPulse samples
Observed OpenPulse samples
Building history7d growth
Not enough current observations
Not enough current observations
Building history30d growth
Not enough current observations
Not enough current observations
Latest OpenPulse observation:
GitHub topics
- ai
- artificial-intelligence
- attention-mechanism
- deep-learning
- finetuning
- from-scratch
- generative-ai
- gpt
- instruction-tuning
- language-model
- large-language-models
- llm
- machine-learning
- natural-language-processing
- pretraining
- python
- pytorch
- tokenizer
- transformers