Resources

./resources

Resources

A curated library of influential papers, frameworks, and technical documents from the community to study and build with AI.

Reading and reference tools

Selected for their technical value, with credit to their authors and access to the original source.

6 resources

Papers2017

Attention Is All You Need

Ashish Vaswani and 7 more authors

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin

The paper introducing the Transformer. A foundational read for understanding self-attention and the architecture behind modern language models.

  • Transformers
  • Attention
  • NLP
Papers2020

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Patrick Lewis and 11 more authors

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela

Combines text generation with document retrieval. A starting point for studying systems that consult external knowledge when answering questions.

  • RAG
  • Retrieval
  • NLP
Frameworks

PyTorch

PyTorch contributors

A tensor and automatic differentiation framework for implementing, training, and evaluating neural networks. Direct access to its documentation and source code.

  • Python
  • Deep learning
  • Autograd
Frameworks

Hugging Face Transformers

Hugging Face, Transformers contributors

A library for using and fine-tuning pretrained text, vision, and audio models. A practical reference for tokenization, inference, and training.

  • Transformers
  • Python
  • Pretrained models
Technical documents

Dive into Deep Learning

Aston Zhang and 3 more authors

Aston Zhang, Zachary C. Lipton, Mu Li, Alexander J. Smola

A technical book connecting deep learning mathematics, implementations, and experiments. Includes executable examples and a PDF edition from the authors' website.

  • Deep learning
  • Mathematics
  • Notebooks