[{"_1":2,"_48":-5,"_49":-5},"loaderData",{"_3":4,"_10":11,"_46":-5,"_47":-5},"root",{"_5":-5,"_6":-5,"_7":-5,"_8":9},"user","shoppingCartId","toast","locale","en","routes/_store+/_readers+/email_author.$slug/route",{"_12":13,"_45":-5},"book",{"_14":15,"_16":17,"_18":19,"_20":21,"_22":23,"_24":25},"id","Z2lkOi8vbGVhbnB1Yi9TdG9yZTo6Qm9va1Byb2R1Y3QvNjA3MzE","title","Super Study Guide: Transformers & Large Language Models","state","published","contactAuthorMethod","email","aboutText","

This book is a concise and illustrated guide for anyone who wants to understand the inner workings of large language models in the context of interviews, projects or to satisfy their own curiosity.

It is divided into 5 parts:

Foundations: primer on neural networks and important deep learning concepts for training and evaluation
Embeddings: tokenization algorithms, word-embeddings (word2vec) and sentence embeddings (RNN, LSTM, GRU)
Transformers: motivation behind its self-attention mechanism, detailed overview on the encoder-decoder architecture and related variations such as BERT, GPT and T5, along with tips and tricks on how to speed up computations
Large language models: main techniques to tune Transformer-based models, such as prompt engineering, (parameter efficient) finetuning and preference tuning
Applications: most common problems including sentiment extraction, machine translation, retrieval-augmented generation and many more

This page allows for a self-serve 15% discount (1) aimed at folks who have already purchased the paper version and (2) to account for purchasing power parity across regions. Thank you so much for your interest and support!

","authors",[26,39],{"_14":27,"_28":29,"_5":30},"Z2lkOi8vbGVhbnB1Yi9TdG9yZTo6UHJvZHVjdEF1dGhvci82NDI2Ng","name","Afshine Amidi",{"_31":32},"avatar",{"_33":34,"_35":36,"_37":38},"url","https://d308did4coypzi.cloudfront.net/avatars/3329850/medium/afshine-amidi-large.jpg?1724394085","styleName","medium","exists",true,{"_14":40,"_28":41,"_5":42},"Z2lkOi8vbGVhbnB1Yi9TdG9yZTo6UHJvZHVjdEF1dGhvci82NDI2Nw","Shervine Amidi",{"_31":43},{"_33":44,"_35":36,"_37":38},"https://d308did4coypzi.cloudfront.net/avatars/3349811/medium/shervine-amidi.png?1725729713","currentUser","routes/_store+/_layout","routes/_store+/_readers+/_layout","actionData","errors"]

Email the authors