Harsimar SinghHow HuggingFace tokenizer gets executed through maze of code?I was very much intrigued about hugging face’s core concept of loading models and running it. It does everything under the hood and you…Sep 12Sep 12
Harsimar SinghInformation Retrieval : Chapter 2In this we will talk about vocabulary and postings list. In previous post of chapter 1, I wrote notes about very fundamental process of…Aug 29Aug 29
Harsimar SinghInformation Retrieval : Chapter 1I didn’t think of this, but this started as a series of short notes on information retrieval by Prof. Christopher D. Manning, Prabhakar…Aug 26Aug 26
Harsimar SinghMixture of Models vs Dense Transformers?Recently meta has released their “Herd of LLama Models” and highlight of which is 405B parameter model contributing significantly to the…Aug 20Aug 20
Harsimar SinghContinuous PreTraining or FineTuning? Let’s resolve this —In the coliseum of machine learning, two gladiators face off in an epic battle: Continuous Pre-Training and Fine-Tuning. The crowd roars as…Aug 15Aug 15
Harsimar SinghEquation for AutoRegressive Models : As explained by Claude sprinkled with info by meThis equation is from the paper : Fine-Tuning Language Models from Human Preferences (https://arxiv.org/pdf/1909.08593)Jul 30Jul 30
Harsimar SinghULMFiT Paper Notes: Paper that laid foundation of fine tuningUniversal Language Model Fine-tuning for Text Classification — Excellent paper by Jeremy Howard and Sebastian RuderJul 30Jul 30
Harsimar SinghMacbook can be a great book — Not just for StarbucksCompiling brief steps on maximising your reading potential and retrieving the crux on demand when you tend to revisit what you read. Below…Oct 7, 2022Oct 7, 2022
Harsimar SinghExcerpts from Naval’s Podcasts -Recently I stumbled upon Naval Ravikant’s podcast with Joe Rogan which gave me some insights into what life processes can be. He has tried…Oct 2, 2022Oct 2, 2022
Harsimar SinghContext Switching in Processors — Is there a thing called parallelism?Imagine a scenario where you have time travelled and this is the era of 1903. Ford is coming up with its production line to launch the…Sep 24, 2022Sep 24, 2022
