The Grand AI Handbook

Traditional NLP Techniques

Foundational methods that shaped early NLP systems.

Chapter 5: Rule-Based Systems Hand-crafted rules, regular expressions Early POS tagging, syntactic parsing [Chomsky hierarchy, finite-state transducers, pattern matching] References Chapter 6: Statistical Language Models N-grams, smoothing techniques Hidden Markov Models (HMMs) [Laplace smoothing, Kneser-Ney smoothing, Viterbi algorithm] References Chapter 7: Text Preprocessing Tokenization, stemming, lemmatization Stop-word removal, TF-IDF [Normalization, word segmentation, document-term matrices] References