Exploration in NLP
Advanced techniques for data-efficient and adaptive NLP.
Chapter 24: Active Learning Efficient data selection, uncertainty sampling Applications: Low-resource NLP [Query-by-committee, entropy-based sampling, annotation cost reduction] References Chapter 25: Data Augmentation Paraphrasing, synonym replacement Back-translation, synthetic text [Text infilling, EDA (Easy Data Augmentation), mixup] References Chapter 26: Continual Learning Avoiding catastrophic forgetting Applications: Evolving NLP models [Elastic weight consolidation, rehearsal, knowledge distillation] References