NLP的roadmap

插件GitHub Copilot 一份NLP快速入门的roadmap,也分享给你,如果感兴趣可以学习学习

  1. https://www.deeplearningbook.org/contents/applications.html NLP基础(只看12.4,其中四级标题(如12.4.3.1等)下的细节内容可略过)
  2. https://huggingface.co/docs/transformers/preprocessing 数据预处理(主要看Natural Language Processing部分)
  3. https://huggingface.co/docs/transformers/training 训练(主要看Train in native PyTorch和Train with PyTorch Trainer部分)
  4. https://zhuanlan.zhihu.com/p/338817680 复习Transformers
  5. https://arxiv.org/pdf/1910.10683.pdf
  1. https://huggingface.co/docs/transformers/tasks/summarization 应用Encoder-decoder预训练语言模型进行文本摘要生成
  2. https://arxiv.org/pdf/1810.04805.pdf +https://arxiv.org/pdf/1907.11692.pdf
  1. https://huggingface.co/docs/transformers/tasks/sequence_classification
  1. https://cdn.openai.com/better-language-models [========] language_models_are_unsupervised_multitask_learners.pdf
  1. https://arxiv.org/pdf/2103.10360.pdf
end