huggingface transformers 源码阅读 - Bert

目录

https://github.com/huggingface/transformers

graph TD;
  ModuleUtilsMixin --> PreTrainedModel
  nn.Module --> PreTrainedModel
  PreTrainedModel --> BertPreTrainedModel
  PreTrainedModel --> BertModel
  PreTrainedModel --> BertForMaskedLM
  PreTrainedModel --> BertForTokenClassification

ModuleUtilsMixin 类提供了一个计算 Module 中参数数量的 method。