Issues

• 📋 Documentation Enhancement Suggestion

  codertimo/BERT-pytorch#111 · Filter by author croviatrust opened on May 12, 2026

• A bug in dataset.py

  codertimo/BERT-pytorch#110 · Filter by author sweetchild222 opened on Sep 12, 2025

• Clarification on Padding Process in BERT Model Construction

  codertimo/BERT-pytorch#107 · Filter by author AliHaiderAhmad001 opened on Nov 24, 2023

• Why Segment Embedding number only 3?

  codertimo/BERT-pytorch#106 · Filter by author UTimeStrange opened on Nov 21, 2023
  1

• 请问训练得到的模型后缀为.model.ep*格式，应该如何进行后续的调用呢？

  codertimo/BERT-pytorch#103 · Filter by author Jwinre opened on May 23, 2023

• GELU is available in PyTorch

  codertimo/BERT-pytorch#102 · Filter by author hubin-keio opened on Mar 15, 2023
  1

• how to fine tune model with trained weight

  codertimo/BERT-pytorch#100 · Filter by author LMC63 opened on Jan 10, 2023

• What dataset did you use to train model?

  codertimo/BERT-pytorch#99 · Filter by author suhyeong10 opened on Oct 19, 2022
  2

• why specify ignore_index=0 in the NLLLoss function in BERTTrainer?

  codertimo/BERT-pytorch#98 · Filter by author Jasmine969 opened on Jul 7, 2022
  1

• bert-vocab?

  codertimo/BERT-pytorch#96 · Filter by author nlpCSir opened on Apr 22, 2022
  1

• Pooler layer?

  codertimo/BERT-pytorch#95 · Filter by author lihaoxin2020 opened on Jan 17, 2022

• It keeps trying to use CUDA despite --with_cuda False option

  codertimo/BERT-pytorch#94 · Filter by author hanyangii opened on Nov 5, 2021

• dataset / dataset.py have one erro?

  codertimo/BERT-pytorch#93 · Filter by author ndn-love opened on Aug 22, 2021
  1

• Why not use torch.no_grad when evaluating test data?

  codertimo/BERT-pytorch#92 · Filter by author EvanZ opened on Jul 3, 2021
  1

• why language_model.py has different vectors

  codertimo/BERT-pytorch#91 · Filter by author zysNLP opened on Jun 27, 2021
  1

• The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.

  codertimo/BERT-pytorch#89 · Filter by author guotong1988 opened on Mar 23, 2021

• IndexError

  codertimo/BERT-pytorch#88 · Filter by author LemonQC opened on Mar 5, 2021
  6

• An error occurred【AttributeError: type object 'BERT' has no attribute 'hidden'】

  codertimo/BERT-pytorch#87 · Filter by author XueqiangF opened on Dec 8, 2020

• In Next Sentence Prediction task,the original code may choose the same line when you try to use the negative sample

  codertimo/BERT-pytorch#86 · Filter by author Emir-Liu opened on Dec 7, 2020

• transformer.py 中的forword方法调用的SublayerConnection类。实现残差链接和标准化的实现

  codertimo/BERT-pytorch#83 · Filter by author dshwei opened on Sep 23, 2020
  2

• how to do Ner

  codertimo/BERT-pytorch#82 · Filter by author jerry-rs opened on Sep 18, 2020

• Default model sizes are much smaller than BERT base

  codertimo/BERT-pytorch#81 · Filter by author bertmaher opened on Aug 28, 2020

• How to implement model once pretrained for masked input sentences?

  codertimo/BERT-pytorch#80 · Filter by author sfaux opened on Aug 21, 2020

• How to use this bert model to load and finetune ?

  codertimo/BERT-pytorch#79 · Filter by author dongrixinyu opened on Jul 16, 2020

• embedding/position.py with RuntimeError if d_model is odd

  codertimo/BERT-pytorch#78 · Filter by author bookong22 opened on Jun 15, 2020
  2