BertViz

Tool for visualizing BERT's attention layers

Jupyter Notebooks

bertviz_detail: new attention details view

bertviz_summary: original summary view

Authors

• Jesse Vig

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details

Acknowledgments

This project incorporates code from the following repos:

• https://github.com/tensorflow/tensor2tensor
• https://github.com/huggingface/pytorch-pretrained-BERT