Skip to content

Commit e2d4cc4

Browse files
committed
Added model figure + bibtex
1 parent 20d68eb commit e2d4cc4

File tree

2 files changed

+23
-15
lines changed

2 files changed

+23
-15
lines changed

README.md

+23-15
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,21 @@
11
# PyTorch BERT Document Classification
2-
Enriching BERT with Knowledge Graph Embedding for Document Classification (PyTorch)
32

4-
Content:
5-
- CLI script
6-
- author embeddings
7-
- projector files
8-
- create file
9-
- data preparation
10-
- requirements
11-
- trained model weights as release zips
3+
Enriching BERT with Knowledge Graph Embedding for Document Classification.
4+
A submission to the [GermEval 2019 shared task](https://www.inf.uni-hamburg.de/en/inst/ab/lt/resources/data/germeval-2019-hmc.html) on hierarchical text classification.
5+
If you encounter any problems, feel free to contact us or submit a GitHub issue.
6+
7+
## Content
8+
9+
- CLI script to run all experiments
10+
- WikiData author embeddings ([view on Tensorboard Projector](http://projector.tensorflow.org/?config=https://github.com/malteos/pytorch-bert-document-classification/raw/master/extras/projector_config.json))
11+
- Data preparation
12+
- Requirements
13+
- Trained model weights as [release files](https://github.com/malteos/pytorch-bert-document-classification/releases)
14+
15+
## Model architecture
16+
17+
![BERT + Knowledge Graph Embeddings](https://github.com/malteos/pytorch-bert-document-classification/raw/master/images/architecture.png)
18+
1219

1320
## Installation
1421

@@ -104,17 +111,18 @@ The scores from the result table can be reproduced with the `evaluation.ipynb` n
104111

105112
If you are using our code, please cite our paper:
106113
```
107-
@article{,
108-
title={},
109-
author={},
110-
journal={arXiv preprint arXiv:},
111-
year={2019}
114+
@inproceedings{Ostendorff2019,
115+
address = {Erlangen, Germany},
116+
author = {Ostendorff, Malte and Bourgonje, Peter and Berger, Maria and Moreno-Schneider, Julian and Rehm, Georg},
117+
booktitle = {Proceedings of the GermEval 2019 Workshop},
118+
title = {{GermEval 2019 Task 1 : Hierarchical Classification of Blurbs}},
119+
year = {2019}
112120
}
113-
114121
```
115122

116123
## References
117124

125+
- [GermEval 2019 Task 1 on Codalab](https://competitions.codalab.org/competitions/20139)
118126
- [Google BERT Tensorflow](https://github.com/google-research/bert)
119127
- [Huggingface PyTorch Transformer](https://github.com/huggingface/pytorch-transformers)
120128
- [Deepset AI - BERT-german](https://deepset.ai/german-bert)

images/architecture.png

35.7 KB
Loading

0 commit comments

Comments
 (0)