GitHub - hadywalied/DistillPegasus: Knowledge Distillation with TAs for seq2seq text summarization model PEGASUS

Repository navigation

DistillPegasus

Public

Knowledge Distillation with TAs for seq2seq text summarization model PEGASUS

3 stars

2 watching

Name		Name	Last commit message	Last commit date
.vscode		.vscode
__pycache__		__pycache__
wandb		wandb
StudentPegasus_test.ipynb		StudentPegasus_test.ipynb
__init__.py		__init__.py
data_loader.py		data_loader.py
loss_functions.py		loss_functions.py
pegasus_students.py		pegasus_students.py
requirements.txt		requirements.txt
train.py		train.py
utils.py		utils.py
xsum_pegasus_student_training.ipynb		xsum_pegasus_student_training.ipynb

Knowledge Distillation with TAs for seq2seq text summarization model PEGASUS

3 stars

2 watching