Ming Zhong commited on
Commit
726d535
1 Parent(s): 04c94d9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ [DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization](https://arxiv.org/abs/2109.02492).
2
+
3
+ ## Introduction
4
+ DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a base version of DialogLED, the input length is limited to 16,384 in the pre-training phase.
5
+
6
+ ## Finetuning for Downstream Tasks
7
+ Please refer to [our GitHub page](https://github.com/microsoft/DialogLM).