Publications / Domestic Conferences & Theses
EDT5: Proposed Embedding Model of T5 Encoder-Decoder Structure
Abstract
Analyzed the structure of T5 and proposed a model architecture that uses both the encoder and decoder for embedding, moving beyond the previous approach that only utilized the encoder for embedding and fine-tuning.
Key Contribution
Proposed encoder-decoder embedding architecture for T5, improving upon encoder-only approaches.