1 code implementation • 28 Nov 2021 • Bill Tuck Weng Pung, Alvin Chan
The ability to reason with multiple hierarchical structures is an attractive and desirable property of sequential inductive biases for natural language processing.
1 code implementation • 28 Nov 2021 • Bill Tuck Weng Pung, Alvin Chan
Moreover, we show that the FASTTREES module can be applied to enhance Transformer models, achieving performance gains on three sequence transduction tasks (machine translation, subject-verb agreement and mathematical language understanding), paving the way for modular tree induction modules.