CAT-LM: Training Language Models on Aligned Code And Tests

2 code implementations • 2 Oct 2023 • Nikitha Rao, Kush Jain, Uri Alon, Claire Le Goues, Vincent J. Hellendoorn

We also drastically increase the maximum sequence length of inputs to 8, 192 tokens, 4x more than typical code generation models, to ensure that the code context is available to the model when generating test code.

Code Generation Language Modelling