Code to Comment "Translation": Data, Metrics, Baselining & Evaluation

no code implementations • 3 Oct 2020 • David Gros, Hariharan Sezhiyan, Prem Devanbu, Zhou Yu

We carefully examine the underlying assumption here: that the task of generating comments sufficiently resembles the task of translating between natural languages, and so similar models and evaluation metrics could be used.

Information Retrieval Retrieval +1

Deep Learning & Software Engineering: State of Research and Future Directions

1 code implementation • 17 Sep 2020 • Prem Devanbu, Matthew Dwyer, Sebastian Elbaum, Michael Lowry, Kevin Moran, Denys Poshyvanyk, Baishakhi Ray, Rishabh Singh, Xiangyu Zhang

The intent of this report is to serve as a potential roadmap to guide future work that sits at the intersection of SE & DL.

Do People Prefer "Natural" code?

no code implementations • 8 Oct 2019 • Casey Casalnuovo, Kevin Lee, Hulin Wang, Prem Devanbu, Emily Morgan

Natural code is known to be very repetitive (much more so than natural language corpora); furthermore, this repetitiveness persists, even after accounting for the simpler syntax of code.

Language Modelling

Studying the Difference Between Natural and Programming Language Corpora

no code implementations • 6 Jun 2018 • Casey Casalnuovo, Kenji Sagae, Prem Devanbu

Code corpora, as observed in large software systems, are now known to be far more repetitive and predictable than natural language corpora.