We hope that our work can facilitate the research work of researchers in llms for nl2code Machine learning, data mining, nlp, software analytics contributions Title={large language models meet nl2code
Since 1975, icse provides a forum where researchers, practitioners, and educators gather together to present and discuss the most recent innovations, trends, experiences and issues in the field of software engineering. We provide an intuitive comparison of all existing models on the humaneval benchmark. For some weeks now, the dblp team has been receiving an exceptionally high number of support and error correction requests from the community
To facilitate further research and applications in this field, in this paper, we present a comprehensive survey of 27 existing large language models for nl2code, and also review benchmarks and metrics