We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.SE

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Software Engineering

Title: Assessing Project-Level Fine-Tuning of ML4SE Models

Abstract: Machine Learning for Software Engineering (ML4SE) is an actively growing research area that focuses on methods that help programmers in their work. In order to apply the developed methods in practice, they need to achieve reasonable quality in order to help rather than distract developers. While the development of new approaches to code representation and data collection improves the overall quality of the models, it does not take into account the information that we can get from the project at hand.
In this work, we investigate how the model's quality can be improved if we target a specific project. We develop a framework to assess quality improvements that models can get after fine-tuning for the method name prediction task on a particular project. We evaluate three models of different complexity and compare their quality in three settings: trained on a large dataset of Java projects, further fine-tuned on the data from a particular project, and trained from scratch on this data. We show that per-project fine-tuning can greatly improve the models' quality as they capture the project's domain and naming conventions. We open-source the tool we used for data collection, as well as the code to run the experiments: this https URL
Comments: 12 pages, 3 figures
Subjects: Software Engineering (cs.SE); Machine Learning (cs.LG)
Cite as: arXiv:2206.03333 [cs.SE]
  (or arXiv:2206.03333v1 [cs.SE] for this version)

Submission history

From: Egor Bogomolov [view email]
[v1] Tue, 7 Jun 2022 14:19:33 GMT (868kb,D)

Link back to: arXiv, form interface, contact.