diff --git a/report/main.md b/report/main.md index 4c610c4..f228be4 100644 --- a/report/main.md +++ b/report/main.md @@ -419,5 +419,14 @@ test is inconclusive. ## Practical Usefulness -Discuss the practical usefulness of the obtained classifiers in a -realistic bug prediction scenario (1 paragraph). +The evaluation shows that all classifiers but the Naive Bayes classifier outperform the biased classifier in overall performance +(represented by the F1 score). Given the evaluation was not performed on a dedicated test set, all classifiers may be subjected to +training bias, which might yield better metrics than a similar evaluation performed on completely new data. However, given the +evaluation sample size (i.e. the number of training runs) this effect is minimal. + +Given this premise, I can say with reasonable confidence the *DT*, *MLP*, *RP* and *SVP* +classifiers would be useful in predicting potential bugs in the Google JSComp project, i.e. the source of the used dataset. Given the +literature presented during lecture, it is not certain if the same trained classifier would yield acceptable results for source +code from another project. This is because differences in coding conventions, the bug tracking process, or simply the definition of +what constitutes a bug may vary from project to project. A solution to this problem might be to simply train the classifiers on a dataset +coming from the project where bug prediction is needed. \ No newline at end of file diff --git a/report/main.pdf b/report/main.pdf index a670252..ebaa275 100644 Binary files a/report/main.pdf and b/report/main.pdf differ