Best practices for evaluating IRFL approaches - Supplemental material

Hirsch, Thomas;Hofer, Birgit

Description

Information retrieval fault localization (IRFL) is a popular research field and many IRFL approaches have been proposed recently.Unfortunately, the evaluation of some of these IRFL approaches is often too simplistic, which can cause an overestimation of performance of these approaches.For this reason, we discuss evaluation pitfalls and problems in our paper "Best practices for evaluating IRFL approaches".To support our claim of the poor status quo of current evaluation practices in some research papers, we have performed a literature survey on 121 papers.This repository contains the data that we have extracted from these papers and our evaluation script.

Citations (0)

Mentions (0)

Metrics

Dataset Index

0.6

FAIR Score

79%

Citations

0

Mentions

0

Metrics Over Time

Publication Details

DOI

Publisher

Zenodo

License

Creative Commons Attribution 4.0 International

Assigned Domain

Subfield

Education

Field

Social Sciences

Domain

Social Sciences

Confidence Score

52%

Source

Scholar Data Model

Normalization Factors

FT

43.27

CTw

1.00

MTw

1.00