TSNE Results

For Bug Prioritization Processes

Unsupervised Prioritization

Strategy Reduced Bandwidth Full Bandwidth
Empirically Honest 0.0 0.0
Regular Deflater 0.0 0.0
Occasional Deflater 0.0 0.0
Empirically Inflater 0.0 0.0
Persistent Deflater 0.0 0.0
Honest 0.0 0.0
Dishonest 1.0 1.0

Gatekeeper Process

50% error rate

Strategy Reduced Bandwidth Full Bandwidth
Empirically Honest 0.0 0.0
Regular Deflater 0.0 0.0
Occasional Deflater 0.0 0.0
Empirically Inflater 0.0 0.0
Persistent Deflater 0.0 0.0
Honest 0.0 0.0
Dishonest 1.0 1.0

10% error rate

Strategy Reduced Bandwidth Full Bandwidth
Empirically Honest 0.0 0.0
Regular Deflater 0.0 0.0
Occasional Deflater 0.0 0.0
Empirically Inflater 0.0 0.0
Persistent Deflater 0.0 0.0
Honest 0.0 0.0
Dishonest 1.0 1.0

0% error rate

Strategy Reduced Bandwidth Reduced Bandwidth Reduced Bandwidth Full Bandwidth Full Bandwidth Full Bandwidth Full Bandwidth
Empirically Honest 1.0 0.0 0.0 1.0 0.0 0.0 0.0
Regular Deflater 1.0 0.0 0.0 0.0 0.0 0.0 0.5
Occasional Deflater 0.0 1.0 0.0 0.0 0.0 0.0 0.0
Empirically Inflater 0.0 1.0 0.0 0.0 1.0 0.0 0.0
Persistent Deflater 0.0 0.0 1.0 0.0 0.0 1.0 0.5
Honest 0.0 0.0 0.0 0.0 0.0 0.0 0.0
Dishonest 0.0 0.0 0.0 0.0 0.0 0.0 0.0

Assessor-Throttling Process

3% dishonesty penalty

Strategy Reduced Bandwidth Full Bandwidth
Empirically Honest 0.0 0.0
Regular Deflater 0.0 0.0
Occasional Deflater 0.0 0.0
Empirically Inflater 0.14 0.0
Persistent Deflater 0.0 0.0
Honest 0.0 0.0
Dishonest 0.86 1.0

10% dishonesty penalty

Strategy Reduced Bandwidth Full Bandwidth
Empirically Honest 0.0 0.0
Regular Deflater 0.0 0.0
Occasional Deflater 0.0 0.0
Empirically Inflater 0.0 0.0
Persistent Deflater 0.0 0.0
Honest 1.0 0.97
Dishonest 0.0 0.03

20% dishonesty penalty

Strategy Reduced Bandwidth Full Bandwidth
Empirically Honest 0.0 0.0
Regular Deflater 0.0 0.0
Occasional Deflater 0.0 0.0
Empirically Inflater 0.0 0.0
Persistent Deflater 0.0 0.0
Honest 1.0 1.0
Dishonest 0.0 0.0