Abstract
Context: Many software systems are highly configurable. Different configuration options could lead to varying performances of the system. It is difficult to measure system performance in the presence of an exponential number of possible combinations of these options.
Goal: Predicting software performance by using a small configuration sample.
Method: This paper proposes PERF-AL to address this problem via adversarial learning. Specifically, we use a generative network combined with several different regularization techniques (L1 regularization, L2 regularization and a dropout technique) to output predicted values as close to the ground truth labels as possible. With the use of adversarial learning, our network identifies and distinguishes the predicted values of the generator network from the ground truth value distribution. The generator and the discriminator compete with each other by refining the prediction model iteratively until its predicted values converge towards the ground truth distribution.
Results: We argue that (i) the proposed method can achieve the same level of prediction accuracy, but with a smaller number of training samples. (ii) Our proposed model using seven real-world datasets show that our approach outperforms the state-of-the-art methods. This help to further promote software configurable performance.
Conclusion: Experimental results on seven public real-world datasets demonstrate that PERF-AL outperforms state-of-the-art software performance prediction methods. Copyright © 2020 Association for Computing Machinery.
Original language | English |
---|---|
Title of host publication | Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) |
Place of Publication | New York |
Publisher | Association for Computing Machinery |
ISBN (Electronic) | 9781450375801 |
DOIs | |
Publication status | Published - Oct 2020 |
Citation
Shu, Y., Sui, Y., Zhang, H., & Xu, G. (2020). Perf-AL: Performance prediction for configurable software through adversarial learning. In Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). Association for Computing Machinery. https://doi.org/10.1145/3382494.3410677Keywords
- Software performance prediction
- Adversarial learning
- Regularization
- Configurable systems