A Survey: Benchmarking and Performance Modelling of Data Intensive Applications

In recent years, there has been a lot of focus on benchmarking and performance modelling of data-intensive applications to understand and improve the development of big data systems. Several interesting approaches were proposed; however, as of writing this paper and to the best of our knowledge, there are no comprehensive surveys that thoroughly examine the gaps, trends and trajectories of this area. To fill this void, we, therefore, present a review of the state-of-art benchmarking and performance modelling efforts in data-intensive applications. We start by introducing the two most common dataflow patterns used, for each of these patterns, we review their approach to benchmarking, modelling and validation & experimental environments. Furthermore, we construct a taxonomy and classification to provide a deep understanding of the focus areas of this domain and identify the opportunities for further research. We conclude by analysing each research gap and highlighting future trends.