Summary of Combinatorial methods for testing Internet of Things smart home systems

In our recent work (https://doi.org/10.1002/stvr.1805), we reported on applying combinatorial testing to Internet of Things (IoT) home automation hub systems. We detailed the creation of a dedicated input parameter model (IPM) for such systems, which was then used with combinatorial test case generation strategies; and also presented our developed automated test execution framework containing two test oracles. We applied and evaluated our proposed methodological approach to a real-world IoT system and analyzed the obtained results from various combinatorial test sets having different properties. Additionally, we compared these results to those from a random testing approach. The empirical testing results pointed to multiple errors and observations in the tested real-world IoT system and all considered approaches performed nearly equally well.