Comparison of Probabilistic Models and Neural Networks on Prediction of Home Sensor Events

Abstract

We present results and comparative analysis on the prediction of sensor events in a smart home environment with a limited number of binary sensors. We apply two probabilistic methods, namely Sequence Prediction via Enhanced Episode Discovery - SPEED, and Active LeZi - ALZ, as well as Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) in order to predict the next sensor event in a sequence. Our dataset has been collected from a real home with one resident over a period of 30 weeks. The binary sensor events are converted to two different text sequences as dictated by SPEED and ALZ, which are also used as inputs for the LSTM networks. We compare the performance of the algorithms regarding the number of preceding sensor events required to predict the next one, the required amount of data for the model to reach peak accuracy and stability, and the execution time. In addition, we analyze these for two different sets of sensors. Our best implementation achieved a peak accuracy of 83% for a set with fifteen sensors including motion, magnetic and power sensors, and 87% for seven motion sensors.