Data acquisition, interfacing and pre-processing of highway traffic data

Reference:
T. Bellemans, B. De Schutter, and B. De Moor, "Data acquisition, interfacing and pre-processing of highway traffic data," Proceedings of Telematics Automotive 2000, Birmingham, UK, vol. 1, pp. 4/1-4/7, Apr. 2000.

Abstract:
Data acquisition and pre-processing are important steps in any traffic data collection, analysis or simulation project. In this paper we present the results of a case study we have done on traffic simulation for a stretch of the E17 highway near Antwerp, Belgium. We will especially focus on the data collection and processing part. The objective of the work presented here is to illustrate how traffic data can be collected and processed in such a way that it can be used for modeling and prediction purposes. The data collection and processing process consists of three steps: data acquisition, interfacing, and pre-processing. During this process a central database with raw sensor data is created. In general the raw sensor data will contain errors or missing values due to sensor failures, data link errors, biases, and other measurement errors. Therefore, we introduce a pre-processing step in order to deal with data that is known to be corrupt or for which the value is temporarily not available (many simulation packages require data records that are complete and contain no gaps). After the three steps have been carried out, we have a database of "clean and complete" traffic data that can be used for further analysis or that can be used in other applications such as highway traffic simulation or traffic forecasts.