A Simple and Reliable Unstructured Data Synchronization Technique for Biogas Data

Abstract

Data from biogas plants are considered as unstructured data due to the complex and dynamic nature. Thus, it is not possible to define common data structure for data generating from biogas plants. This reason prevents online or inline synchronization of biogas data with the central database. In addition, due to the scattered locations of the plants, it is not possible to use private communication media for data synchronization. Also, use of existing complex fully automated systems with high technology is not economically feasible. We introduce a software solution that is capable of overcoming aforementioned drawbacks. Total system is a combination of data recording module and two data synchronizing modules. The data recording module of the system is installed in a personal digital assistant (PDA) which is capable of storing and locally customizing. After daily data recording, connecting the PDA to the first synchronization module in computer will automatically update new data to a spread sheet in the local machine and sends a copy of new data to central computer as an email. In the central computer the data in the email are uploaded to a database using the second synchronization module. This process guarantied continuous data flow of unstructured data to central database at low cost while providing farmer much reliable data without additional effort. The proposed method has been implemented for synchronizing biogas data of six plants with different data structures that located in considerably large geographically area (Bryan, Germany).