Choiru Zain, Andri Ashfahani, Mahardhika Pratama, Edwin Lughofer, Eric Pardede,
"Scalable Teacher-Forcing Networks under Spark Environments for Large-Scale Streaming Problems"
: 2020 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS), Serie IEEE Xplore, IEEE Press, 2020
Original Titel:
Scalable Teacher-Forcing Networks under Spark Environments for Large-Scale Streaming Problems
Sprache des Titels:
Englisch
Original Buchtitel:
2020 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS)
Original Kurzfassung:
Large-scale data streams remains an open issue in
the existing literature. It features a never ending information flow, mostly going beyond the capacity of a single processing node. Nonetheless, algorithmic development of large-scale streaming algorithms under distributed platforms faces major challenge due to the scalability issue. The network complexity exponentially grows with the increase of data batches, leading to an accuracy loss if the model fusion phase is not properly designed. A largescale
streaming algorithm, namely Scalable Teacher Forcing
Network (ScatterNet), is proposed here. ScatterNet has an elastic structure to handle the concept drift in the local scale within the data batch or in the global scale across batches. It is built upon the teacher forcing concept providing a short-term memory aptitude. ScatterNet features the data-free model fusion approach which consists of the zero-shot merging mechanism and the online model selection. Our numerical study demonstrates moderate improvement of prediction accuracy by ScatterNet while gaining
competitive advantage in terms of execution time compared to
its counterpart.
Forschungs-