We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.AI

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Artificial Intelligence

Title: Towards a Generic Multimodal Architecture for Batch and Streaming Big Data Integration

Abstract: Big Data are rapidly produced from various heterogeneous data sources. They are of different types (text, image, video or audio) and have different levels of reliability and completeness. One of the most interesting architectures that deal with the large amount of emerging data at high velocity is called the lambda architecture. In fact, it combines two different processing layers namely batch and speed layers, each providing specific views of data while ensuring robustness, fast and scalable data processing. However, most papers dealing with the lambda architecture are focusing one single type of data generally produced by a single data source. Besides, the layers of the architecture are implemented independently, or, at best, are combined to perform basic processing without assessing either the data reliability or completeness. Therefore, inspired by the lambda architecture, we propose in this paper a generic multimodal architecture that combines both batch and streaming processing in order to build a complete, global and accurate insight in near-real-time based on the knowledge extracted from multiple heterogeneous Big Data sources. Our architecture uses batch processing to analyze the data structures and contents, build the learning models and calculate the reliability index of the involved sources, while the streaming processing uses the built-in models of the batch layer to immediately process incoming data and rapidly provide results. We validate our architecture in the context of urban traffic management systems in order to detect congestions.
Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Journal reference: Journal of Computer Science, Volume 15 No. 1, 2019, 207-220
DOI: 10.3844/jcssp.2019.207.220
Cite as: arXiv:2108.04343 [cs.AI]
  (or arXiv:2108.04343v1 [cs.AI] for this version)

Submission history

From: Maryem Rhanoui [view email]
[v1] Mon, 9 Aug 2021 20:50:01 GMT (1160kb)

Link back to: arXiv, form interface, contact.