The Metamorphosis (of RAM3S)
Source abstract
Abstract
The real-time analysis of Big Data streams is a terrific resource for transforming data into value. For this, Big Data technologies for smart processing of massive data streams are available, but the facilities they offer are often too raw to be effectively exploited by analysts. RAM3S (Real-time Analysis of Massive MultiMedia Streams) is a framework that acts as a middleware software layer between multimedia stream analysis techniques and Big Data streaming platforms, so as to facilitate the implementation of the former on top of the latter. RAM3S has been proven helpful in simplifying the deployment of non-parallel techniques to streaming platforms, such as Apache Storm or Apache Flink. In this paper, we show how RAM3S has been updated to incorporate novel stream processing platforms, such as Apache Samza, and to be able to communicate with different message brokers, such as Apache Kafka. Abstracting from the message broker also provides us with the ability to pipeline several RAM3S instances that can, therefore, perform different processing tasks. This represents a richer model for stream analysis with respect to the one already available in the original RAM3S version. The generality of this new RAM3S version is demonstrated through experiments conducted on three different multimedia applications, proving that RAM3S is a formidable asset for enabling efficient and effective Data Mining and Machine Learning on multimedia data streams.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Analysis and Summarization · Algorithms and Data Compression · Music and Audio Processing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Engineering (DISI), Alma Mater Studiorum, University of Bologna, Viale del Risorgimento, 2, 40136 Bologna, Italy
References (21)
Show source-provided references
1. Tang, M., Pongpaichet, S., and Jain, R. (2016, January 15–19). Research Challenges in Developing Multimedia Systems for Managing Emergency Situations. Proceedings of the 24th ACM international conference on Multimedia (ACM MM 2016), Amsterdam, The Netherlands.10.1145/2964284.2976761 ↗
2. A General Framework for Real-time Analysis of Massive Multimedia Streams10.1007/s00530-017-0566-5 ↗
3. Bartolini, I., and Patella, M. (2019). Real-Time Stream Processing in Social Networks with RAM3S. Future Internet, 11.10.3390/fi11120249 ↗
4. Bartolini, I., Moscato, V., Pensa, R.G., Penta, A., Picariello, A., Sansone, C., and Sapino, M.L. (2013, January 9–13). Recommending Multimedia Objects in Cultural Heritage Applications. Proceedings of the International Conference on Image Analysis and Processing (ICIAP 2013), Naples, Italy.10.1007/978-3-642-41190-8_28 ↗
5. Modoni, G., and Tosi, D. (2016, January 22–24). Correlation of Weather and Moods of the Italy Residents through an Analysis of Their Tweets. Proceedings of the 2016 IEEE 4th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW), Vienna, Austria.10.1109/W-FiCloud.2016.53 ↗
6. Viola, P., and Jones, M. (2001, January 8–14). Rapid Object Detection Using a Boosted Cascade of Simple Features. Proceedings of the 2001 Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, USA.
7. Turk, M., and Pentland, A.P. (1991, January 3–6). Face Recognition Using Eigenfaces. Proceedings of the 1991 Conference on Computer Vision and Pattern Recognition (CVPR 1991), Lahaina, HI, USA.
8. A Fast Recognition Algorithm for Suspicious Behavior in High Definition Videos10.1007/s00530-015-0456-7 ↗
9. Tucker Decomposition-Based Tensor Learning for Human Action Recognition10.1007/s00530-015-0464-7 ↗
10. Human Gesture Recognition Using a Simplified Dynamic Bayesian Network10.1007/s00530-014-0414-9 ↗
11. Detection, Classification and Localization of Acoustic Events in the Presence of Background Noise for Acoustic Surveillance of Hazardous Situations10.1007/s11042-015-3105-4 ↗
12. The Stratosphere Platform for Big Data Analytics10.1007/s00778-014-0357-y ↗
13. Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., and Stoica, I. (2010, January 22). Spark: Cluster Computing with Working Sets. Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud’10), Boston, MA, USA.
14. Ramesh, N.; Bringhurst, J.; Gupta, I.; Campbell, R.H. Samza: Stateful Scalable Stream Processing at LinkedIn10.14778/3137765.3137770 ↗
15. Wolf, L., Hassner, T., and Maoz, I. (2011, January 20–25). Face Recognition in Unconstrained Videos with Matched Background Similarity. Proceedings of the 2011 Conference on Computer Vision and Pattern Recognition (CVPR 2011), Colorado Springs, CO, USA.10.1109/CVPR.2011.5995566 ↗
16. SHIATSU: Tagging and Retrieving Videos without Worries10.1007/s11042-011-0948-1 ↗
17. Automatic License Plate Recognition (ALPR): A State-of-the-Art Review10.1109/TCSVT.2012.2203741 ↗
18. Prakash, C. (2021, December 03). Spark Streaming vs. Flink vs. Storm vs. Kafka Streams vs. Samza: Choose Your Stream Processing Framework. Why Not Learn Something Blogspot. Available online: https://why-not-learn-something.blogspot.com/2018/03/spark-streaming-vs-flink-vs-storm-vs.html.
19. Yavuz, B. (2021, December 03). Benchmarking Structured Streaming on Databricks Runtime Against State-of-the-Art Streaming Systems. Eng. Blog. Available online: https://databricks.com/blog/2017/10/11/benchmarking-structured-streaming-on-databricks-runtime-against-state-of-the-art-streaming-systems.html.
20. Krettek, A. (2021, December 03). The Curious Case of the Broken Benchmark: Revisiting Apache Flink® vs. Databricks Runtime. Ververica Blog. Available online: https://www.ververica.com/blog/curious-case-broken-benchmark-revisiting-apache-flink-vs-databricks-runtime.
21. The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing10.14778/2824032.2824076 ↗