Optimizing Real-Time Data Processing in Resource-Constrained Environments: A Spark and GPU-Driven Workflow for Large Language Models
Published in 2024 IEEE International Conference on Future Machine Learning and Data Science (FMLDS), 2024
This paper explores a Spark and GPU-driven workflow for efficient real-time data processing of LLMs.
Recommended citation: Mina Yousef, Ghada Khoriba, & Tamer Arafa. (2024). “Optimizing Real-Time Data Processing in Resource-Constrained Environments: A Spark and GPU-Driven Workflow for Large Language Models.” IEEE FMLDS 2024.
Recommended citation: Mina Yousef, Ghada Khoriba, & Tamer Arafa. (2024). "Optimizing Real-Time Data Processing in Resource-Constrained Environments: A Spark and GPU-Driven Workflow for Large Language Models." IEEE FMLDS 2024.
Download Paper