AI-Driven Fault Detection in Cloud-Based Data Engineering Architectures

Authors

  • Dillepkumar Pentyala Farmer Insurance Author
  • Narendra Devarasetty Department of Computer Engineering, 12, Sardar Patel Rd, Anna University, Guindy, Chennai, Tamil Nadu 600025, India Author
  • Vinay Chowdary Manduva Department of Computer Science, Missouri State University, Springfield, MO Author

Keywords:

Artificial Intelligence, Data Engineering, Machine Learning, Real-Time DecisionMaking, Predictive Modeling.

Abstract

The integration of Artificial Intelligence (AI) into data engineering represents a transformative shift in data processing and analytics workflows. This paper explores how AI-driven methodologies enhance the efficiency, accuracy, and scalability of data engineering processes. We present a comprehensive analysis of AI techniques applied to data ingestion, processing, and analytics, focusing on their impact on real-time decision-making, predictive modeling, and automated data management. Key applications in financial trading, healthcare monitoring, and manufacturing predictive maintenance illustrate the practical benefits of AI integration. Our findings reveal that AI-enhanced data pipelines significantly reduce latency, improve data quality, and enable more precise analytics. We discuss the methodologies employed, including machine learning models, natural language processing, and deep learning techniques, and their role in automating data workflows and generating actionable insights. This paper concludes by highlighting the future directions for AI-driven data engineering, emphasizing the need for further research to address challenges such as ethical considerations, model interpretability, and scalability in complex data environments.

Downloads

Download data is not yet available.

Downloads

Published

2024-06-12

How to Cite

AI-Driven Fault Detection in Cloud-Based Data Engineering Architectures. (2024). International Journal of Advanced Engineering Technologies and Innovations, 1(3), 664-697. http://ijaeti.com/index.php/Journal/article/view/518

Most read articles by the same author(s)

1 2 > >>