Generative Ensemble Learning for Robust Anomaly Detection in IIoT Financial Monitoring

Nirup Kumar Reddy Pothireddy

doi:10.63519/IJCSERD_12_01_011

Authors

Nirup Kumar Reddy Pothireddy Independent Researcher, USA. Author

DOI:

https://doi.org/10.63519/IJCSERD_12_01_011

Keywords:

Generative Adversarial Networks (GAN), AND cGAN, Ensemble Learning, DCGAN, Anomaly Detection, WGAN, IIoT, Financial Fraud Detection, Robustness, Streaming analytics, Scalable AI

Abstract

The widespread growth of Industrial Internet of Things (IIoT) systems reveals new vulnerabilities in financial data streams, especially in fraud and pattern anomalies detection mechanisms. Traditional detection methods used to detect anomalies have limited generalization abilities and consistently tend to produce unsatisfactory false-positive rates; the limitation of these two features is paramount in a large scale financial environment. This paper introduces a novelty in the form of a Generative Ensemble-learning Framework employing three distinct Generative Adversarial Network architectures—Deep Convolutional GAN, Wasserstein GAN and Conditional GAN—to create an ensemble with improved robustness for anomaly detection in IIoT-financial monitoring systems. By adorning the complements in magnifying the strengths of each GAN, ensemble-architecture represents the stark contrast from overfitting and reduction in detection variance to success, allowing the triumph of both the scientific progress and social welfare in essence. Experimental evaluation on benchmark IIoT financial data showed that our proposed framework produced much more significant improvements on false-positive rates (FPRs), F1-scores, and Area Under the Curve (AUC) compared to single GAN models. We further galvanized the interpretability and calibration with a weighted decision fusion strategy. This proposed ensemble method is capable of learning relatively quickly on streaming data in an adaptable manner and so functioning as a scalable foundational layer for deployment in real applications of automated financial monitoring. This study uniquely contributes with the pioneers' unconventional application of adversarial learning through Ensemble Learning and echoes the echo within the wider literature in securing IloT's financial institutions from data-driven Bonekennels.

References

I. Goodfellow et al., “Generative adversarial nets,” Advances in Neural Information Processing Systems, vol. 27, pp. 2672–2680, 2014.

A. Radford, L. Metz, and S. Chintala, “Unsupervised representation learning with deep convolutional generative adversarial networks,” International Conference on Learning Representations (ICLR), 2016.

M. Arjovsky, S. Chintala, and L. Bottou, “Wasserstein GAN,” International Conference on Machine Learning (ICML), 2017.

M. A. Al-Garadi et al., “A survey of machine and deep learning methods for internet of things (IoT) security,” IEEE Communications Surveys & Tutorials, vol. 22, no. 3, pp. 1646–1685, 2020.

U. Fiore et al., “Using generative adversarial networks for improving classification effectiveness in credit card fraud detection,” Information Sciences, vol. 479, pp. 448–455, 2019.

N. V. Chawla, N. Japkowicz, and A. Kotcz, “Editorial: Special issue on learning from imbalanced data sets,” ACM SIGKDD Explorations Newsletter, vol. 6, no. 1, pp. 1–6, 2004.

H. Zenati et al., “Efficient GAN-based anomaly detection,” arXiv preprint arXiv:1802.06222, 2018.

Z.-H. Zhou, Ensemble Methods: Foundations and Algorithms, CRC Press, 2012.

C. Zhou and R. C. Paffenroth, “Anomaly detection with robust deep autoencoders,” Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 665–674, 2017.

M. Mirza and S. Osindero, “Conditional generative adversarial nets,” arXiv preprint arXiv:1411.1784, 2014.

Y. Li, Y. Li, and Y. Sun, “Synthetic financial transaction generation using generative adversarial networks for fraud detection,” Journal of Computational Science, vol. 50, p. 101280, 2021.

T. Salimans et al., “Improved techniques for training GANs,” Advances in Neural Information Processing Systems, vol. 29, 2016.

T. T. Nguyen, N. G. Nguyen, and N. V. Nguyen, “A novel ensemble learning framework based on GANs for intrusion detection,” Journal of Information Security and Applications, vol. 58, p. 102776, 2021.

S. Roy and R. Mukherjee, “Data-driven anomaly detection in industrial networks: A GAN-based approach,” Computers & Security, vol. 104, p. 102213, 2021.

H. Zhang et al., “StackGAN: Text to photo-realistic image synthesis with stacked GANs,” IEEE International Conference on Computer Vision (ICCV), pp. 5907–5915, 2017.

Y. Zhang et al., “Blockchain-based data integrity verification and sharing for industrial IoT,” IEEE Transactions on Industrial Informatics, vol. 16, no. 6, pp. 4134–4145, 2020.

J. Jurgovsky et al., “Sequence classification for credit-card fraud detection,” Expert Systems with Applications, vol. 100, pp. 234–245, 2018.

K. Gai et al., “Blockchain-assisted information sharing with privacy preservation in industrial IoT,” IEEE Transactions on Industrial Informatics, vol. 15, no. 6, pp. 3693–3700, 2018.

A. Mosenia and N. K. Jha, “A comprehensive study of security of internet-of-things,” IEEE Transactions on Emerging Topics in Computing, vol. 5, no. 4, pp. 586–602, 2017.

X. Li et al., “Robust anomaly detection system for industrial IoT based on multi-layer perception,” IEEE Access, vol. 7, pp. 32600–32609, 2019.

H. Schlegl et al., “Unsupervised anomaly detection with generative adversarial networks to guide marker discovery,” International Conference on Information Processing in Medical Imaging, pp. 146–157, 2017.

P. Perera and V. M. Patel, “Learning deep features for one-class classification,” IEEE Transactions on Image Processing, vol. 28, no. 11, pp. 5450–5463, 2019.

Y. Deng et al., “Deep direct reinforcement learning for financial signal representation and trading,” IEEE Transactions on Neural Networks and Learning Systems, vol. 28, no. 3, pp. 653–664, 2016.

A. Sharma and J. H. Park, “Blockchain-based hybrid framework for secure data management in IoT,” Journal of Information Processing Systems, vol. 16, no. 5, pp. 1187–1200, 2020.

M. Lis et al., “GAN-based data augmentation for improving deep learning classification in industrial inspection,” Pattern Recognition Letters, vol. 153, pp. 83–90, 2022.

J. Kim, Y. Park, and H. Kim, “GAN-based synthetic data for boosting performance of intrusion detection in industrial IoT networks,” IEEE Internet of Things Journal, vol. 8, no. 3, pp. 1935–1945, 2020.

A. Srivastava et al., “VEEGAN: Reducing mode collapse in GANs using implicit variational learning,” Advances in Neural Information Processing Systems, vol. 30, 2017.

K. Buda, A. Maki, and M. A. Mazurowski, “A systematic study of the class imbalance problem in convolutional neural networks,” Neural Networks, vol. 106, pp. 249–259, 2018.

G. Van Horn and P. Perona, “The devil is in the tails: Fine-grained classification in the wild,” arXiv preprint arXiv:1709.01450, 2017.

H. Lucic et al., “Are GANs created equal? A large-scale study,” Advances in Neural Information Processing Systems, vol. 31, 2018.

T. Karras et al., “Progressive growing of GANs for improved quality, stability, and variation,” International Conference on Learning Representations (ICLR), 2018.

A. Liu and X. Yao, “Ensemble learning via negative correlation,” Neural Networks, vol. 12, no. 10, pp. 1399–1404, 1999.

T. Saito and M. Rehmsmeier, “The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets,” PLOS ONE, vol. 10, no. 3, e0118432, 2015.

H. He and E. A. Garcia, “Learning from imbalanced data,” IEEE Transactions on Knowledge and Data Engineering, vol. 21, no. 9, pp. 1263–1284, 2009.

L. Yu et al., “SeqGAN: Sequence generative adversarial nets with policy gradient,” AAAI Conference on Artificial Intelligence, pp. 2852–2858, 2017.

S. Khan and E. Cambria, “A review of deep learning for finance,” IEEE Transactions on Computational Social Systems, vol. 6, no. 6, pp. 1303–1310, 2018.