Mastering Python Test Automation
Keywords:
Python, Playwright, Web Automation, API Automation, Framework, Machine Learning, Regression Models, CICD, Jenkin files, pdf2image, deepDiff, Cypress, UiPathAbstract
This paper examines the advantages of implementing test automation with Python, emphasizing strategies for effective deployment and best practices to ensure successful automation processes. The benefits of using Python for test automation include enhanced efficiency, quicker execution times, and broader test coverage. Moreover, Python's comprehensive libraries and frameworks offer strong support for test automation, enabling developers to effortlessly automate unit, integration, and system testing.
Additionally, test automation is crucial for the scalability and repeatability of testing efforts. With increasing project complexity, manual testing becomes more time-consuming and susceptible to errors. Automating tests with Python allows the project delivery team to expand their testing efforts to accommodate larger projects while ensuring consistent and reliable test outcomes.
The paper also delves into the capabilities of the test automation framework in Python, along with associated packages for UI and API testing. Given the robustness of web and API automation workflows, which can run and create data swiftly and stably, establishing a data repository for training and testing regression, CNN, and KNN models becomes much simpler, and the test automation framework can be integrated with machine learning models. The potential for integrating machine learning models is explored as well.
In summary, the paper presents a comprehensive guide to mastering Python test automation across various domains, including web applications, API testing, GUI testing, performance testing, continuous integration/continuous deployment (CI/CD), data-driven testing, and cross-browser testing. Understanding the significance of Python in test automation enables the project delivery team to optimize their testing procedures, enhance efficiency, and ultimately provide higher-quality products to their clients and stakeholders.
References
Pytest plugin to write end-to-end browser tests with Playwright.. (2023, February 15). https://github.com/microsoft/playwright-pytest
(2022, April 27). Selenium Automation With Python. https://advantosoftware.com/selenium-withpython-training-in-pune/
Anuja Jain M, Swarnalatha P* Muhammad Rukunuddin Ghalib, S. Prabu (2012, May). Web-Based Automation Testing Framework. International Journal of Computer Applications (0975 – 8887) Volume 45– No.16
Automation Testing. (2023, January 1). http://rareskillsltd.com/automation-testing/
Best Quality Assurance Testing Blogs Strategies & Trends. (2023, January 31). https://blog.qasource.com/topic/software-testing
CI/CD for Machine Learning in 2024: Best Practices to Build, Test, and Deploy. (2023, December 27). https://medium.com/infer-qwak/ci-cd-for-machine-learning-in-2024-best-practices-to-build-test-anddeploy-c4ad869824d2
Data Driven Testing - API Test Base. (2022, October 19). https://apitestbase.io/docs/en/data-driventesting
Jenkins CI pipeline which automatically runs application tests when commit action happens in GitHub.. (2022, February 22). https://github.com/Rustam-Z/jenkins-pytest-github
Leading Kualitee Test Management Tool & Software by Kualitatem. (2017, March 29). https://www.kualitatem.com/software-testing-tools/
Legerity: A framework for speeding up the development of automated UI tests for Windows, Android, iOS, and Web with Appium/Selenium on .NET. (2022, December 30). https://github.com/MADEApps/legerity
Lenz, M. (2019, January 1). Python Continuous Integration and Delivery. https://doi.org/10.1007/9781-4842-4281-0
Libraries in Python. (2021, October 16). https://www.geeksforgeeks.org/libraries-in-python/
pytest: helps you write better programs. (2022, June 2). https://pytest.org/en/7.0.x/
Ramesh, R. (2024, April 23). The Guide to Integrating Generative AI into Unified Continuous Testing Platforms. https://www.headspin.io/blog/discover-how-generative-ai-in-continuous-testing-works
S.K, A., Amrathesh, A., & M, G R. (2021, June 18). A review on Continuous Integration, Delivery and Deployment using Jenkins. , 23(06), 919-922. https://doi.org/10.51201/jusst/21/05376
Salunke, S S. (2014, March 13). Selenium Webdriver in Python: Learn with Examples. https://dl.acm.org/citation.cfm?id=2655462
Sandman, A. (2023, January 23). Software Testing, Artificial Intelligence and Machine Learning Trends in 2023. https://www.infoq.com/articles/software-testing-ai-ml-2023/
Selenium Python with Behave BDD (Basic + Advance + Architect). (2023, January 1). https://www.selenium-tutorial.com/p/selenium-python-tutorial
SUBSCRIBE, S. (2023, January 26). Using Machine Learning to Make Test Executions More Efficient HackerNoon. https://hackernoon.com/using-machine-learning-to-make-test-executions-more-efficient
Suhas, T M., & K, S N. (2021, July 16). Continuous Integration and Continuous Deployment with Jenkins in C++ Software Development. , 23(07), 805-810. https://doi.org/10.51201/jusst/21/05307
Test Automation Tool For Web, Desktop & Mobile. (2021, January 1). https://www.sahipro.com/
Xin, C J C B H L G J K P. (2023, January 10). Understanding the Complexity and Its Impact on Testing in ML-Enabled Systems. https://arxiv.org/abs/2301.03837
CI/CD for Machine Learning in 2024: Best Practices to Build Abhishek, M K., Rao, D R., & Subrahmanyam, K. (2022, January 1). Framework to Deploy Containers using Kubernetes and CI/CD Pipeline. Science and Information Organization, 13(4). https://doi.org/10.14569/ijacsa.2022.0130460
Apruzzese, G., Colajanni, M., Ferretti, L., Guido, A., & Marchetti, M. (2018, May 1). On the effectiveness of machine and deep learning for cyber security. https://doi.org/10.23919/cycon.2018.8405026
Architecting for Scale. (2018, April 6). https://www.jenkins.io/doc/book/scaling/architecting-forscale/
Automated Software Testing with Python. (2023, January 1). https://github.com/PacktPublishing/Automated-Software-Testing-with-Python
Balameena, N., & Muralidharan, D. (2016, August 16). Automation of wireless Telecom Node Commands of Network Management System. Indian Society for Education and Environment, 9(29). https://doi.org/10.17485/ijst/2016/v9i29/93212
Baniaș, O., Florea, D., Gyalai, R., & Curiac, D. (2021, August 9). Automated Specification-Based Testing of REST APIs. Multidisciplinary Digital Publishing Institute, 21(16), 5375-5375. https://doi.org/10.3390/s21165375
Bassi, S. (2007, November 30). A Primer on Python for Life Science Researchers. International Society for Computational Biology, 3(11), e199-e199. https://doi.org/10.1371/journal.pcbi.0030199
Bilina, R., & Lawford, S. (2012, March 12). Python for Unified Research in Econometrics and Statistics. Taylor & Francis, 31(5), 558-591. https://doi.org/10.1080/07474938.2011.553573
Braiek, H B., & Khomh, F. (2018, January 1). On Testing Machine Learning Programs. Cornell University. https://doi.org/10.48550/arxiv.1812.02257
Breck, E., Cai, S., Nielsen, E., Salib, M., & Sculley, D. (2017, December 1). The ML test score: A rubric for ML production readiness and technical debt reduction. https://doi.org/10.1109/bigdata.2017.8258038
De, B. (2017, January 1). API Testing Strategy. , 153-164. https://doi.org/10.1007/978-1-4842-13056_9
Fontes, A., & Gay, G. (2023, May 2). The integration of machine learning into automated test generation: A systematic mapping study. Wiley, 33(4). https://doi.org/10.1002/stvr.1845
Gopularam, B P., Yogeesha, C B., & Periasamy, P. (2012, December 1). Highly scalable model for tests execution in cloud environments. https://doi.org/10.1109/adcom.2012.6563584
Gupta, N., Yadav, V., & Singh, M. (2018, August 22). Automated Regression Test Case Generation for Web Application. Association for Computing Machinery, 51(4), 1-25. https://doi.org/10.1145/3232520
Hof, V V., & Fuchs, A. (2018, April 9). Automatic scalable parallel test case execution. introducing the münster distributed test case runner for Java (miDSTR). https://doi.org/10.1145/3167132.3167408
Islam, M N., & Quadri, S M K. (2020, January 1). Framework for Automation of Cloud-Application Testing using Selenium (FACTS). Advances in Science, Technology and Engineering Systems Journal (ASTESJ), 5(1), 226-232. https://doi.org/10.25046/aj050129
Jain, P., & Soni, D. (2020, February 1). A Survey on Generation of Test Cases using UML Diagrams. https://doi.org/10.1109/ic-etite47903.2020.395
Kelly, S. (2016, January 1). What Is Python?. , 3-5. https://doi.org/10.1007/978-1-4842-2517-2_2
Kim, M., Qi, X., Sinha, S., & Orso, A. (2022, July 18). Automated test generation for REST APIs: no time to rest yet. https://doi.org/10.1145/3533767.3534401
King, T M., Arbon, J., Santiago, D., Adamo, D T., Chin, W., & Shanmugam, R. (2019, April 1). AI for Testing Today and Tomorrow: Industry Perspectives. https://doi.org/10.1109/aitest.2019.000-3
Kozhevnikov, V A., & Pankratova, E S. (2018, May 30). DEVELOPMENT OF AN INTELLIGENT
RECOMMENDER ASSISTANT USING THE TELEGRAM PLATFORM. International Academy
Of Theoretical & Applied Science, 61(05), 77-83. https://doi.org/10.15863/tas.2018.05.61.16 44. Maffey, K R., Dotterrer, K., Niemann, J., Cruickshank, I J., Lewis, G A., & Kästner, C. (2023, May 1). MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualities. https://doi.org/10.1109/icse-nier58687.2023.00012
Marijan, D., Gotlieb, A., & Ahuja, M K. (2019, April 1). Challenges of Testing Machine Learning Based Systems. https://doi.org/10.1109/aitest.2019.00010
Martin-Lopez, A. (2020, June 27). AI-driven web API testing. https://doi.org/10.1145/3377812.3381388
N, D S., S, S D., Vijayasree, D., Roopa, N S., & Arun, A. (2022, January 1). A Review on the Process of Automated Software Testing. Cornell University. https://doi.org/10.48550/arXiv.2209.
Natarajan, R., Madlambayan, M A M., & Patalay, M M. (2022, December 12). PYTHON PROGRAMMING FOR BEGINNERS. European Organization for Nuclear Research. https://doi.org/10.5281/zenodo.7580581
Pajankar, A. (2017, January 1). Python Unit Test Automation. https://doi.org/10.1007/978-1-48422677-3
Prabhu, S., Naik, M K., Firdosh, A D., Sohan, S A., & Malvi, N B. (2021, June 17). Automation in Testing with Jenkins for Software Development. , 23(06), 746-755.https://doi.org/10.51201/jusst/21/05340
Purushothaman, S K., Kashyap, N., Ha, D., Agarwal, S., Iqbal, S., & Behere, V. (2018, December 1). Unified Approach Towards Automation of any Desktop Web, Mobile Web, Android, iOS, REST and SOAP API Use Cases. https://doi.org/10.1109/iccsdet.2018.8821229
Smith, J A., Richman, G., DeStefano, J., Pryor, J., Rao, T C., Strecker-Kellogg, W., & Wong, T. (2015, December 23). The Careful Puppet Master: Reducing risk and fortifying acceptance testing with Jenkins CI. IOP Publishing, 664(6), 062059-062059. https://doi.org/10.1088/17426596/664/6/062059
Sriwichainan, P., & Suwannasart, T. (2020, October 9). Generating Test Scripts for Web-Based Applications. https://doi.org/10.1145/3441233.3441248
Sushma, T N. (2020, June 17). Automation of Software Development using DevOps and its Benefits. International Research Publication House, V9(06). https://doi.org/10.17577/ijertv9is060369
Wagner, S. (2006, July 21). A model and sensitivity analysis of the quality economics of defectdetection techniques. https://doi.org/10.1145/1146238.1146247
Zhang, J M., Harman, M., Ма, Л., & Liu, Y. (2019, January 1). Machine Learning Testing: Survey, Landscapes and Horizons. Cornell University. https://doi.org/10.48550/arxiv.1906.10742
Downloads
Published
Issue
Section
License
Copyright (c) 2024 International Journal of Computer Science and Engineering Research and Development (IJCSERD)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
