The Role of Generative Foundation Models in Transforming Software Development and Computational Reasoning

Authors

  • B. Subashini School of Information Systems, Madras Institute of Technology, Chennai, India. Author
  • Teena Richard School of Information Systems, Madras Institute of Technology, Chennai, India Author
  • C. Priyadarshini School of Information Systems, Madras Institute of Technology, Chennai, India Author

DOI:

https://doi.org/10.63282/3117-5481/AIJCST-V2I6P102

Keywords:

Generative Foundation Models, Software Development, Computational Reasoning, Artificial Intelligence, Code Generation, Machine Learning, Model Interpretability, Ethical AI

Abstract

Generative foundation models (GFMs) have become a game changer in artificial intelligence (AI) with massive implications on software development and computational reasoning. These models, typified by both their large-scale training on a wide variety of datasets, and their ability to perform self-supervised learning, have shown impressive versatility across both code generation and computer optimization as well as the more complex problems in the fields of science and engineering. The paper will discuss how GFMs affect the practice of software engineering in the contemporary setting, and computational reasoning. We look at how generative models have evolved, how they relate to their architectures and how they have come to be a part of software development life cycles. More so, we examine how they are useful in automating coding procedures, improving software quality, extracting knowledge, and decision-making using computational reasoning. The developers can minimize the manual coding time using GFMs speeding up prototyping as well as increasing system robustness. Nevertheless, these models also come with certain challenges, such as the matter of ethics, biases, insecurity, and domain-specific adaptation. These challenges are addressed in the paper and the ways of reducing the risks involved. Based on the thorough examination of the literature available, the frameworks of methodologies, and case studies, we provide an in-depth discussion of the transformative value of GFMs in software creation and computer inference. Our results underscore the need to approach integration of generative models in a responsible manner, but in ways that are interpretable, accountable as well as sustainable computational

References

[1] Eom, S. B. “A Survey of Operational Expert Systems in Business (1980–1993).” Interfaces, Vol. 26, No. 5, 1996, pp. 50-70.

[2] Sacerdoti, E. D. “A Survey of Expert System Projects.” Presented at Software Development ’89, San Francisco, 1989.

[3] Jiang, Juyong; Wang, Fan; Shen, Jiasi; Kim, Sungju; Kim, Sunghun. “A Survey on Large Language Models for Code Generation.” J. ACM, Vol. 37, No. 4, Aug 2018.

[4] Sacerdoti, E. D. “A Survey of Expert System Projects.” Proceedings of Software Development ’89, San Francisco, 1989.

[5] Conrad, F. G. “Using Expert Systems to Model and Improve Survey Classification Processes.” U.S. Bureau of Labor Statistics Research Paper ST960070, 1996.

[6] Pang, X., & Werbos, P. “Neural Network Design for J-Function Approximation in Dynamic Programming.” arXiv preprint, 1998.

[7] Rumelhart, D. E., Hinton, G. E., & Williams, R. J. “Learning Representations by Back-propagating Errors.” Nature, Vol. 323, No. 6088, 1986, pp. 533-536. (classic though outside strict 1980-2000 but near)

[8] Luger, G. F. “Artificial Intelligence: Structures and Strategies for Complex Problem Solving.” 2nd ed., Addison-Wesley, 1998. (textbook on AI approaches including rule-based and neural nets)

[9] Gulwani, S., Polozov, A., & Singh, R. “Program Synthesis.” Foundations and Trends® in Programming Languages, Vol. 4, Nos. 1–2, 2017, pp. 1-119.

[10] Mou, L., Men, R., Li, G., Zhang, L., & Jin, Z. “On End-to-End Program Generation from User Intention by Deep Neural Networks.” arXiv preprint arXiv:1510.07211, 2015.

[11] Anand, S., Burke, E. K., Chen, T. Y., Clark, J. A., Cohen, M. J., Grieskamp, W., Harman, M., & McMinn, P. “An Orchestrated Survey of Methodologies for Automated Software Test Case Generation.” Journal of Systems and Software, Vol. 86, 2013, pp. 1978-2001.

[12] Wylie, C. “The History of Neural Networks and AI: Part III.” Open Data Science blog, 2018.

[13] “Grammatical Evolution: Neural Network Synthesis Using Cellular Encoding and Genetic Algorithm.” Proceedings of the 1994 Genetic Programming Conference. (early work on program synthesis via evolutionary methods)

[14] Motsinger-Reif, A. A., & Ritchie, M. D. “Neural Networks for Genetic Epidemiology: Past, Present, and Future.” BioData Mining, Vol. 1, 2008, Article 3

Downloads

Published

2020-11-07

Issue

Section

Articles

How to Cite

[1]
S. B., T. Richard, and P. C., “The Role of Generative Foundation Models in Transforming Software Development and Computational Reasoning”, AIJCST, vol. 2, no. 6, pp. 14–23, Nov. 2020, doi: 10.63282/3117-5481/AIJCST-V2I6P102.

Similar Articles

1-10 of 103

You may also start an advanced similarity search for this article.