Generative AI's Role in Social Science Both in Research Assistance and Analysis
Keywords:
Mixed Method Research, Generative Artificial Intelligence, Large Language Model, Computational Social ScienceAbstract
In an era where generative artificial intelligence technology is continuously growing, especially large language models that are receiving significant attention for their application in assisting various research endeavors, this paper analyzes the evolution of machine learning up to the inception of large language models. The discussion highlights DARPA's projects in integrating qualitative research with advanced computational methods, specifically through the Next Generation Social Science (NGS2) and Ground Truth (GT) projects. Subsequently, these initiatives have evolved into Computational Social Science and mixed method research, which combines qualitative (QUAL) and quantitative (QUAN) research methods, resulting in more diverse and comprehensive research outcomes. However, while generative artificial intelligence holds great potential, there are chances of errors, commonly referred to as "hallucination". This paper addresses measures to enhance accuracy concerning this aspect. Furthermore, the paper also presents practical examples of utilizing generative artificial intelligence for trend detection and automated scenario creation.
References
กอบเกียรติ สระอุบล. (2565). เรียนรู้ AI: Deep Learning ด้วย Python. สำนักพิมพ์ อินเตอร์มีเดีย.
ปริญญา สงวนสัตย์. (2562). Artificial Intelligence with Machine Learning, AI สร้างได้ด้วยแมชชีนเลิร์นนิ่ง. ไอดีซี พรีเมียร์.
Asif, M. A. (2019). Technologies of Power - From Area Studies to Data Science. Journal for Digital Cultures. Spectres of AI, Nr. 5, S. 2019: 1–13. https://doi.org/10.25969/mediarep/13498.
Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H.. (2006). Greedy layer-wise training of deep networks. In Proceedings of the 19th International Conference on Neural Information Processing Systems (NIPS'06). MIT Press, Cambridge, MA, USA, 153-160.
Cioffi-Revilla, C. (2022). The Scope of Computational Social Science. In Handbook of Computational Social Science: Theory, Case Studies and Ethics, Volume 1, edited by Uwe Engel, Anabel Quan-Haase, Sunny Xun Liu and Lars Lyberg, pp. 17-32. London: Routledge.
De Veaux, R. D. and Eck A. (2022). Machine Learning Methods for Computational Social Science. In Handbook of Computational Social Science: Theory, Case Studies and Ethics, Volume 2, edited by Uwe Engel, Anabel Quan-Haase, Sunny Xun Liu and Lars Lyberg, pp. 291-321. Routledge.
Géron, A. (2017). Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligence Systems. O’Reilly Media, Inc.
González, R. J. (2022). War Virtually: The Quest to Automate Conflict, Militarize Data, and Predict the Future. University of California Press.
Hinton, G. E., Osindero, S., and Teh Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Comput, 18(7), 1527-54. http://www.doi.org/10.1162/neco.2006.18.7.1527. PMID: 16764513.
Hong QN, Pluye P, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, Gagnon M-P, Griffiths F, Nicolau B, O’Cathain A, Rousseau M-C, Vedel I. (2018). Mixed Methods
Appraisal Tool (MMAT), version 2018. Registration of Copyright, Canadian Intellectual Property Office, Industry Canada.
Jacobsen, A. (2015). The Pentagon’s Brain: An Uncensored History of DARPA, America’s Top Secret Military Research Agency. Little, Brown and Company.
Jobin, A., Lenca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature machine intelligence, 1(9), 389-399.
King G., Keohane, R. O., Verba, S. (1994). Designing Social Inquiry: Scientific Inference in Qualitative Research. Princeton University Press.
Kublik, S., and Saboo, S. (2022). GPT-3: Building Innovative NLP Products Using Large Language Model. O’Reilly Media, Inc.
Lecun, Y., Bottou, L., Bengio Y., and Haffner P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278-2324. http://www.doi.org/10.1109/5.726791.
Levine, R., Drang, D. E., and Edelson, B. (1991). AI and Expert Systems: A Comprehensive Guide (Second Edition). McGraw-Hill Book Co-Singapore.
Liang, W., Zhang, Y., Cao, H., Wang, B., Ding, D. Y., Yang, X., ... & Zou, J. (2023). Can large language models provide useful feedback on research papers? A large-scale empirical analysis. arXiv preprint arXiv: 2310.01783.
Mahoney, J. (2010). After KKV: The New Methodology of Qualitative Research. World Politics, 62, 120-147. http://doi.org/10.1017/S0043887109990220
Mazzucato, M. (2015). The Entrepreneurial State: Debunking Public vs Private Sector Myths. PublicAffairs.
McCulloch, W.S. and Pitts, W. A. (1943). logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5, 115–13. https://doi.org/10.1007/BF02478259
Morgan, D. L. (2007). Paradigm Lost and Pragmatism Regained: Methodological Implications of Combining Qualitative and Quantitative Methods. Journal of Mixed Methods Research, 1, 48. https://doi.org/10.1177/2345678906292462
Rodriguez, M. Y. and Storer, H. (2019). A computational social science perspective on qualitative data exploration: Using topic models for the descriptive analysis of social media data, Journal of Technology in Human Services. http://doi.org/10.1080/15228835.2019.1616350
Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65(6), 386-408. https://doi.org/10.1037/h0042519
Rumelhart, D., Hinton, G. & Williams, R. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536. https://doi.org/10.1038/323533a0
Russel, S., and Norvig, P. (2022). Artificial Intelligence: A Modern Approach (Fourth Edition) Global Edition. Pearson Education Limited.
Turing, A. (1950). Computing Machinery and Intelligence. Mind, New Series, 59(236), (Oct., 1950), 433-460.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
Woodhouse, I. H. (2021). On ‘ground’ truth and why we should abandon the term. J. Appl. Rem. Sens. 15(4), 041501. https://doi.org/10.1117/1.JRS.15.041501.
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., ... & Wen, J. R. (2023). A survey of large language models. arXiv preprint arXiv: 2303.18223.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 PAAT Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
