<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">dgisocio</journal-id><journal-title-group><journal-title xml:lang="ru">Цифровая социология/Digital Sociology</journal-title><trans-title-group xml:lang="en"><trans-title>Digital Sociology</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2658-347X</issn><issn pub-type="epub">2713-1653</issn><publisher><publisher-name>Государственный университет управления</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.26425/2658-347X-2024-7-3-4-14</article-id><article-id custom-type="elpub" pub-id-type="custom">dgisocio-323</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ЦИФРОВАЯ СОЦИОЛОГИЯ: НАПРАВЛЕНИЯ ИССЛЕДОВАНИЙ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>DIGITAL SOCIOLOGY: RESEARCH AREAS</subject></subj-group></article-categories><title-group><article-title>Опыт применения больших языковых моделей для анализа социологических данных, полученных в результате интервью о восприятии студентами предпринимательской деятельности</article-title><trans-title-group xml:lang="en"><trans-title>Experience in applying large language models to analyse sociological data obtained as a result of interviews on students’ perception of entrepreneurial activity</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9193-4535</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Ашихмин</surname><given-names>Е. Г.</given-names></name><name name-style="western" xml:lang="en"><surname>Ashikhmin</surname><given-names>E. G.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Ашихмин Евгений Георгиевич, Аспирант</p><p>Пермь</p></bio><bio xml:lang="en"><p>Evgenii G. Ashikhmin, Postgraduate Student</p><p>Perm</p></bio><email xlink:type="simple">e.ashikhmin@icloud.com</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-7627-9162</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Левченко</surname><given-names>В. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Levchenko</surname><given-names>V. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Левченко Валерий Витальевич, Д-р психол. наук, зав. каф. социологии и политологии</p><p>Пермь</p></bio><bio xml:lang="en"><p>Valery V. Levchenko, Dr. Sci. (Psy.), Head of the Sociology and Political Science Department </p><p>Perm</p></bio><email xlink:type="simple">levv66@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-3402-3473</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Селеткова</surname><given-names>Г. И.</given-names></name><name name-style="western" xml:lang="en"><surname>Seletkova</surname><given-names>G. I.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Селеткова Гюзель Ильясовна, Ст. преп. каф. социологии и политологии</p><p>Пермь</p></bio><bio xml:lang="en"><p>Gyuzel’ I. Seletkova, Senior Lecturer at the Sociology and Political Science Department</p><p>Perm</p></bio><email xlink:type="simple">guzal.ka@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Пермский национальный исследовательский технический университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Perm National Research Polytechnic University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2024</year></pub-date><pub-date pub-type="epub"><day>20</day><month>10</month><year>2024</year></pub-date><volume>7</volume><issue>3</issue><fpage>4</fpage><lpage>14</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Ашихмин Е.Г., Левченко В.В., Селеткова Г.И., 2024</copyright-statement><copyright-year>2024</copyright-year><copyright-holder xml:lang="ru">Ашихмин Е.Г., Левченко В.В., Селеткова Г.И.</copyright-holder><copyright-holder xml:lang="en">Ashikhmin E.G., Levchenko V.V., Seletkova G.I.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://digitalsociology.guu.ru/jour/article/view/323">https://digitalsociology.guu.ru/jour/article/view/323</self-uri><abstract><p>В современном обществе наблюдается цифровая трансформация различных сфер, связанная с развитием искусственного интеллекта и больших данных. Внедрение больших языковых моделей (англ. large language model, далее – LLM) в научные исследования открывает новые возможности, но и ставит ряд вопросов, в связи с чем актуальным становится изучение особенностей их применения для качественного анализа данных в социологии. Цель – изучить, как большие языковые модели могут влиять на методологию и практику социологических исследований, выявить преимущества и недостатки их применения. Авторы опираются на использование большой языковой модели Calude-3 для качественного анализа эмпирических данных социологического исследования восприятия студентами предпринимательской деятельности. Раскрыты возможности LLM в анализе качественных данных: оценка тональности, построение логических выводов, классификация, кластеризация и формирование типологий. Показаны преимущества использования LLM: увеличение скорости обработки данных, экономия времени и ресурсов. Применение LLM становится инструментом для оптимизации исследовательского процесса в социологии, позволяя углубить анализ качественных данных, но имеет и ряд ограничений: социальная и политическая предвзятость, трудности с галлюцинациями. Необходимы повышение прозрачности моделей, улучшение их интерпретируемости и объяснимости и уменьшение их социальной, политической предвзятости, а также этическое и юридическое регулирование использования моделей LLM.</p></abstract><trans-abstract xml:lang="en"><p>Modern society is experiencing a digital transformation of various spheres associated with the development of artificial intelligence and big data. The introduction of large language models (hereinafter referred to as LLM) into scientific research opens new opportunities, but also raises a number of questions, which makes it relevant to study the peculiarities of their application for qualitative data analysis in sociology. The purpose of this article is to explore how LLM can influence the methodology and practice of sociological research, and to identify the advantages and disadvantages of their application. The authors rely on the use of the Calude-3 LLM to qualitatively analyse empirical data from a sociological study of students’ perception of ­entrepreneurship. The possibilities of LLM in the analysis of qualitative data are revealed: analysis of sentiment, construction of logical conclusions, classification, clustering, and formation of typologies. The advantages of using LLM are shown: increased data processing speed, saving time and resources. The application of LLM becomes a tool to optimise the research process in sociology, allowing to deepen the analysis of qualitative data, but it also has a number of limitations: social and political bias, difficulties with hallucinations. It is necessary to increase the transparency of models, improve their interpretability and explainability and reduce their social and political bias as well as ethical and legal regulation of the use of LLM models.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>Большие языковые модели</kwd><kwd>LLM</kwd><kwd>цифровые инструменты</kwd><kwd>качественный анализ данных</kwd><kwd>анализ интервью</kwd><kwd>методы социологических исследований</kwd><kwd>цифровая трансформация</kwd><kwd>оценка тональности</kwd><kwd>алгоритм предобработки данных</kwd><kwd>кластеризация</kwd></kwd-group><kwd-group xml:lang="en"><kwd>Large language models</kwd><kwd>LLM</kwd><kwd>digital tools</kwd><kwd>qualitative data analysis</kwd><kwd>interview analysis</kwd><kwd>sociological research methods</kwd><kwd>digital transformation</kwd><kwd>sentiment analysis</kwd><kwd>data preprocessing algorithm</kwd><kwd>clustering</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Алексеев Д.В. Использование генеративного ИИ при анализе данных веб-аналитики. Universum: технические науки. 2024;2(119):4–9. http://doi.org/10.32743/UniTech.2024.119.2.16815</mixed-citation><mixed-citation xml:lang="en">Abid A., Farooqi M., Zou J. Large language models associate Muslims with violence. Nature Machine Intelligence. 2021;3:461–463. http://dx.doi.org/10.1038/s42256-021-00359-2</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Аржанова К.А., Писклакова Л.Д. Особенности использования искусственного интеллекта в маркетинговых коммуникациях компаний. Цифровая социология. 2023;6(4):4–12. https://doi.org/10.26425/2658-347X-2023-6-4-4-12</mixed-citation><mixed-citation xml:lang="en">Alekseev D.V. Using generative AL in analyzing web analytics data. Universum: Technical Sciences. 2024;2(119):4–9. (In Russian). http://doi.org/10.32743/UniTech.2024.119.2.16815</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Джибилова Е.Г., Побываев Н.С. Анализ российского и зарубежного опыта применения ChatGPT и искусственного интеллекта в политике и социальной сфере. Социально-гуманитарные знания. 2024;1:64–69.</mixed-citation><mixed-citation xml:lang="en">Arzhanova K.A., Pisklakova L.D. Features of using artificial intelligence in companies’ marketing communications. Digital Sociology. 2023;6(4):4–12. (In Russian). https://doi.org/10.26425/2658-347X-2023-6-4-4-12</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Коваль Е.А. Большие данные и большие вызовы социальному воображаемому. Социальные нормы и практики. 2023;3:54–63. http://doi.org/10.24412/2713-1033-2023-3-54-63</mixed-citation><mixed-citation xml:lang="en">Dehouche N. Plagiarism in the age of massive generative pre-trained transformers (GPT-3). Ethics in Science and Environmental Politics. 2021;21:17–23. http://dx.doi.org/10.3354/esep00195</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Кублик С., Сабу Ш. GPT-3. Руководство по использованию API Open AI. Перев. с англ. В.С. Яценкова. М.: ДМК Пресс; 2023. 172 с.</mixed-citation><mixed-citation xml:lang="en">Durmus E., Nguyen K., Liao Th.I., Schiefer N., Askell A., Bakhtin A. et al. Towards measuring the representation of subjective global opinions in language models. ArXiv. 2024. https://doi.org/10.48550/arXiv.2306.16388</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Летов О.В. Этические аспекты в области разработки искусственного интеллекта. Социальные и гуманитарные науки. Отечественная и зарубежная литература. Серия 3. Философия. 2024;1:34–44. http://doi.org/10.31249/rphil/2024.01.03</mixed-citation><mixed-citation xml:lang="en">Dzibilova Е.G., Pobyvaev N.S. Analysis of Russian and foreign experience in the application of ChatGPT and AI in politics and social sphere. Social and humanitarian knowledge. 2024;1:64–69. (In Russian).</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Раицкая Л.К., Ламбовска М.Р. Перспективы применения ChatGPT для высшего образования: обзор международных исследований. Интеграция образования. 2024;1(28):10–21. https://doi.org/10.15507/1991-9468.114.028.202401.010-021</mixed-citation><mixed-citation xml:lang="en">Eigner E., Händler Th. Determinants of LLM-assisted decision-making. ArXiv. 2024. https://doi.org/10.48550/arXiv.2402.17385</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Семенова В.В. Качественные методы: введение в гуманистическую социологию: учебное пособие для студентов вузов. М.: Добросвет; 1998. 292 с.</mixed-citation><mixed-citation xml:lang="en">Koval E.A. Big data and big challenges to the social imaginary. Social norms and practices. 2023;3:54–63. (In Russian). http://doi.org/10.24412/2713-1033-2023-3-54-63</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Середкина Е.В., Мезин Е.А. Как может повлиять ChatGPT на культуру диалога и образование? Науковедческие исследования. 2023;3:74–79. https://doi.org/10.31249/scis/2023.03.04</mixed-citation><mixed-citation xml:lang="en">Krugmann J.O., Hartmann J. Sentiment analysis in the age of generative AI. Customer Needs and Solutions. 2024;11. http://dx.doi.org/10.1007/s40547-024-00143-4</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Старовойтов А.Г. Исследование возможностей чат-бота ChatGPT и оценка перспектив их практического применения специалистами службы управления персоналом. Journal of Monetary Economics and Management. 2024;1:22–29. https://doi.org/10.26118/2782-4586.2024.75.98.003</mixed-citation><mixed-citation xml:lang="en">Kublik S., Sabоо Sh. GPT-3. The ultimate guide to building NLP products with Open AI API. Trans. from Eng. V.S. Yatsenkov. Moscow: DMK Press; 2023. 172 p. (In Russian).</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Татарова Г.Г., Бабич Н.С., Бессокирная Г.П., Кученкова А.В. Типологический анализ в социологии как диагностическая процедура: монография. М.: Федеральный научно-исследовательский социологический центр Российской академии наук; 2023. 358 с.</mixed-citation><mixed-citation xml:lang="en">Letov O.V. Ethical considerations in artificial intelligence development. Social sciences and humanities. Domestic and foreign literature. Series 3. Philosophy. 2024;1:34–44. (In Russian). http://doi.org/10.31249/rphil/2024.01.03</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Шюц А. Обыденная и научная интерпретация человеческого действия. В кн.: Избранное. Мир, светящийся смыслом. Пер. с нем. и англ. В.Г. Николаева. М.: РОССПЭН; 2004. С. 7–50.</mixed-citation><mixed-citation xml:lang="en">Linegar M., Kocielnik R., Alvarez R.M. Large language models and political science. Frontiers in Political Science. 2023;5. http://dx.doi.org/10.3389/fpos.2023.1257092</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Ядов В.А. Стратегия социологического исследования. Описание, объяснение, понимание социальной реальности. 3е изд., перераб. и доп. М.: Омега-Л; 2007. 567 с.</mixed-citation><mixed-citation xml:lang="en">Manning Ch.D. Human language understanding &amp; reasoning. Daedalus. 2022;2(151):127–138. http://dx.doi.org/10.1162/daed_a_01905</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Abid A., Farooqi M., Zou J. Large language models associate Muslims with violence. Nature Machine Intelligence. 2021;3:461–463. http://dx.doi.org/10.1038/s42256-021-00359-2</mixed-citation><mixed-citation xml:lang="en">Markowitz D.M. Can generative AI infer thinking style from language? Evaluating the utility of AI as a psychological text analysis tool. Behavior Research Methods. 2024;56:3548–3559. http://dx.doi.org/10.3758/s13428-024-02344-0</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Dehouche N. Plagiarism in the age of massive generative pre-trained transformers (GPT-3). Ethics in Science and Environmental Politics. 2021;21:17–23. http://dx.doi.org/10.3354/esep00195</mixed-citation><mixed-citation xml:lang="en">Motoki F., Neto V.P., Rodrigues V. More human than human: measuring ChatGPT political bias. Public Choice. 2024;198:3–23. http://dx.doi.org/10.1007/s11127-023-01097-2</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Durmus E., Nguyen K., Liao Th.I., Schiefer N., Askell A., Bakhtin A. et al. Towards measuring the representation of subjective global opinions in language models. ArXiv. 2024. https://doi.org/10.48550/arXiv.2306.16388</mixed-citation><mixed-citation xml:lang="en">Raitskaya L.K., Lambovska M.R. Prospects for ChatGPT application in higher education: a scoping review of international research. Integration of education. 2024;1(28):10–21. (In Russian). https://doi.org/10.15507/1991-9468.114.028.202401.010-021</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Eigner E., Händler Th. Determinants of LLM-assisted decision-making. ArXiv. 2024. https://doi.org/10.48550/arXiv.2402.17385</mixed-citation><mixed-citation xml:lang="en">Schütz A. Common-sense and scientific interpretation of human action. In: Favourites. A world glowing with meaning. Trans. from Germ. and Eng. V.G. Nikolaev. Moscow: ROSSPEN; 2004. Pp. 7–50. (In Russian).</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Krugmann J.O., Hartmann J. Sentiment analysis in the age of generative AI. Customer Needs and Solutions. 2024;11. http://dx.doi.org/10.1007/s40547-024-00143-4</mixed-citation><mixed-citation xml:lang="en">Semyonova V.V. Qualitative methods: an introduction to humanistic sociology: textbook for university students. M.: Dobrosvet; 1998. 292 p. (In Russian).</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Linegar M., Kocielnik R., Alvarez R.M. Large language models and political science. Frontiers in Political Science. 2023;5. http://dx.doi.org/10.3389/fpos.2023.1257092</mixed-citation><mixed-citation xml:lang="en">Seredkina E.V., Mezin E.V. How can ChatGPT affect the culture of dialogue and education? Science Studies. 2023;3:74–79. (In Russian). https://doi.org/10.31249/scis/2023.03.04</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Manning Ch.D. Human language understanding &amp; reasoning. Daedalus. 2022;2(151):127–138. http://dx.doi.org/10.1162/daed_a_01905</mixed-citation><mixed-citation xml:lang="en">Starovoitov A.G. Research of ChatGPT chatbot capabilities and assessment of prospects for their practical application by HR specialists. Journal of Monetary Economics and Management. 2024;1:22–29. (In Russian). https://doi.org/10.26118/2782-4586.2024.75.98.003</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Markowitz D.M. Can generative AI infer thinking style from language? Evaluating the utility of AI as a psychological text analysis tool. Behavior Research Methods. 2024;56:3548–3559. http://dx.doi.org/10.3758/s13428-024-02344-0</mixed-citation><mixed-citation xml:lang="en">Tatarova G.G., Babich N.S., Bessokirnaya G.P., Kuchenkova A.V. Typological analysis in sociology as a diagnostic procedure: monograph. Moscow: Federal Center of Theoretical and Applied Sociology of the Russian Academy of Sciences; 2023. 358 p. (In Russian).</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Motoki F., Neto V.P., Rodrigues V. More human than human: measuring ChatGPT political bias. Public Choice. 2024;198:3–23. http://dx.doi.org/10.1007/s11127-023-01097-2</mixed-citation><mixed-citation xml:lang="en">Turner J.C., Reynolds K.J. Self-categorization theory. In: Handbook of theories of social psychology. Volume 2. New York: SAGE Publications; 2012. Pp. 399–417.</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Turner J.C., Reynolds K.J. Self-categorization theory. In: Handbook of theories of social psychology. Volume 2. New York: SAGE Publications; 2012. Pp. 399–417.</mixed-citation><mixed-citation xml:lang="en">Yаdov V.A. Strategy of sociological research. Description, explanation, understanding of social reality. 3rd ed., revised and enlarged. Moscow: Omega-L; 2007. 567 p. (In Russian).</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
