2024.09 - Present | Yonsei Graduate School, Human and Artificial Intelligence Research (HAIR) Lab
Researcher
Proposed a framework to assess the alignment between AI ethical guidelines and laws, finding an average cosine similarity score of 0.51, and suggested measures to improve coherence and consistency for AI regulation.
Conducted a usability study on Large Language Models (LLMs) like GPTs and ChatGPT Chrome Extensions in academic writing, identifying their potential to automate routine tasks with an average of 0.31 errors per use for GPTs while highlighting ethical concerns and proposing responsible usage guidelines.
Invented a Reinforcement Learning agent using a text-based game to mimic human decision-making and behavior through prompt engineering, achieving human-comparable performance with no statistically significant difference.
2023.06 - 2024.07 | NC Cultural Foundation, Business Development Team
Manager
Coined the term FAIR AI (Faithful, Accountable, Inclusive, Responsible AI) to represent all AI ethics-related projects within the AI ethics business team, drawing on widely used terminology in AI ethics.
Launched the first AI ethics repository website in South Korea under the name FAIR AI, addressing the absence of such a platform in the country.
Planned and designed all content and structure for the FAIR AI website from its inception, overseeing IT tasks essential for the website’s development and launch.
Authored all content for the repository, including introductions to FAIR AI and AI ethics, covering a wide range of topics and gaining 8,000+ monthly views and 17000+ unique visitors over a four-month period (from May 2023 to August 2023).
Compiled and curated all resources for the repository, including 6,000+ academic papers, 2,500+ news articles, 200+ reports, 35 ethical guidelines, 40 reference websites, and all AI ethics-related curricula and majors from the top 100 universities in computer science.
Organized the first AI ethics conference “FAIR AI 2024” in collaboration with KAIST, by managing invitations for 17 renowned speakers with 200+ opinion leaders, as well as creating key presentation materials and lecture content.
Created training data for the keyword search functionality of the Augmentative and Alternative Communication (AAC) application and the FAIR AI website.
Authored AI ethics blog posts and translated and edited all internal Korean documents into English. Attended 20+ AI ethics conferences to stay updated on trends and acquire insights.
2022.03 - 2023.08 | Yonsei Graduate School, Human and Artificial Intelligence Research (HAIR) Lab
Graduate Researcher
Pioneered a new approach by developing two models: a legal status classifier and an emotional classifier using Bidirectional Encoder Representations from Transformers (BERT). The legal status classifier was trained on legal data to determine how AI laws attribute legal status to AI entities. The emotional classifier, trained on matched data of tweets and emotional tones, analyzed public sentiment toward AI. Identified mismatches between legal definitions and public perceptions, providing insights for practical policy adjustments.
Analyzed the impact of AI ethics on user engagement and demonstrated that ethical improvements in chatbots like Lee Ruda 2.0 led to sustained growth and increased user trust by 27%.
2022.03 - 2023.08 | Yonsei Graduate School
M.S. in Innovation (Advisor: Professor Keeheon Lee) (Full-tuition Scholarship)
2018.03 - 2022.02 | Yonsei University
B.A. in Science Technology and Policy (STP), Humanities, Art and Social Sciences Division (HASS) (Academic Honor Roll)
B.A. in Psychology (Academic Honor Roll)
2015.03 - 2018.02 | Myungduk Foreign Language High School
Majored in Russian (Academic Excellence Award, Ranked 1st Place in English)
President of P.O.P (Passion of Psychology) Club
2023.08 | Korea Arts and Culture Committee
The 4th Ideathon for "The World Changed by Art Data" ($2,246)
Excellence Award
Topic: “Personalized Art/Culture Course Recommendations Using Big Data”
2022.03 – 2023.08 | Yonsei Graduate School
Integrated BA/MS Degree Full-tuition Scholarship ($16,533)
Awarded to the highest-performing student each semester (only one recipient per semester).
Teaching Assistant Scholarship ($5,764)
Opportunity is given to the highest-performing student once a year.
Graduate School Innovation Monitoring Group Scholarship ($749)
Institute of Convergence Science (ICONS) Interdisciplinary Research Scholarship ($1,497)
Selected as one of the top 10 graduate students at Yonsei Graduate School for excellence in research ideas and proposal writing.
Social Innovation Activity Scholarship (Educational Activities) ($749)
2018.03 – 2021.12 | Yonsei University
Academic Honor Scholarship: Underwood Truth Scholarship ($1,714)
Higher Education Innovation Institute Educational Scholarship ($357)
Enhance responsible AI governance through critical evaluation and refinement of ethical frameworks
Contribute to policy frameworks that promote transparency, accountability, and inclusivity in AI development
Assess and improve coherence between AI ethical guidelines and legal regulations
Design human-centered AI models that prioritize well-being by aligning innovation with core human values
Investigate the intersection of psychology, particularly happiness and personality, with AI development
Apply cognitive science principles to AI for advancing human-centered technologies
Building a Consensus: Harmonizing AI Ethical Guidelines and Legal Frameworks in Korea for Enhanced Governance
Lee, J.W., & Lee K. (2024)
Government Information Quarterly, Under Review
Artificial Intelligence (AI) permeates various technologies including information and communication technology, significantly reshaping societal practices and individual routines. While this offers benefits, it also prompts concerns about the negative changes of AI, requiring careful governance. This paper focuses on mitigating these risks by offering recommendations for establishing coherent legal frameworks to safeguard innocent individuals from AI-related threats or potential harm, whether intentional or unintentional. We propose a framework that utilizes a large language model to assess the alignment between AI ethical guidelines and bills. A case study is conducted to analyze the Korean regulatory landscape, since Korea’s AI legal frameworks particularly lag behind amid its rapid advancement of technology. This study employs a range of methods - descriptive, correlation, cluster, and semantic analyses - to offer a comprehensive comparison of Korea’s legislative documents. Our findings reveal continuity in certain aspects but discontinuity in others between these two governance tools. Consequently, we suggest measures to enhance the consistency between these two realms for AI regulation, contributing to more robust and effective AI governance practices.
Lee, J.W., & Lee K. (2023).
Proceedings of the Fall Conference of the Korean Institute of Industrial Engineers, 3534-3554.
The advent of Large Language Models (LLMs) has potential efficiencies in information retrieval, notably in acquiring expert knowledge. This study aimed to compare the quality of responses derived from human expert interviews against those generated by ChatGPT in subfields within Industrial Engineering. Interview questions in fields of 'Technology Forecasting' and 'UI/UX' were asked to ChatGPT. Text similarity models were utilized to compare the responses made by human experts and ChatGPT, while the quality of contents were compared through qualitative analysis. Quantitative analysis revealed high similarity scores in both subfields, with UI/UX responses exhibiting slightly higher scores. Furthermore, responses to factual-based questions yielded higher similarity scores than those to personal queries. The findings suggest that LLMs can serve as viable alternatives for information retrieval, providing responses of comparable quality to those of human experts.
Automating Academic Tasks with ChatGPT: A Usability Study.
Lee, J.W.*, Svetasheva, A.*, Lee K. (2023).
Proceedings of the Fall Conference of the Korean Institute of Industrial Engineers, 3511-3533.
The advent of AI models, particularly Large Language Models (LLMs) like ChatGPT, is being widely used in the educational sector, serving as an effective tool to perform routine tasks. This study was conducted to analyze the efficacy of ChatGPT plugins and extensions in Chrome browsers in automating routine academic tasks such as information retrieval, summarization, language translation, and text formatting, and to gauge the perceived efficiency gains by users. This research concentrated on the Human-Computer Interaction (HCI) facets of these tools. This study employed a methodology comprising usability tests, questionnaires, and interviews with participants of varying experience levels. The results proved that ChatGPT plugins and Chrome extensions could significantly automate routine tasks, with users perceiving notable efficiency gains and rating above-average scores on the System Usability Scale (SUS) for these tasks. There were no significant differences in performance between highly experienced and inexperienced participants in terms of time and error rates. However, disparity in the SUS scores and a divergence in the ethical perspectives on using AI tools in academia was noted, with inexperienced participants deeming it unethical, contrary to their experienced counterparts. This research has implications on the use of LLMs like ChatGPT in the academic fields.
Large Language Models as Potential Interviewees: Focused on ChatGPT.
Lee, J.W., & Lee K. (2023).
Proceedings of the Spring Conference of the Korean Institute of Industrial Engineers, 720-731.
The advent of large language models, such as ChatGPT, has revolutionized the way we interact with artificial intelligence. These models have the potential to save time and effort in obtaining information, including expert knowledge, through their ability to generate human-like responses. This study aims to compare the quality of interview responses generated by ChatGPT with those provided by human experts. A sample of interview prompts were collected to cover the topic of biology, and responses were collected from ChatGPT and human experts in each domain. The responses were then analyzed to measure the similarities in terms of validity and trustworthiness. Additionally, the efficiency and convenience of obtaining responses from ChatGPT were evaluated in comparison to traditional expert interviews. Preliminary findings suggest that ChatGPT can generate responses that are similar to those provided by human experts in terms of quality, validity, and trustworthiness. However, differences were also observed in terms of nuanced responses and expert insights, which may be attributed to the limitations of language models in capturing domain-specific knowledge and context. Despite these differences, the use of ChatGPT as an alternative source of information has the potential to save time and effort in obtaining expert insights, thereby increasing efficiency and convenience. The results of this study contribute to the growing body of literature on the use of large language models in obtaining expert knowledge and highlight their potential benefits and limitations. This research has implications for various fields, including information retrieval, data analysis, and decision-making, where the use of language models can provide a valuable alternative to traditional expert interviews.
Maintaining Biodiversity: Focused on The U.S. Endangered Species Act and Korea's Wildlife Act.
Lee, J.W., & Lee S.G. (2022).
Asia Pacific Journal of Health Law & Ethics, 16(1), 211-268.
Biodiversity acts as an important factor in protecting not only the ecosystem but also humans all over the world. However, currently due to indiscriminate development, biodiversity is being destroyed. In order to maintain biodiversity, it is crucial to protect endangered species. Even though both the United States and Korea have laws to protect endangered species, contrary to the outstanding achievements shown by the Endangered Species Protection Act (ESA) of the United States, Korea’s Wildlife Protection and Management Act (Wildlife Act) is not showing high effects. Hence, with the aim of promoting biodiversity, by analyzing the similarities and differences between the two Acts, this study determined what improvements can be made to Korea’s Wildlife Protection and Management Act. The similarities between the two Acts were regarded as the strengths of Korea’s Wildlife Protection and Management Act, which were 1) protection of habitat and successful execution of the law, 2) inclusion of both native and foreign endangered species, 3) adequate period of evaluation, and 4) clarity on the ministry and office concerned. On the other hand, differences were regarded as the limitations of Korea’s Wildlife Protection and Management Act, which were 1) lack of specificity and broad scope of aid, 2) lack of specific categorization, 3) lack of priorities, 4) lack of stability and long-term effects, and 5) lack of social consensus. Therefore, amendments such as specifically mentioning the method, contents, and standards of reward, adding a ‘candidate species’ category, prioritizing certain species, securing a sufficient amount of budget, creating a single specialized ministry that comprehensively manages matters related to endangered species, maintaining the Korean Wildlife Act for a while to increase its stability, and increasing public interest by clarifying the specific amount of rewards and penalties, ways of education provision regarding endangered species, and simple methods for protecting endangered species and so on are recommended to be made in Korea’s Wildlife Protection and Management Act.
Assessing AI Policy Using a Legal Status Classifier: Three Case Studies.
Lee, J.W., & Lee K.
In preparation for submission
With the rapid development of artificial intelligence (AI) technology, AI policy plans are being suggested. However, no precise policies are established, nor are the evaluation criteria on AI policy proposals’ effectiveness adequate. Hence, this study presents a comprehensive framework for analyzing the legal status of three AI conversational agents to determine their necessary policies and evaluate the effectiveness of AI policies through comparison. By analyzing the reviews on conversational agents using Bidirectional Encoder Representations from Transformers (BERT) for legal status classification, the type of legal status and the degree to which a review aligns with that status was identified. Character AI had the highest level of legal status among the conversational agents, while differences in legal status intensities were mainly found depending on region. This study has significance for analyzing the mismatch between AI policy plans and policies needed for conversational agents, and suggesting the importance of AI policy improvements.
Emotional Responses Depending on Demographic Differences: A Comparative Analysis of Lee Luda, Character AI, and ChatGPT.
Lee, J.W., & Lee K.
In preparation for submission
Due to the increased variation on the types of conversational agents, user’s emotions differ depending on the different characteristics of such agents. In this study, response data on 3 different types of conversational agents from various platforms were analyzed using Bidirectional Encoder Representations from Transformers (BERT) for emotion classification. The results provided emotional intensity scores for four basic emotions. Characteristics of reviewers were analyzed using a model to predict the demographic information and cluster reviewers into groups to analyze how different attributes influenced the type and intensity of emotion expressed towards such agents. Our findings indicated a fascinating pattern: Lee Luda elicited the highest intensity of emotion, primarily negative, such as anger and sadness. All three conversational agents had the lowest score for joy among the four emotions. We contribute to designing and regulating conversational agents in a way that is fairer and beneficial to everyone.
Analysis of the Relationship Between Emotion and Legal Status: Based on South Korea's AI Policy.
Lee, J.W., & Lee K.
In preparation for submission
"I'll Do the Prompting, Who'll Write My Literature Review?": Using AI to Automate Routinzed Academic Tasks.
Lee, J.W.*, Svetasheva, A.*, & Lee K.
In preparation for submission
Routinized academic tasks are repetitive activities with uniform procedures. They are simple and timeconsuming but essential in research. The recent Large Language Models (LLMs) transform tools to assist academic works but they are criticized by their questionable credibility and efficiency. To clarify this, we conducted a usability study with a particular focus on GPTs and ChatGPT Chrome Extensions in academic writing. For GPTs, our customized GPT ‘Research AIde’ was used, while participants independently selected Chrome Extensions they deemed most effective for their tasks. Three experience-based groups of 30 participants shared user experience, functionality, ethical considerations, future applications in using AI in academia. We find that LLMs automates routinized tasks but has ethical problems. From this, we draw guidelines for responsible but effective use of AI in academia.
LLM as a Reinforcement Learning Agent in a Text-based Game.
Svetasheva, A.*, Lee, J.W.*, Kang Y., & Lee K.
In preparation for submission
As Large Language Models (LLMs) develop and their accessibility increases, the opportunities for agents to make better decisions increase. In this study, we introduce a text-based game as a way to improve Reinforcement Learning (RL) agent's decision-making process. We explore how the agent acts in a text-based horror game and how the agent's persona influences its game-playing performance. We found that the non-instructional elements in the game can effectively train the agent and lead to more realistic behaviour. Furthermore, we utilized prompt engineering to make an LLM imitate the personal characteristics of human participants. Our result shows that the scores and success rates between the LLM and humans were statistically similar although there were significant differences in time. This underscores the possibility of LLMs mimicking human-like gameplay behaviour in text-based games. We conclude that there is a potential to advance both RL and AI-driven persona emulation within non-instructional contexts.
Automated Language Exam Question Generation System.
Um, S.*, Lee, J.W.*, Song, G.*, Lee, S.*, & Park, T., Yonsei University University-Industry Foundation, 10-2023-0138070
Industry-University Cooperation Project with NAVER Financial: "Automatic Data Quality (AutoDQ)."
Um, S.*, Lee, J.W.*, Kim, Y.*, Kim, H.*, & Jeong, J.*, Yonsei University Data Science Lab
Executed AutoDQ tasks to recognize word patterns for data cleaning. Refined payment data by retaining necessary information, inferring missing transaction details, and standardizing merchant names. Achieved 100% accuracy on company-provided data.
Modeling Project: "AuTOEIC: Auto-making exams of TOEIC Listening Section."
Um, S.*, Lee, J.W.*, Song, G.*, & Lee, S.* Yonsei University Data Science Lab
Developed an AI-driven automated system for generating TOEIC task 1 questions, creating images and multiple choices consisting of 1 correct answer, 2 attractive distractors, and 1 incorrect option, achieving 98% accuracy.
EDA Project: "Han River Picnic: When is the Best Time to go Avoiding Air Pollution?"
Lee, J.W.*, Kim, S.*, Park, S.*, Lim, S.*, Cho, S.*, & Cho, E.*, Yonsei University Data Science Lab
As the project leader, constructed a model to determine the optimal time to visit Han River Park across five districts by analyzing air pollution data and composition, using statistical verification methods. Accurately predicted visits, which aligned with good weather conditions.
Industry-University Cooperation Project with Freewheelin Inc.: "Establishment of Student Progress Indicators and Clustering of Student Types."
Kim. C.*, Lee, J.W.*, Jeon. J.*, Jang. J.*, Cho. S.*, & Han, Y.*, Yonsei University Data Science Lab
Created a skill measurement index, performed clustering of student types through K-means Time Series Clustering, and created an embedding-based correct answer rate prediction model to improve student grades, achieving over 90% accuracy.
Modeling Project: "Cafe Recommendation System Using Reviews, Star Ratings, and Keywords."
Kim, K.*, Park, J.*, Lee, S.*, Lee, J.W.*, & Kim, J.*, Yonsei University Data Science Lab
Developed a cafe recommendation system by utilizing dimensionality reduction, CBF, CF and A3NCF algorithms, leveraging both quantitative review data and text-based reviews. Achieved high accuracy with root-mean-square deviation (RMSE) values ranging from 0.5 to 1.0.
EDA Project: "Can Human Personalities Change?"
Lee, J.*, Yoo, Y.*, Jang. J.*, Lee, J.W.*, Choi. Y.*, & Hwang, J.*, Yonsei University Data Science Lab
Led a project analyzing environmental factors influencing changes in human personality traits, utilizing psychological propensity data and examining trait variations across different socio-demographic groups.
2023.09 | Yonsei University STP – Seoul National University STS 5th Workshop
Served as a designated discussant on “The ‘Real’ 21st Century Relationship: Human & AI-Chatbot.”
2023.05 | Spring Academic Conference, Korean Association of IT Services
Handled protocol and interpretation for VIPs (The British, Australian, Estonian Ambassador to South Korea).
2022.05 - 2023.06 | Data Science Lab (DSL), Yonsei University Club
8th Member
Acquired knowledge by studying various types of advanced statistics, data analysis methods, data mining methods, AI algorithms, deep learning, and Python programming by completing basic, main, and advanced sessions.
Achieved leadership skills as a team leader of 10 people in exploratory data analysis (EDA) projects and Natural Language Processing (NLP) intensive studies.
Participated in five study groups, engaging in weekly discussions and presentations on data science and AI. (Recommendation Systems Modeling, NLP Modeling, Object Oriented Programming, Linear Algebra, and GNN Intensive Study).
2022.05 | Yonsei University STP – Seoul National University STS 4th Workshop
Served as a designated discussant on “Cyborg Technology: Focused on the Medical Field.”
2024.09 - 2024.12 | Yonsei Graduate School
Teaching Assistant
Human-Centered Technology Policy
2022.03 - 2023.06 | Yonsei Graduate School
Teaching Assistant
Statistical Analytic Methods
Introduction to Science, Technology, and Policy
Legal Approach to Health and Technology
Policy Analysis
Seminar on Sustainable Development Goals
2018.03 – 2018.06 | Yonsei University
Undergraduate Mentor, "Free Semester System Mentoring"
Guided middle school students in academic and personal development, fostering critical thinking and independent learning skills.
Software
🖥️ Python (Proficient), R (Intermediate), SPSS (Intermediate), MATLAB (Basic), Visual Studio (Intermediate), Crawling (Intermediate), MS Office Word, PowerPoint, Excel (Proficient)
Languages
Korean 🇰🇷 (First language), English 🇺🇸 🇬🇧 (Fluent), Russian 🇷🇺 (Basic)
Interests
Tennis 🎾 (Bronze Medal🥉, Yonsei Tennis Club YUTT), Hiking ⛰️ (Twice a month), Riding Bicycles 🚲, Global Travel 🧳(25+ Countries), Watching Football Matches in Person ⚽🏟️ (30+), Preparing for Christmas Parties🎄
Personality
Extroverted 😆, Collaborative 🤗, Organized 📝, Diligent 🤓, Enthusiastic 💪, Imaginative 💭, Creative 💡
I enjoy taking on new challenges and exploring uncharted territories. 🔍
Due to my father's profession, I had the privilege of experiencing life abroad from an early age.
I attended the International School of Amsterdam (ISM) from pre-kindergarten to first grade 🇳🇱🧡
I continued my education at The Marist School in the UK from second to fourth grade. I received the highest academic achievement award, had the privilege of enjoying tea with the principal, and was unanimously elected to the pupil council! 🇬🇧💂
In fifth grade, I continued my education at The British International School in Moscow (BISM). 🇷🇺🪆
These international experiences allowed me to immerse myself in various cultures, make friends from all over the world, and build connections that I still cherish and maintain to this day! 🥰
In Person 👋
Yonsei University, Human and Artificial Intelligence Research (HAIR) Lab
Room 310, Veritas Hall B, Yonsei University 85 Songdogwahak-ro, Yeonsu-gu, Incheon 21983, Republic of Korea
Email 📧
[personal] jaewoolee7@naver.com | jaewoolee1118@gmail.com
[official] jaewoolee77@yonsei.ac.kr
On the Web 🌐
Find me on Linkedin
[PRESENT: Researcher] Human and Artificial Intelligence Research (HAIR) Lab at Yonsei University