본문 바로가기

입트영

The Transformer Algorithm and English Studies

사진: Unsplash 의 Emiliano Vittoriosi

 

ChatGPT is an AI chatbot based on a pre-trained generative natural language processing system. The technology used here is the Transformer algorithm developed by Google in 2017.

This Transformer algorithm is remarkably similar to the conversational style we humans use. Even without free will, ChatGPT is capable of naturally engaging in conversations with humans. Seeing this, I found myself questioning whether the words we speak as humans are expressions of our free will, or if we are saying familiar phrases as a matter of probability.

I also contemplate a similar idea for English speaking practice. If we speak in English as much as possible, and thereby increase the likelihood of using English expressions, it could lead to more natural English speaking, similar to the principles behind ChatGPT.

 

engage in conversation - to start a conversation with someone

increase likelihood -  increasing the probability that something else will happen

 

ChatGPT는 사전에 훈련된 생성형 자연어 처리 시스템 기반의 AI 챗봇이다. 여기에 활용되는 기술은 2017년 구글에서 개발한 트랜스포머 알고리즘이다. 

이러한 트랜스포머 알고리즘은 인간이 사용하는 대화 방식과 정말 유사하다. 자유의지가 없는 ChatGPT도 사람과의 자연스러운 대화가 가능해졌다. 이러한 모습을 보면서 나는 우리 인간이 하는 말이 우리의 자유의지를 통해서 내뱉는 것인지 확률적으로 익숙한 말을 내뱉는 것인지 의구심마저 들었다.

영어 말하기 훈련도 마찬가지라는 생각을 해 본다. 영어로 최대한 말을 많이 해보며 영어 표현 구사 확률을 높인다면 ChatGPT의 원리처럼 더 자연스러운 영어 발화가 되지 않을까 싶다.

 

  • It’s not easy to engage in conversation with strangers. / She has the ability to engage in conversation with anyone.
  • We can increase the likelihood of success if we work together. / Pollution is increasing the likelihood of extreme weather events.
  • Most people don’t understand the principles behind mobile devices. / You don’t need to know the principles behind it to appreciate it. 

A: When I talk with ChatGPT these days, it feels just like I’m talking to a real person.

B: I often feel the same way.

A: If we train consistently with ChatGPT, our English skills are sure to improve, right?

B: Yes, with constant practice, we can develop expressions that we say instinctively.

A: That’s right.

B: We should actively make use of ChatGPT to practice speaking and listening in English.