What is the Technology behind ChatGPT?
ChatGPT uses deep learning -- a subset of machine learning -- to produce humanlike text through transformer neural networks. The transformer predicts text, including the next word, sentence or paragraph, based on its training data's typical sequence.
Training begins with generic data, then moves to more tailored data for a specific task. ChatGPT was trained with online text to learn the human language, and then it used transcripts to learn the basics of conversations.
Human trainers provide conversations and rank the responses. These reward models help determine the best answers. To keep training the chatbot, users can upvote or downvote its response by clicking on "thumbs up" or "thumbs down" icons beside the answer. Users can also provide additional written feedback to improve and fine-tune future dialogue.
