31st March 2023
Editorials
Context:
A U.S. company, OpenAI, has once again sent shock waves around the world, this time with GPT4, its latest AI model. This large language model can understand and produce language that is creative and meaningful, and will power an advanced version of the company’s sensational chatbot, ChatGPT.
GPT4 and features:
- Accept text and image input simultaneously- GPT4 is more conversational and creative. Its biggest innovation is that it can accept text and image input simultaneously, and consider both while drafting a reply.
- Understand Human Emotions- The model can purportedly understand human emotions, such as humorous pictures. Its ability to describe images is already benefiting the visually impaired.
- Can deal with larger prompts- While GPT3.5 could not deal with large prompts well, GPT4 can take into context up to 25,000 words, an improvement of more than 8x.
Ethical questions:
- No transparency about inner working- The GPT4 technical report clearly states that it has no information about the architecture (including model size), hardware, training compute, dataset construction, training method of the same.
- Privacy issues-. It retains the user’s data and sensitive information, which can pose a threat if the data gets misused.
- Trained on biases which are only known in western culture- There is a possibility that the moderator model is trained to detect only the biases we are aware of, and mostly in the English language. This model may be ignorant of stereotypes prevalent in non-western cultures, such as those rooted in caste.