N Harfi 👁 26 views

Natural Language Processing / NLP

The area that allows computers to understand, comment and produce human language.

Natural language processing (Natural Language Processing, NLP) is the subfield of artificial intelligence and computer science, which enables computers to communicate, analyze and manufacture human language -software or verbal understanding, interpretation, analysis. Since the human language is filled with uncertainty, context dependence, civil and cultural references, it has been a difficult problem for many years to convert it into a structured form that a computer can work. NLP; machine translation (translate text from one language to another), feeling analysis ( determining the emotional tone of a text), text abstracting, asset name recognition (person, location, corporate names), question answering and chat bots cover a wide range of tasks.

The history of the field has shown that from rule-based systems in 1950-60s, statistical methods in 1990-2000s, word embedding in 2010s and repetitive nerve networks, and finally an evolution towards large language models with the post 2017 Transformer architecture. This last conversion area has changed from root: apart, special trained models are required for each NLP task (translation, summarization, classification), today a single large language model can perform almost all of these tasks with a reasonable success when given an appropriate instruction. For this reason, NLP has become one of the most visible branches of today’s artificial intelligence area.