Unsupervised pre-training is a term from the fields of Artificial Intelligence and Digital Transformation. It describes a method by which computers learn independently from large amounts of data, without a human explicitly telling them what is right or wrong. The goal is for the systems to discover correlations and structures in the data so they can be used for various tasks later on.<\/p>\n
Imagine a clever computer reading millions of texts on the internet to understand the German language. During unsupervised pre-training, the computer is given these texts, but no one tells it what a \u201edog\u201c is, for example. The system therefore looks for patterns on its own \u2013 for instance, that the word \u201eHund\u201c (dog) often appears alongside \u201ebellen\u201c (to bark) \u2013 and stores this knowledge.<\/p>\n
Later, the trained system can be used for specific tasks, such as writing automatically generated texts or answering questions. For example, unsupervised pre-training is often used nowadays for voice assistants like Siri or Alexa to make them more intelligent and provide answers that are oriented towards actual language and user needs.<\/p>","protected":false},"excerpt":{"rendered":"