Large language models: pre-training with a twist
The next DG CNECT technical workshop will take place on 14 June 2022 (10-16 CEST) via Zoom
In future-oriented AI, large language models (LLMs) are on the pulse of time. Combining the latest deep learning technology with heavy computing infrastructure now enables academic or commercial organisations to build language models from large amounts of text or speech data. Such models incorporate information that is useful for understanding a language, such as its vocabulary and how it expresses meaning.
Starting from such pre-trained LLMs, other organisations can train additional models for their specific applications (e.g., automated translation, summarisation, dialogue interaction, speech recognition) or domains, using much less data and computing power. That is why the process of “specialising” a pre-trained model is gaining a large impact on the field of natural language processing.
Organised by the Multilingualism sector of DG CNECT, the online workshop Large Language Models: pre-training with a twist will take place on 14 June from 10:00 to 16:00 CEST via Zoom. In this workshop, which is primarily oriented towards staff of EU institutions and European public administrations, top-level speakers will discuss various aspects of pre-trained LLMs, such as:
- how to make use of models available from repositories.
- how to specialise multilingual models, for instance for automated translation.
- how to leverage models in specific use cases, within public administrations and industry.
- how to consider legal aspects of models.
The event is part of a series of technical workshops in the ELRC project, which supports the development of eTranslation, the online machine translation service provided by the European Commission, and a wider deployment of the DG's services in terms of language resources and tools. The detailed workshop agenda can be found on the event webpage.
Interested? Then register here to participate!
