November 14th, 2024 – h. 15.00 – Sala riunioni primo piano
The PhD student Fariha Maqbool will summarize the summer school she has attended in order to award her academic credits, giving an introductory talk on the topics of the school.
Talk title:
Transformers – A Revolution in NLP and ML
Abstract:
The introduction of the Transformer architecture in the paper titled “Attention Is All You Need” by Vaswani et al. revolutionized the field of artificial intelligence, particularly natural language processing (NLP). Today, Transformer-based models are achieving state-of-the-art results in tasks ranging from machine translation and text summarization to image generation and even protein folding prediction. In this talk, I will discuss how this journey that started with simple perceptron, led us to powerful language models that can generate human-like text, answer questions, and even engage in creative writing. This talk will take a deep dive into the concepts and high level architecture of transformer model including Encoder, Decoder and Attention Mechanism.
Everyone is invited to participate
Recent Comments