Far from being invented in late 2022, Large Language Models like ChatGPT find their roots in well established, multiple decades old literature in Machine Learning. In this talk, as such, Niccolo’ Gentile will first introduce the main algorithm behind said models, called Transformers, hence explaining what exactly happens from prompt inputting to sentence generation. Then, he will present one of his most recent publications, titled “Shaping Explanations: Semantic Reward Modeling with Encoder-Only Transformers for GRPO”, where said models, within an innovative training framework, are leveraged to address the famously challenging Italian Faculty of Medicine Admission test, with broader implications for pedagogical tasks
Friday, 26 June, the 10th edition of the Grande Région Cahiers was officially presented in Esch-Belval. Launched in 2019 by Franz Clément and published by LISER, this publication series explores key issues affecting the Greater Region.
