How does the pre-training objective affect what large language models learn about linguistic properties?

Publication
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics
Ahmed Alajrami
Ahmed Alajrami
PhD Student in NLP

My research interests include language modelling and interpretability.