Publications

Konrad Staniszewski

2024

• Yu Zhao, Yuanbin Qu, Konrad Staniszewski , Szymon Tworkowski, Wei Liu, Piotr Miłoś , Yuxiang Wu, Pasquale Minervini, Analysing The Impact of Sequence Composition on Language Model Pre-Training, 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand, 11 August 2024 - 16 August 2024. See in PBN

2023

• Szymon Tworkowski, Konrad Staniszewski , Mikołaj Pacek, Yuhuai Wu, Henryk Michalewski , Piotr Miłoś , Focused Transformer: Contrastive Training for Context Scaling, 37th Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, the United States of America, 10 December 2023 - 16 December 2023. See in PBN