Some code is missing from the winner’s submission; https://github.com/rapidsai/deeplearning/tree/main/WSDM2021/02_Models/XLNet_SMF Good stuff overall! Congrats!