Advances in private training for production on-device language models
… Differential privacy by default in federated learning In “ Federated Learning of Gboard Language Models with Differential Privacy ”, we announced that all the NWP neural network LMs in Gboard have DP guarantees, and all future launches of Gboard LMs trained on user data require DP guarantees. …