Pope says abuse scandal has driven some from church