A small explosive device went off outside a French church in central Rome, causing only material damage in an incident France's embassy to the Vatican said could be linked to President Francois Hollande's visit Friday.