Elizabeth's prayer book is a symbol of her faith. Her prayer book is taken away by Mary, who did not share her protestant faith but rather adhered to Catholocism. Mary was not tolerant of, nor did she recognize, any faith but her own.
Beware, Princess Elizabeth