How do you get a newborn to keep their pacifier in their mouth while sleeping?

When me and my wife lie our 2 month old down, she wakes up if her pacifier comes out of her mouth. She pushes it out of her mouth and it causes her to wake up...any help would be appreciated.