One Direction Didn't Want to "Scare People Off" With 'Midnight Memories'!