What is it about Mumei that sometimes spooks Yoshiro?

Yoshiro is often spooked by Mumei because of his seeming ability to read people's minds as if he were reading a book.