Why doesn't Genly like Estraven?

In the beginning of the book, Genly Ai is indebted to Estraven for having arranged an audience with the king, but he is also frustrated because he sees Estraven as being cold and aloof, and he is angry because he feels that, as Prime Minister, he should have done more to make the audience go more smoothly.