Why does Orwell feel pressure from the crowd?

The crowd is harassing Orwell. As the symbol of imperial power, they expected Orwell to do something about the elephant.

But at that moment I glanced round at the crowd that had followed me. It was an immense crowd, two thousand at the least and growing every minute.