What is the speed bottleneck?

I'm wondering what speeds up the speeds of games using the emulator. Is it purely CPU limited? If so, single core speed, threads, etc? What about a GPU? Does that impact anything? I'm trying to get an idea of how I can improve performance but I'm not clear what is the bottleneck.

Any ideas?