The big picture of a supercomputer is relatively simple: there are nodes containing CPUs and possibly GPUs together with memory connected by the interconnect. However,when zooming in, things start to get more complicated as well as interesting, and in this chapter we look in more detail at the building blocks of a modern supercomputer.