In a complex system there are many interconnected components. Although the behavior of each components can be simple, the behavior of the system as a whole can be quite complex. This is called emergent behavior.
The human brain is a network of simple components called neurons. Although the behavior of a single neuron is simple: to fire or not to fire, the behavior of the brain is quite complex: problem solving, language, knowledge, etc.