By this logic, sunlight shining through a window should only light up the specific area that is directly hit by light.

In reality, the whole room is lit (assuming a house sized room) by indirect light in differing intensities. This is light reflected by various surfaces (including water vapor in the air) that is bounced around.