Turning off the secondary solver means you're not getting any secondary light bounces. See the image below:
On the left: Pt + Hdcache, light bounces several times and also reaches the floor in the shadowed area
On the right: Pt + None, the floor part is completely dark, no bounced light from the walls.