What do we do with a passage that says, "You see that a person is justified by works and not by faith alone"? To understand it rightly, we do what we must with any passage of Scripture. We must understand it in its own context. When we do this, all the confusion goes away and this verse teaches us something very profound that we must always remember.
As Luther said, "we are saved by faith alone, but saving faith is never alone."