Yes, you are making perfect sense. You judge the action (or the sin), you don't judge the sinner.
In this country of tolerance, we are too quick to jump all over anyone who seems to be judging someone else, when you are merely stating that what they're doing may be wrong. We leave the judgment of the person up to God. Even people who sit on the bench as a judge, sentence the person accused, based on what they've done, not who they are.