A wall actually CAN prevent Chant of Rage from working. If you are one zone away from the hate token, and there is a wall (with the passage blocked trait) between you, then it is not possible for you to move towards the target. Moving to the side of the wall would mean you are now 2 zones from the target, meaning you've just moved away from it instead of towards it. I think we can all agree that moving AWAY does not satisfy the requirement of the spell to move TOWARDS the hate token.
Since you can't go through the wall, and every other direction would be moving away from the target, you therefore don't have to move at all and can choose whatever action you want. So yeah, you're correct Jeffman. If the wall's directly between you, you're free.
Regarding Drmambo23's statement, in addition to being wrong about necessarily having to move around the wall, it also seems to be under the impression that you must always choose the shortest path to the hate token. This is also wrong. If there are multiple paths towards the target, you can always choose which one to take regardless of which one is shorter. The only requirement is that each and every move you make must bring you closer towards the token. Because of this requirement though, if one path is longer than another, that kinda means that such a path eventually leads to a dead end that frees you from your requirement.
This is because the token is at a set distance away from you. Say, it's 4 zones from you. That means the required move must bring you within 3 zones from the target. Other moves don't satisfy its requirements. Then the move after that must bring you to within 2 zones. And then 1. And then the same zone. If any path was longer than this, the enchant could not force you to move along it. You can use this to your advantage by choosing such paths.
For example, if the hate token is 2 zones to the left of my enchanted creature and 1 zone above, then my first move could be either left or up. The zone above me though has a wall on it's left border. My opponent may have a problem with me choosing to move upwards then, as "going around the wall takes longer" but really what happens is that now I CAN'T move closer, because of the wall, and I'm freed of the obligation.
I think a lot of people don't realize all the ways there are to manipulate chant of rage and mitigate it's power, which is partly why it's so popular. That's why I felt compelled to mention some of the options here, even though it wasn't really part of the question.
Arkdeniz is correct though that if you can move through a wall, even if it has a passage attack, then you MUST move through it (assuming there aren't other paths towards the token).