Use enough to solve your issues.Once the clearance that you need is established,take them out and paint them the same color as the pulley.This will make them much less noticeable.Anyone who makes despairaging comments should be told to"pound sand"! Phil may very well be right about the hub being pressed too far down,but that's gonna be tough to fix at home.