The best way i found to do this is to get Mothers alluminum and mag pollish
1. Put pollish on terry cloth, and rub the swinger until a black residue forms
2. Wipe off with a microfiber towel
this also works on getting lube off plastic, also it give the alluminum a nice shine