Are the spiral arms of our galaxy spinning or are only stars spinning and skipping from arm to arm?

You're basically right, although the spiral density waves aren't entirely still. They do rotate around the galaxy, although at a much slower rate than the stars.