That's slow, but at least it moves. Probably needs a good cleaning with kerosine/Jet Fuel/Brake or Carb Cleaner, then either a graphite lubricant or light oil as Blue62 said.
With my most recent project without a key, I didn't waste time fiddling around with the button. I removed the steering wheel and trim, then hit it for a few seconds with a Sawzall. In the case of replacing the whole lock mechanism, I recommend it.