Stern drive up/down switch at helm

I can here a click sound on both stern drive but will not raise or lower first time. After a dozen tries it will engage. Any idea on what would cause this.
Bayrunner -- FV312 - Simple Pleasure
Answers