Agile - Storyboard maintenance

When in the Storyboard view of my sprint, i'd like the ability to move a story from the current sprint to either another sprint or to the backlog. Currently you have to navigate up a few levels to "All Iterations", find the story (again) in that list view, then click Move>To Backlog (or to a diff sprint). Way too many clicks.