Currently the feature you want is not implemented. The only way to prioritise cards without drag and drop is moving all cards out of the list and move card with the highest priority first back to the list.
The Shortcusts for Trello Chrome Extension lets you move cards to the top. It's open source and there is a GitHub Issue on it to add shortcut for Card Move Up/Down. (Any JS developers willing to pull this one off?)