It is already possible to configure the Block template selection with matcher rules.
It should be possible to do the same for the controller, as already can be done with Content or Location views.