I guess (and without knowing this particular switch) that it may also be configured such that you need to be on the management VLAN in order to manage the switch, which may therefore mean that you have to be on a particular port(s) of the switch to do it.
Console access would be the obvious way to find out what is going on...
·