You have to break the connection to the alternator. When you disconnect the battery with the switch, the engine will stay running because it is running off the alternator. It is the same as disconnecting a battery with the engine running, the engine runs off the alternator. That is why you break the circuit to the alternator. Try it by using the battery switch and when it stays running, disconnect the alternator wire. The engine will then die.