I reckon this is dependent on your settings for countries etc.
Let’s say, your shop is in Albania, you most likely want to have 23% as default VAT, right? Go to Admin -> Core settings -> Settings -> Global, change the value for “Domestic Customers” to the value “Albania”.
Second, adjust Settings -> VAT -> Default VAT for all Products to “23”.
Third, go to countries now. Albania should be activated and you shouldn’t be able to change any VAT settings here. With other words, all your Albanian customers should see the price including 23% now, except you added another value at the product item or category management (e.g. to 13%).
Oh - and BTW: deactivate the option you mentioned before