You have to check the voltage in DC (direct current) mode. AC is for alternating current normally found in household circuits. If you have battery voltage and it climbs 1 to 2 volts at 2000 rpm, the alternator and regulator are ok.
Before you replaced the battery did you check the voltage? The no start condition might not have been battery related given the voltages you stated above.