Well the alternator could be an issue. There is no regulator as such. This is done by integral diodes. Though these can be replaced separately, if thealternator has been in service any length of time, it's much better to rebuild it, getting a new bearing and windings in the process for almost no extra $.
How old is your battery? A weak or dying attery can take the alternator along for the ride.
