USB is normally 5 volts and is allowed to be up to 5.5 volts. 6 volts is out of specification, and 12 volts is much too high and creates a high risk that you'll permanently break the phone. (On the other hand, you might not. Maybe your phone is safe from this. Other people's phones might not be.)
If someone else plugs their phone into 5.45 volts and it breaks, it's their fault. If they plug their phone into 6 volts and it breaks, it's your fault and you will have to pay for their new phone.
You should get some type of converter/regulator module that will convert any voltage to 5 volts. They are quite cheap and plentiful at any electronics supplier. Search for 'buck converter' (decreases voltage), 'boost converter' (increases it) or 'buck/boost converter' (does either). It will be a little circuit board with somewhere to attach input and output wires. If you can't solder then see if you can find one with screws for the input and USB connectors for the output.
Some are adjustable with a knob or you can get one that's pre-set to 5 (or 5.5) volts.
Important numbers to look at are the output voltage, allowed input voltage, and maximum current.
A buck converter can only decrease voltage, so even if it says the output is adjustable 3V to 30V, to get a 5V output the input must be higher than 5V (probably higher than 6V - leave some safety margin). Likewise, a boost converter would need an input lower than 5V (probably lower than 4V).
If yours is adjustable, setting the voltage a bit higher than 5 volts (but not more than 5.5) isn't a bad idea, since the voltage will drop a little between the converter and the phone when it starts pulling current.
AA, AAA, C and D cells start at about 1.6 volts each when brand new, drop down to 1.5, then slowly drop to about 0.8 volts by the time they are completely empty. So make sure the converter you choose can handle the brand new battery voltage as well as the completely empty voltage, so you can use all the power in the batteries.
To charge several phones at once, simply connect them in parallel. In parallel, the amperage adds up. I'd estimate about 2A per phone, to make sure I get a big enough voltage converter. The actual amount will probably be less than that.
Phones can adapt their charging speed depending on how much the power source says it can provide. A very easy and standard signal is to simply connect the two data pins to each other. This tells the phone it can use 1.5 amps. If you want to charge more phones more slowly, you could try one of the other signals to tell them to slow-charge.