Common amongst older hardware actually. THe parallel port is cheap and easy to design hardware for compared to USB which is expensive by comparison (at least back in the day). On top of that parallel doesn't put out much juice if any where as USB gives a solid +5v@500ma which is more than enough for most devices.
Your USB keyboard probably only eats about 100-150ma.