The distributed optimization [Battiti:89a;89e] software was developed by Roberto Battiti, modifying a back-propagation program written by Steve Otto. Fox and Williams inspired our first investigations into the optimization literature (Shanno's conjugate gradient [Shanno:78a] is used in [Williams:87b]).