manager of the system engineering department

Assume that you, as manager of the system engineering department, are dependent on the performance of a number of major suppliers. What steps would you take (and what should be included) in establishing the requirements for the evaluation of the suppliers?