High-risk suppliers need to be constantly appraised for appropriateness to supply to your organization. The result needs to be visible, risks identified and auditable.
What would happen if the relationship faltered? How often do you refresh the relationship or appraise the suppliers performance? How do you measure that? What is the risk to you if the supplier “disappears” overnight? Is the risk material, or just politically embarrassing?
Of course all these will depend upon a number of factors including how easy it is to replace a supplier, whether assured supply is important, the criticality of the commodity to your business model, and other social implications.