Steering wheel shaking while braking

The vibration is very mild and only shakes the steering wheel. Both rotors and both brakes have been replaced. Car also shakes while driving higher speed. What could the cause be ?