Remove unnecessary patch fixes, and also move the time-tested patch to the armbian series as permanently supported.