Yes, a late payment fee will only be paid when the computed late payment fee is $1.00 or greater.
41 C.F.R. §301-52.21