There was never a jibber in our family.
There was never a coward in our family.
Derivation:
'Jibber' - refuse to proceed in some action, hence to show cowardice (19th century, origin unknown). (Concise Oxford Dictionary) Probably 19th century English verb 'Jib' - to shirk. (Partridge)