Rheumatoid arthritis (RA) and ankylosing spondylitis (AS) are chronic inflammatory diseases that together affect 2–3% of the population. RA and AS predominantly involve joints, but heart disease is also a common feature in RA and AS patients. Here we have studied a new spontaneous mutation that causes severe polyarthritis in bone phenotype spontaneous mutation 1 (BPSM1) mice. In addition to joint destruction, mutant mice also develop aortic root aneurism and aorto-mitral valve disease that can be fatal depending on the genetic background. The cause of the disease is the spontaneous insertion of a retrotransposon into the 3′ untranslated region (3′UTR) of the tumor necrosis factor (TNF), which triggers its strong overexpression in myeloid cells. We found that several members of a family of RNA-binding, CCCH-containing zinc-finger proteins control TNF expression through its 3′UTR, and we identified a previously unidentified regulatory element in the UTR. The disease in BPSM1 mice is independent of the adaptive immune system and does not appear to involve inflammatory cytokines other than TNF. To our knowledge, this is the first animal model showing both polyarthritis and heart disease as a direct result of TNF deregulation. These results emphasize the therapeutic potential of anti-TNF drugs for the treatment of heart valve disease and identify potential therapeutic targets to control TNF expression and inflammation.