In September of 2005, WMMF became the first unsigned band to be featured on the PBS series Austin City Limits in years, which they recorded with Scottish indie rockers Franz Ferdinand. In early 2006, WMMF was finally signed to Barsuk records.
Jerry Lee Lewis' song What Made Milwaukee Famous is the band's namesake.
The bands second album What Doesn't Kill Us Makes Us Stronger was released in 2008.