
Joel Madden (in the front) started dating Hilary Duff in 2004. In November 2006, after two and a half years, Joel and Duff broke up. Madden stated at a club ten days afterwards that their age difference was causing problems.
Later that year, in December of 2006, Madden and Nicole Richie became a couple. In June and July 2007, numerous media outlets were stating that Richie was pregnant with Madden's baby. These rumors were unaddressed by the couple until July 31, 2007 when they confirmed in an interview with Diane Sawyer that Richie was pregnant with Madden's child. For the sake of Richie and the baby, Madden has given up smoking. Richie gave birth to the couple's daughter, Harlow Winter Kate Madden on January 11, 2008 at Cedars-Sinai Medical Center in Los Angeles..
Madden currently resides in Glendale, California with Nicole Richie and Harlow.