The actress is shedding light on how family factored into stepping away from and returning to the big screen

Cameron Diaz is shedding light on one of the main reasons she's returning to the big screen: her husband's support.

Related: Cameron Diaz 'Feels Beyond Lucky' to Have 2 Kids with Benji Madden: 'They Love Being Parents' (Exclusive)

"We were in the house for a long time, which was amazing," the Charlie's Angels star said of her break from acting. "So, I had to push myself."

Good Charlotte guitarist Madden, she continued, "was just like, 'You've been supporting us and building the family.' And supporting him in his businesses. He's like, 'It's time for us to support you and let mommy ascend and do her thing.'"

Never miss a story -- sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

Taking a step back from her screen career "felt like the right thing for me to reclaim my own life, and I just really didn't care about anything else," said Diaz. "Nobody's opinion, nobody's success, no one's offer, no one's anything could change my mind about my decision of taking care of myself and building the life that I really wanted to have."

She added, "It really comes to what are you passionate about? For me it was to build my family."

Of course, an offer she couldn't refuse came from Foxx, 56. "I couldn't say no to Jamie" in filming Back to Action, said Diaz. "He said, 'Come with me.' And I was like, 'Okay, let's do it.' "

After Annie and 1999's Any Given Sunday, she noted, "It's our third film together." Back in Action, to be released by Netflix on Jan. 17, 2025, was delayed due to Foxx's unspecified medical emergency on the movie's set in April 2023.

Related: Why Cameron Diaz and Benji Madden Are Selling Their $18 Million L.A. Home: Source (Exclusive)