Kevin Federline has led a life largely out of the spotlight since his divorce from pop princess Britney Spears, but the former dancer recently spoke out against his ex-wife's father, accusing Jamie Spears of child abuse.

Federline's attorney, Mark Vincent Kaplan told PEOPLE that the alleged incident occurred on the evening of Aug. 24 at Jamie's home. Federline's two sons that he shares with Britney Spears, Sean Preston, and Jayden James were visiting their mother at Jamie's home at the time.

“There was a disagreement that occurred while Britney and the children were visiting with Jamie at his home that led to a physical altercation that was observed by Jayden,” Kaplan told the magazine. “Britney did the right thing and removed the children and took them out of there, but the trauma to the kids is nonetheless.”

Sources told TMZ that Jamie had allegedly broken down a door to get to 13-year-old Sean Preston and that he grabbed him once he was in the room. Federline then reported the incident to the Ventura Co. Sheriff's Department the next day.

Both boys have been granted a restraining order against their grandfather that was filed on their behalf by Kaplan and Federline.

As a result of the alleged incident, Federline had his lawyer filed to adjust the 50/50 custody agreement that he and Britney Spears shared for their children. Although Kaplan told PEOPLE that the agreement of Federline having the boys "closer to 90" percent of the time while Spears has them for the other 10 percent has been in place for "almost the last year" the filing was made to make the custody agreement official.

According to TMZ the new custody agreement gives Federline 70% custody while Spears retains 30%. Kaplan also confirmed to PEOPLE that Spears' time with her sons remains supervised.

Kaplan also stated that Federline's sons are doing fine since the alleged incident and that the custody filing was simply done to protect their best interests. "Kevin in no way wants to prevent the boys from having any unreasonable custodial contact with their mom," Kaplan told E! News. "The boys love their mother but the existing [custody] arrangement, as reflected in the terms of the most recently entered order, are reflecting what Kevin believes is in the children's best interest."

Read Next: Britney Spears’ Sons Staying With Kevin Federline While She Receives Help