Carver was indicted on 12 counts including rape, armed robbery, kidnapping with bodily injury, false imprisonment, aggravated assault and battery, according to records from DeKalb County Superior Count.
Police said the victim was working alone at the church when she was attacked.
Police said Carver showed up at the office door banging and ringing the bell.
Authorities said when the 53-year-old woman came to the door, she had no time to react and that Carver attacked and sexually assaulted her. During a court appearance, it was revealed that Carver allegedly used a knife to hold down the woman while he raped and robbed her.