Grindelwald didn't give up easily, and as Credence's fury of rage stormed the city, he followed him and continued trying to recruit him on his side. Soon they were joined by Newt Scamander and Porpentina Goldstein.
Tina used to be an Auror at the MACUSA, until she was dismissed for assaulting Mary Lou Barebone, Credence's adoptive mother. Grindelwald's plans to get rid of them by sentencing them to death at the MACUSA did not come to fruition. Newt managed to escaped with the help of his Swooping Evil, a winged magical creature which looks like a cross between a snake and an extremely large blue-and-green butterfly. He then saved Tina, and the two of them tried to break out of the MACUSA.
Their initial approach wasn't very successful, as the Aurors outnumbered them heavily. But Tina's younger sister, Queenie, came to aid --- she hid them in Newt's magical suitcase, and then simply walked out the MACUSA with the suitcase.
While Newt and Tina tried stopping Grindelwald, they were simply no match for his prowess.
The MACUSA quickly followed the trail of events, and soon the party was also joined by a large group of Aurors, championed by the MACUSA president, Seraphina. As Grindelwald was still under disguise as Graves, the Aurors focused their attack on the more obvious threat at the time --- the Obscurus. The thought of Credence being lost and his plans falling apart sent Grindelwald in a frenzy, making him break his character as Graves. Seraphina then ordered the Aurors to take in Graves.
Grindelwald, who was now burning with rage, did no longer need to hide or suppress his immense powers and quickly showed both the Aurors and Newt and Tina, what he is capable of. Despite being outnumbered maybe twenty to one, he was able to successfully deflect all of them and simply overwhelmed them in combat.
It was Newt who saw an opportunity to catch Grindelwald off-guard and with the help of his Swooping Evil restrained his hands from behind. Tina then casted a Summoning Charm to take his Wand, while Newt used a Revelio Charm which completely removed Grindelwald's human transfiguration and exposed him behind the disguise of Graves.
Despite his situation, Grindelwald's spirit did not break. He showed no sign of fear or remorse, and he faced his capturers with courage and arrogance. Even as the MACUSA locked him up, he continued talking to everyone in a condescending tone. Perhaps because he did not believe his story ended here. And just months later, he'd make a dramatic escape from the grasp of the MACUSA and reunite with his old army of followers.
They'd go back to their old habits of spreading chaos, launching assaults at various locations. Gellert would even eventually build himself a prison, named Nurmengard, with the intention to hold his opponents there. Nurmengard was a gigantic, towering and grim fortress, isolated on a secluded island area. The prison was built out of black rock, with very high walls, and with Grindelwald's famous "For the Greater Good" slogan engraved on top of its entrance.
During the following years Grindelwald would continue his routine of terrorising Europe, with no sign of any form of authority being able to stop him. He had no match, perhaps with the exception of his old friend --- Albus Dumbledore. Many wizards and witches, possibly including both Gellert and Albus themselves, believed he's the only one skilled enough to be able to challenge the Dark Wizard. But while Dumbledore was aware of the ongoing horrors in Europe, he hesitated confronting Grindelwald.
Dumbledore's worries did not involve losing a duel with Grindelwald. Instead, he feared what meeting Grindelwald might reveal. He was still very much troubled by his sister's accidental death, and believed that Gellert might be aware of who truly was responsible for Ariana's demise. It wasn't something he wanted to find out.
Ultimately, as people suffering from Grindelwald's actions pleaded and urged Dumbledore to help stop the terror, he decided to make a move and track down Grindelwald.
"I think he knew it, I think he knew what frightened me. I delayed meeting him until finally, it would have been too shameful to resist any longer. People were dying and he seemed unstoppable, and I had to do what I could." ~ Albus Dumbledore