Rights groups have expressed concern after photographs emerged of the young men having their mohawks and funky hairstyles shaved off by Aceh's police.
They look sullen and frightened as they are forced into a communal bath.
But Aceh's police say they are not trying to harm the youths, they are trying to protect them.
The 64 punks, many of whom are from as far away as Bali or Jakarta, were picked up on Saturday night during a local concert.
Aceh police spokesman Gustav Leo says there have been complaints from residents nearby.
The residents did not like the behaviour of the punks and alleged that some of them had approached locals for money.
Mr Leo stressed that no-one had been charged with any crime, and there were no plans to do so.
They have now been taken to a remedial school in the Seulawah Hills, about 60km (37 miles) away from the provincial capital Banda Aceh.
"They will undergo a re-education so their morals will match those of other Acehnese people," says Mr Leo.