Jack Straw has launched a series of pilot schemes aimed at opening the workings of the justice system to members of the public.
A trial website has been launched which could allow people to view details of punishments given to offenders in their area.
Straw said that to avoid being embarrassed by appearing on the website, offenders should not commit crimes.
"There has to be consequences," he said. "If they feel slightly ashamed then they will realise that doing community punishment is not a soft option and they will be less likely to come back.
"It's about the system being firm and clear."
Visiting a youth project in Newham, east London he added that too much of the justice system "has been a secret garden and we've got to open it up".
The green paper on engaging communities in criminal justice also includes new community prosecutors who would be tasked with engaging communities.
Community impact statements will also be used in court, while citizens' panels will give the public greater influence over community payback schemes.
The pilot projects will take place in 30 areas across England and Wales.
Home secretary Jacqui Smith said: "The public are our best weapon in fighting crime.
"If people understand and trust the criminal justice system and see it as a public service, they will be able to get on with their lives without fear of crime, secure in the knowledge that there are tough consequences for those who break the rules."

Dods Parliamentary Communications Ltd