Its been my experiance in the past that when you make a "formal" complaint to relivant gov depts ......the "nice bloke" gets real ugly, and will without a doubt cover his own behind and support the MAJORITY....not the minority ( you)...thus your problem would be two fold .....
work place bullying does have another effect you may not be aware of .....traumatic stress .....this can play a big part in your life without you knowing it .....so I suggest you look it up and check the symptoms just to be safe ....
as others have said, you do NOT have to put up with it,and gov depts working as slow as they do, you would probably find yourself a bit outcast at work once you start the ball rolling ......you will work in silence thats for sure .....and the boss will probably pick fault in your work etc ....but he cannot sack you.....(without good reason) for fear of validating your claim.... it takes guts to work there under those conditions, and it would take guts to take it further ...but .......BEFORE you do ......send your boss a letter by registered mail and make a photocopy of the letter .....outline the problem and your plan of action should it continue ....and give it 7 days ......if it does not resolve .....then go and complain officially ....they will ask you what you did to resolve this yourself ...hence what I just said .........proof is what they want .....hearsay can be denied ....good luck