I don't know about working in a university, but I can tell you the problems you are likely to encounter both working in an office and dealing with other people: crap technology, particularly photocopiers; stupid mission statements supposedly demonstrating that the organisation is 'go getting/people centred/forward thinking/proactive' etc zzzzzzzzz; clueless management; time wasters and time servers; not enough hours to get all the work done. Add to this students, who despite embarking on a degree course, have no commonsense, people skills or even downright manners.
If you are lucky, there will be handful colleagues who will make your day bearable.