It sounds like you may be getting a fine for items that may be clearly cosmetic in nature and quite subjective to judge. Obviously if there are problems with your roof that may jeopardize safety, pose a risk and are defined in the Inspection Code of your particular city, you may have to repair some items. Your gutters are another matter. It seems to me that just because your gutters may need cleaning doesn't mean it would allow for a fine.
Did the letter you received define any particular code that you allegedly violated?
I would follow up with your local property inspector and get to the bottom of it. Most cities allow for appeal with some type of administrative body. In general you will not get a request to pay a fine without your day in court to defend the issue.
Hope this helps and good luck
