For gas or natural gas/propane I'd have my character pack along a spark plug wrench and pull the spark plugs and walk away with them. Alternately, if you want the problem to be not immediately obvious, widen the gap on the spark plugs so they no longer throw a spark and replace them.
However, this would take several minutes to accomplish depending on how tightly the spark plugs are screwed in. Also, as soon as the guy started monkeying around wth the generator the power would go off unless they're operating off a battery bank.
IF it's a propane generator it likely has a valve for refilling the tank that could be jammed open with some sort of homemade device and the propane vented. THis would only work if the castle wasn't downwind, however, as propane does have that distinctive rotten egg smell. Also, there's the boom factor to consider. (Not a huge issue in an open-air environment unless someone walks up with, say, a lit cigarette.) Note that if the environment is HUMID this might not work due to icing up.
For diesel, because diesel's not particularly flammable, a couple of holes (bullet) in the fuel tank would do it if we're talking above ground tank. However, this would likely be noisy. You might just have him remove a couple of strategic wires.
Note in some household applications they actually operate off battery power -- often just a bank of lead acid car batteries -- attached to an inverter. The generator recharges the batteries. I point this out because it means that even if you kill the generator they may have power for several hours to a couple of days depending on the setup.
I'm currently writing to you from a large cabin that was powered in this fashion until the late 90's when they brought grid power into the neighborhood. There was a generator (we're not sure what type) that was wired into a battery bank and the house ran off 12 volt most likely with inverters that would convert the power to 110 household current as needed for certain household appliances.
Also, if they're running off a generator the house likely has non-electric appliances, such as a gas or wood stove and a propane refridgerator, and oil or propane lamps for light. (Or 12 volt fluorescents like you'd find in an RV.)
It's cheaper to have a propane fixture directly producing light than it is to make electricity with the generator and THEN make light with the electricity. My point is, losing power may be a nuisance but it's not that big of a deal if they're properly set up.
If they don't have gravity fed water they may lose water. In a castle, likely they have a rooftop water tank somewhere. People in rural areas stockpile water anyway ... so no showers but it's very likely they have bottled water in a basement or closet somewhere for drinking.
Leva