It also matters a lot what time era you are talking about.
Basically, the work never ends on a farm. If you have cows, they have to be milked every 12 hours, no matter what. No vacations, holidays or days off -- even for funerals. Many farmers do that about 5 am and 5 pm (maybe 6 am and 6 pm.) Selling milk and butter is often a good source of "extra" income, so they may have a lot of cows.
During the growing season there is almost endless work. Turning the ground, fertilizing, planting, weeding (or cultivating), pruning, dealing with insects and diseases, harvesting, preserving or selling the harvest. Plus, most farms are constantly falling apart (due to a lack of cash.) So, you need to constantly repair everything -- the barn, the fences, the pump in the well, the steps on the porch. (You can’t afford to pay a plumber or carpenter, because the farm isn’t making any money.)
In the fall you chop wood from the wooded acerage on your land, which you use to heat the house (because – you guessed it – the farm doesn’t generate enough income to heat the house with gas, electricity or oil.)
On a stereotypical family farm the men grew crops like hay, corn, soybeans or wheat and milked. The women were responsible for the garden (which provided vegetables for the family), and the chickens, in addition to caring for the children and doing all the housework and laundry. During the harvest, the women worked until the wee hours of the morning canning produce, making jams and jellies, so they would have food over the winter.
About the "no animals" thing. A traditional or organic farm is almost a closed ecosystem. It won't really work without the animals.
Thirty years ago I lived on a small family farm in Alabama. We basically raised all our own food (except for coffee, sugar & flour.) That would have been impossible without the animals. (We had 40 acres and 8 people.)
I became disillusioned with the lifestyle when I realized that I was literally working 80 hours per week -- and all we were getting out of the deal was groceries. I could have worked 20 hours at the minimum wage, bought groceries at the grocery store, and come out ahead.
On a small farm, the cows provide milk and meat. The chickens provide an alarm clock, eggs, and meat. Hogs mature fairly quickly, and act as a garbage disposal. The animal’s manure goes to make compost to fertilize the garden & other crops. Unless you are willing to use fertilizers derived from petrochemicals, you need that manure. Otherwise, the soil in the garden and fields becomes depleted in just a few growing seasons.
Traditionally, farmers use mules, horses or oxen to plow the fields. The other alternative is a tractor. It's going to be very difficult for one person working without an animal or tractor to raise enough vegetables to a) meet all their calorie and protein needs and b) sell enough to pay the electric bill, and maybe buy enough gas to drive the car a few times a week.
Also, animals can graze on land that's too infertile, too rocky or too hilly to be used for any crops.
Small farming is not economically viable in the 20th or 21st century. In the example above, 5 of those people were adults who worked "real jobs" full time to support the farm. (And, only half the land had a mortgage.) In a good year, we broke even, counting everyone's salary. Small family farming, as a hobby, can be more expensive than using cocaine.