Did you notice if there has been any repaving done? That road has been rough going for many years now. I have numerous routes that go down it, and it is pretty hairy with all the potholes. Up is probably no problem, so maybe I need to try these routes in reverse.
There seemed to have been a few narrow strips of newish pavement, but not really much. Going up was generally OK, although there certainly was a lot of rough pavement. Downhill wouldn't have been fun.
I had three downhill sections after that. The first (turning off the Whately-Conway Road) was not too bad, took it at full speed, though wouldn't have with narrower tires), the second (delivers you to the Whately Inn) is excellent, the third, I think it's Swamp Road, was pretty good. All way better than North Farms.