Is assembly really as hard as reviewers say?

For the larger wooden Backyard Discovery sets, yes. The r/daddit thread linked from multiple Backyard Discovery listings is blunt about it – budget a full weekend and a second adult. Metal A-frames like the Big Brutus and Sportspower Arcadia are reported as meaningfully faster to build, on the order of a few hours.