Do chemistry sets need adult supervision?

Yes for any kit that includes real reagents or a heat source. Reviewers and the manufacturers themselves explicitly recommend adult supervision for the C1000/C2000/C3000 line; younger-skewing kits like the Nat Geo Junior and Kids First sets use household-safe materials but still suggest a parent be present for goggles, spills and cleanup.