Do I have to drill into studs?

Yes, in nearly every case. High-trust r/hometheater threads are skeptical of 'studless' drywall-anchor mounts for anything but the smallest TVs, and the testing writeup at nytimes.com emphasizes mounts that include drilling templates and can be leveled after installation as a key ease-of-use factor.