Everyone is shipping apps built with AI now. I am too - it's the fastest way I know to go from idea to a live URL. But after building a small security scanner and running it against thousands of real, publicly listed AI-generated websites, I now look at my own deploys very differently.

Here's the data first, then the lessons.

The dataset

My side project AppSeal scans a live site with 125 checks: security headers, exposed secrets (.env, .git, AI/cloud/payment API keys), TLS config, cookies, broken links, admin panels, and basic DNS hygiene.

We collected 6,348 unique hosts from public portfolios, launch pages and "built with X" galleries, then scanned each one.

The results

Grade Sites Share
A+ 20 0.3%
A 264 4.2%
B 1,266 20%
C 3,626 57%
D 1,103 17%
E 69 1%

  • Average score: 60/100
  • Only 1 in 22 sites reaches A or better
  • 94% of live sites fail at least one basic security header check

The most common header gaps across scanned sites:

Missing / weak Share of sites
COOP 83%
Permissions-Policy 80%
X-Frame-Options 74%
CSP 74%
Referrer-Policy 63%
HSTS 46%

And the genuinely scary one: a number of sites exposed .env files or had live API keys for AI/cloud providers sitting in client-side code. We flag those as critical severity, and they are one-line mistakes.

Why this happens

AI builders (v0, Lovable, Bolt and friends) optimize for an amazing first screen. They don't set security headers, and they don't know which of your keys are "demo" and which are real. Neither does the person shipping the project on a Sunday evening - that's not a dig, that's exactly why I built the scanner.

Three fixes that cover most of the gap

  1. HSTS + basic headers in one place. If you're on Vercel, a vercel.json with a headers() block covers X-Frame-Options, X-Content-Type-Options, Referrer-Policy, HSTS and Permissions-Policy in five lines.
  2. CSP, even a modest one. For a static-ish site a meta CSP is fine to start. Locking script-src down removes the whole class of injected-scripts problems.
  3. Never ship real keys in client code. "But it's a free-tier key" - scanners and bots don't care, and free tiers get abused for mining.

Try it

The scanner is free, one domain, no signup: appseal.online. Full aggregated stats live here: appseal.online/stats. It's a solo project, so honest feedback on the report UI is very welcome.