Every so often a directory like mine stops adding tools and starts shipping broken links instead. I run one: about 4,323 AI tool listings. I had been assuming "the crawler refreshes the descriptions" was close enough to "the links still work". So I spent a morning checking whether the stored URLs actually load. The method was simple, and it collapsed on the first control group.
What I ran
Sample: 300 of 4,323 listings (6.9%) — the top 150 by the traffic number I display, plus 150 random from the rest. One machine, one pass, Node fetch, concurrency 16, follow redirects, 15-second timeout.
| outcome | count |
|---|---|
| 2xx / 3xx | 193 |
| 4xx | 21 |
| 5xx | 2 |
| no TCP or TLS answer at all | 84 |
First read of that table: "28% of my catalog is dead." Wrong, and I can prove it's wrong.
The control group that killed the method
Two of the 84 were notion.so and writesonic.com. Both are undeniably alive companies. They timed out from my machine exactly like the other 82 did.
So that bucket isn't "dead tools", it's "unreachable from where I sit", and those are not the same set. The 4xx column is misleading in the other direction too: all 21 of them are 403, and they include Canva, Midjourney, Lovable and DataRobot — sites that answer a browser and refuse my fetch. Not dead either.
Now count the part of the catalog I structurally cannot check from here: 370 of 4,323 listings (8.6%) sit on domains this network does not let me reach — *.google.com and withgoogle.com (152), huggingface.co (78), OpenAI and ChatGPT (55), x.ai / grok.com (46), Anthropic and Claude (23), Meta AI (16).
A single-vantage link check on a global catalog is mostly a measurement of the network path, not of the product. My dead-link list had an 8.6% floor of "unknowable" in it before any server said anything.
What I could actually prove
Throw away the ambiguous failures and keep only ones that are self-evidently about the domain rather than the path. That's 8 listings:
- 4 domains that no longer resolve.
sharktank-ai.com,superprompts.com,aicoloringpage.org,postai.pro. I checked each against three independent resolvers (system, AliDNS, DNSPod); all three returned nothing. That isn't a firewall artifact, that's an unregistered domain. - 1 with a lapsed certificate.
moviepong.appstill serves a Let's Encrypt cert withnotAfter = Jun 17 2026— expired about five months ago — and the page now returns 404. Nobody renewed it because nobody is running it. - 1 Cloudflare 530, error code 1016.
summarist.aireached the edge, then Cloudflare could not resolve the origin. The tunnel is gone; the DNS record never got the memo. - 1 answering 404 while DNS points at a free host's default name.
naturallanguageplaylist.comresolves to apythonanywhere.comhost. The app left, the A record stayed. - 1 TLS handshake failure at an AWS Global Accelerator address.
promptmixer.devopens port 443 and then nothing speaks TLS. No listener behind the accelerator.
Four of those eight are already filed under my "RIP AI" category. The other four — ColorPage Lab, MoviePong, Summarist, Natural Language Playlist — are still listed as ordinary, live tools. Three of those four carry a free pricing label, and pricing is the first filter on the site. A reader filtering to free tools has no way to know the thing they clicked has had an expired certificate since June.
The label also errs the other way
Of the 16 sampled listings tagged "RIP", 7 returned HTTP 200. Most are stale tags on things that got bought or moved — harmless. Two aren't:
- Pandora Avatars is stored with
socialbook.io. The<title>of that page today is "2-Row Infinite Testimonial Slider". Whatever that domain sells now, it isn't that product. - Stocknews AI at
stocknewsai.comredirects toclick-v4.junclikrmedi.com/click?i=…— a parked-domain click script.
So "dead" in my catalog is a category name, and the category comes from a source I mirror. It is not an observation with a timestamp attached. Neither is "live".
29 links that quietly changed owner
Of the 216 listings that answered, 29 finished on a different registrable domain than the one I store. 18 of those start from a tracking short link, expected. The remaining 11 are domain moves I have not applied: runwayml.com → runway.com, moonvalley.ai → moonvalley.com, preview.reve.art → reve.com, freepik.com → magnific.com, textero.ai → textero.io, relume.io → relume.ai, plusdocs.com → plusai.com, www.anthropic.com → claude.com, hollyhires.ai → hiringagents.ai, aimyads.ai → brandnetworks.com (a different company entirely), plus the parked-domain case above.
Each of those is a listing whose visible name and actual destination now disagree.
The part that is my own fault
76 listings — 17 of them inside the top 150 — store a tracking short link (prf.hn, *.pxf.io, *.sjv.io, partnerlinks.io) as the tool's website. That's deliberate; it's how the directory pays for itself. But it costs me diagnostic power. Probing prf.hn tells me whether the affiliate network is up, never whether the product is. And when the vendor moves, the tracker still reports 200, so the change is invisible to me by construction.
What I would change — none of it shipped
This is a dev log, not a roadmap, so let me be exact: I have changed nothing yet. There is no HTTP status column, no check timestamp, no second vantage point.
- Store the vendor's canonical domain as its own field and keep the monetized redirect separate, so link hygiene is measurable at all.
- Make a dead link a state with evidence attached — status code, error class, check date, resolver set — and give "unreachable from one machine" its own third value instead of folding it into dead.
- Refuse to render a pricing label for a listing whose domain fails a multi-resolver check. The free filter is the loudest page on the site; it shouldn't be able to surface an unregistered domain.
- Hold "RIP" pages out of the sitemap until something external confirms the death, because 7 of 16 sampled dead tags still serve 200.
Those 300 checks were one pass from one place. If you run a crawler or a directory, point the same script at a couple of domains you know are alive before you trust your dead list. Mine said 84 dead and 8 defensible.
The free-tools index — 2,198 listings with their pricing labels, all of the above included — is at AIVerse free AI tools. Now you know how little I can promise about the links in it.

