ReviewOS

stacks/bench-review

seo: test/internal pages are built, crawlable, and sitemapped — /jtest, /secret-marketing, /paywall

#65
Closed glennmichael123 opened this 9 days ago ·
9 days ago

Problem

Internal/test pages ship in the production build with no noindex and no robots Disallow, and the build-generated sitemap actively advertises them.

Findings

  • dist/jtest.html, dist/secret-marketing.html, dist/paywall.html are built and crawlable.
  • secret-marketing.stx hardcodes a fabricated 5-star review of a named fake judge — a reputational/credibility leak for a judge-review platform if it gets indexed.

Acceptance criteria

  • /jtest and /secret-marketing removed from the views build
  • Any retained marketing/paywall page is noindexed and robots-Disallowed
  • The fabricated judge review is not publicly served anywhere

Split out from the SEO bundle of the 2026-06-10 production-readiness audit.

9 days ago

Resolved. All three sub-claims now check out against the built artifact:

  • /jtest — deleted in e4390fc. It was four lines containing JTEST_MARKER, which the SSG turned into a 101KB document carrying the framework's default "stx App" title.
  • /secret-marketing — no longer exists; nothing builds it.
  • /paywall — still built, deliberately: it is the real upgrade page, not test scaffolding. It is absent from the sitemap and disallowed in robots.txt.

The sitemap no longer advertises any of them (grep '/jtest\|/paywall\|/secret-marketing' dist/sitemap.xml is empty), and robots.txt keeps the Disallow rules for the two deleted paths so an old crawl-queue entry is refused rather than repeatedly 404-ing.

One deliberate non-change: /paywall gets a robots Disallow rather than a noindex meta. The two don't combine — a crawler told not to fetch a page cannot read the noindex on it — and for a page that should not be crawled at all, Disallow plus sitemap exclusion is the right pair.

Sign in to comment on this issue.