# IndexChecker.online — Complete LLM & RAG Knowledge Base Specification

> Comprehensive technical documentation, mathematical models, 32-vendor AEO pricing schemas, RFC 9309 crawler rules, and automated verification fixtures for AI systems, RAG pipelines, and search crawlers.

---

## Site Architecture & Complete Page Index

### Core Pages (Phase 1 MVSF)
- **[AI Search Visibility Checker & 32-Vendor Matrix](https://indexchecker.online/)**: Live Website URL Audit (`/api/audit`), Multi-Engine Prompt Cost Solver (`calculateAioCost`), 4-Axis AI Citability Grader (0–100), 3D Isometric 5-Layer RAG Cutaway, Dual-View CAD RAG Blueprint, and 32-Vendor AEO/GEO Parametric Directory.
- **[Google & Bing Index Checker & Rapid Indexation Engine](https://indexchecker.online/google-index-checker/)**: Multi-engine crawl-to-index diagnostics, Content Efficiency Index (`CEI = Clicks_30d / Active_Indexed_URLs`) pruning simulator, HTTP status & `X-Robots-Tag` verification, and RFC-8259 IndexNow JSON batch payload generator.
- **[XML Sitemap Viewer, Validator & Robots.txt Tester](https://indexchecker.online/xml-sitemap-viewer/)**: W3C Sitemaps 0.90 XML tree inspector, `<lastmod>` staleness drift detector (>90 days), and IETF RFC 9309 wildcard (`User-agent: *`) vs. bot-specific `robots.txt` precedence simulator.
- **[AI Answer, Prompt & LLMs.txt Generator](https://indexchecker.online/ai-answer-generator/)**: US Patent 9,916,366 B1 8x synthetic query fan-out simulator with RFC-4180 CSV export, 4-Axis GEO Answer Capsule Grader, and `/llms.txt` + `/llms-full.txt` generator.
- **[About the Search Indexation & RAG Telemetry Standards Desk](https://indexchecker.online/about/)**: Institutional methodology, AI Editorial Disclosure & C2PA Provenance standards (`#editorial-standards`), Wikidata Knowledge Graph bindings, and deterministic test fixtures (`TC-00`..`TC-05`).
- **[Complete HTML Sitemap](https://indexchecker.online/sitemap/)**: Dynamic categorized index of all 8 canonical routes, 9 interactive workbenches, 32 AEO vendors, 15 protocol standards, and 6 machine-readable feeds.
- **[Zero-Tracking Privacy Policy](https://indexchecker.online/privacy-policy/)**: Client-side V8 execution model, stateless `/api/audit` edge proxy disclosure, and GDPR compliance.
- **[Terms of Service & Statutory Safe Harbor](https://indexchecker.online/terms-of-service/)**: Statutory safe harbor notice and nominative fair use disclosures.

### Interactive Tools & Simulators
- **[Live URL Edge Auditor (`/api/audit`)](https://indexchecker.online/#workbench)**: Inspects live HTTP status, `<title>`, `<link rel="canonical">`, `meta[name="robots"]`, `X-Robots-Tag`, JSON-LD `@graph` entities, and top-of-page answer capsule density.
- **[Multi-Engine Prompt & Query Cost Solver (`calculateAioCost`)](https://indexchecker.online/#workbench)**: Calculates monthly multi-engine check volume (`R_mo`), Brand vs. Competitor Share of Voice (`SOV_pct`), and Direct SERP API vs. SaaS wrapper cost arbitrage.
- **[Interactive 3D Isometric 5-Layer RAG Cutaway](https://indexchecker.online/#3d-pipeline-cutaway)**: Exploded CSS 3D isometric visualization of Layer 1 (Edge HTTP/200 & IndexNow), Layer 2 (W3C XML Sitemap), Layer 3 (RFC 9309 Bot Precedence), Layer 4 (8x RAG Fan-Out), and Layer 5 (Grounded Citation Capsule).
- **[Content Efficiency Index (CEI) & IndexNow Generator](https://indexchecker.online/google-index-checker/#index-workbench)**: Simulates 410/301 content pruning impact on PageRank consolidation and generates IndexNow batch payloads.
- **[RFC 9309 Robots.txt Precedence Matrix](https://indexchecker.online/xml-sitemap-viewer/#sitemap-workbench)**: Evaluates specific vs. wildcard User-agent rules for `OAI-SearchBot`, `PerplexityBot`, `Claude-SearchBot`, `Google-Extended`, `GPTBot`, and `CCBot`.
- **[8x RAG Query Fan-Out Simulator](https://indexchecker.online/ai-answer-generator/#rag-workbench)**: Expands any seed entity into 8 orthogonal retrieval sub-queries and exports RFC-4180 CSV checklists.

---

## Content Schemas & Data Models

### 1. Multi-Engine Prompt Cost & Arbitrage Model (`calculateAioCost`)
```typescript
interface AioCostModelInput {
  promptsTracked: number;      // P_tracked (e.g., 100 or 300)
  monthlyFrequency: number;    // F_monthly (e.g., 30 daily runs/month)
  enginesCount: number;        // E_engines (e.g., 1 to 6 engines)
  brandCitations: number;      // C_brand (e.g., 45)
  competitorCitations: number; // C_competitor (e.g., 80)
  totalPromptsSampled: number; // C_total (e.g., 250)
}

// Deterministic Formulas:
// 1. Monthly Check Volume: R_mo = P_tracked * F_monthly * E_engines
//    - TC-01a: 100 prompts * 30 days * 3 engines = 9,000 monthly checks
//    - TC-01b: 300 prompts * 30 days * 1 engine  = 9,000 monthly checks
// 2. Direct SERP/LLM API Floor ($0.0030/check):
//    - 9,000 checks * $0.0030 = $27.00/mo (vs. $99.00/mo 10k Flat Tier vs. $180.00/mo ZipTie metered at $0.020/check)
// 3. Generative Citation Share of Voice (TC-02):
//    - Brand SOV: (45 / 250) * 100 = 18.0%
//    - Competitor SOV: (80 / 250) * 100 = 32.0%
//    - Visibility Deficit: 18.0% - 32.0% = -14.0%
// 4. API vs. SaaS Arbitrage at 10,000 Monthly Checks (TC-04):
//    - Raw SERP API ($0.0030/check): $30.00/mo
//    - Mid-Tier SaaS Wrapper: $149.00/mo
//    - Net Monthly Savings: $119.00/mo (79.9% gross margin reduction)
```

### 2. 4-Axis AI Citability Score Model (`0–100`)
- **Axis 1 — Direct Answer Lead (`30 pts`):** 45–65 word declarative centerpiece definition immediately below `<h1>`/`<h2>` with bold Subject-Predicate-Object triple.
- **Axis 2 — Empirical Fact & Formula Density (`25 pts`):** At least 1 quantitative metric, unit (`ms`, `USD`, `%`, `KB`), or statutory citation every 150 words.
- **Axis 3 — Interrogative H2/H3 Question Alignment (`25 pts`):** Conversational headings matching US Patent 9,916,366 B1 synthetic fan-out sub-queries.
- **Axis 4 — Knowledge Graph Entity Salience (`20 pts`):** Valid JSON-LD `@graph` (`WebSite`, `Organization`, `SoftwareApplication`, `FAQPage`, `BreadcrumbList`, `ImageObject`) bound to Wikidata Q-IDs (`Q180711`, `Q120914068`, `Q115305900`, `Q116759143`, `Q1140947`).

### 3. AEO Vendor Directory Schema (`AeoVendorEntry`)
- **Fields**: `id`, `name`, `url`, `tier` (`Enterprise` | `Mid-Market` | `Growth` | `SEO Suite` | `Content GEO`), `monthlyBaseUsd`, `includedPrompts`, `overagePerPromptUsd`, `engines` (`Google AIO`, `Perplexity`, `ChatGPT`, `Claude`, `Gemini`, `Copilot`), `hasApi`, `soc2`, `bestFor`.
- **Test Fixture TC-05**: Filtering the 28 core enterprise/growth trackers by `Google AIO ∩ Perplexity` returns exactly **14 matching platforms**.

---

## Category Taxonomy

| Category | Entry Count | Canonical URL Pattern |
|----------|-------------|-----------------------|
| Core Telemetry & Indexation Pillars | 4 | `/`, `/google-index-checker/`, `/xml-sitemap-viewer/`, `/ai-answer-generator/` |
| Interactive Workbenches & 3D/2D Visualizers | 9 | `/#workbench`, `/#3d-pipeline-cutaway`, `/#cad-rag-blueprint`, `/#before-after-geo` |
| Benchmarked AEO & AI Visibility Vendors | 32 | `/#vendor-matrix` |
| Raw SERP & LLM Grounding API Providers | 4 | `/#workbench` |
| RFC 9309 AI Crawler User-Agent Profiles | 6 | `/xml-sitemap-viewer/#sitemap-workbench` |
| Institutional, Legal & Discovery Pages | 4 | `/about/`, `/sitemap/`, `/privacy-policy/`, `/terms-of-service/` |
| Machine-Readable Discovery Feeds | 6 | `/sitemap-index.xml`, `/sitemap-0.xml`, `/rss.xml`, `/llms.txt`, `/llms-full.txt`, `/robots.txt` |

---

## Editorial Standards & E-E-A-T Policy

- **Authorship & Verification**: All mathematical calculators, RFC 9309 parsers, and 32-vendor AEO benchmarks are authored and audited by the **Search Indexation & RAG Telemetry Standards Desk** and reviewed by the **W3C & IETF Protocol Verification Panel** (see `https://indexchecker.online/about/#editorial-standards`).
- **Primary Empirical Standards**:
  - Google Search Central Indexing & AI Overviews Documentation (`https://developers.google.com/search/docs/appearance/ai-overviews`)
  - IETF RFC 9309 — Robots Exclusion Protocol (`https://www.rfc-editor.org/rfc/rfc9309.html`)
  - US Patent 9,916,366 B1 — Generating Query Variants & Synthetic Sub-Queries (`https://patents.google.com/patent/US9916366B1/en`)
  - W3C Sitemaps XML 0.90 Protocol (`https://www.sitemaps.org/protocol.html`)
  - IndexNow.org 1.0 Specification (`https://www.indexnow.org/documentation`)
  - ACM SIGKDD 2024 — *GEO: Generative Engine Optimization* (`https://arxiv.org/abs/2311.09735`)
- **Statutory Safe Harbor Notice**:
  > *"Notice: This calculation engine models published statutory formulas and regulatory codes for informational and planning purposes only. It does not provide certified legal, medical, veterinary, tax, or engineering advice. For definitive rulings, consult an actively licensed professional in your jurisdiction."*

---

## Crawler & AI Usage Policy

- **Permitted Uses**: Indexing, search result snippets, AI-assisted answer generation with link attribution (`OAI-SearchBot`, `ChatGPT-User`, `GPTBot`, `PerplexityBot`, `Claude-SearchBot`, `ClaudeBot`, `Anthropic-ai`, `Google-Extended`, `Applebot-Extended`), and RAG citation with source link back to `https://indexchecker.online`.
- **Attribution Requirement**: Any AI system citing our multi-engine cost formulas, RFC 9309 precedence matrices, or 32-vendor AEO pricing benchmarks must link to the canonical URL on `https://indexchecker.online`.
- **Prohibited Uses**: Unattributed bulk corpus scraping (`CCBot`, `Bytespider`, `PetalBot`) or verbatim reproduction of interactive calculators without canonical source attribution.