SEO Optimization

Search engine optimization based on Lighthouse SEO audits and Google Search guidelines. Focus on technical SEO, on-page optimization, and structured data.

Technical SEO

Crawlability

robots.txt:

text
1# /robots.txt
2User-agent: *
3Allow: /
4
5# Block admin/private areas
6Disallow: /admin/
7Disallow: /api/
8Disallow: /private/
9
10# Don't block resources needed for rendering
11# ❌ Disallow: /static/
12
13Sitemap: https://example.com/sitemap.xml

Meta robots:

html
1<!-- Default: indexable, followable -->
2<meta name="robots" content="index, follow">
3
4<!-- Noindex specific pages -->
5<meta name="robots" content="noindex, nofollow">
6
7<!-- Indexable but don't follow links -->
8<meta name="robots" content="index, nofollow">
9
10<!-- Control snippets -->
11<meta name="robots" content="max-snippet:150, max-image-preview:large">

Canonical URLs:

html
1<!-- Prevent duplicate content issues -->
2<link rel="canonical" href="https://example.com/page">
3
4<!-- Self-referencing canonical (recommended) -->
5<link rel="canonical" href="https://example.com/current-page">
6
7<!-- For paginated content -->
8<link rel="canonical" href="https://example.com/products">
9<!-- Or use rel="prev" / rel="next" for explicit pagination -->

XML sitemap

xml
1<?xml version="1.0" encoding="UTF-8"?>
2<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
3  <url>
4    <loc>https://example.com/</loc>
5    <lastmod>2024-01-15</lastmod>
6    <changefreq>daily</changefreq>
7    <priority>1.0</priority>
8  </url>
9  <url>
10    <loc>https://example.com/products</loc>
11    <lastmod>2024-01-14</lastmod>
12    <changefreq>weekly</changefreq>
13    <priority>0.8</priority>
14  </url>
15</urlset>

Sitemap best practices:

• Maximum 50,000 URLs or 50MB per sitemap
• Use sitemap index for larger sites
• Include only canonical, indexable URLs
• Update lastmod when content changes
• Submit to Google Search Console

URL structure

✅ Good URLs:
https://example.com/products/blue-widget
https://example.com/blog/how-to-use-widgets

❌ Poor URLs:
https://example.com/p?id=12345
https://example.com/products/item/category/subcategory/blue-widget-2024-sale-discount

URL guidelines:

• Use hyphens, not underscores
• Lowercase only
• Keep short (< 75 characters)
• Include target keywords naturally
• Avoid parameters when possible
• Use HTTPS always

HTTPS & security

html
1<!-- Ensure all resources use HTTPS -->
2<img src="https://example.com/image.jpg">
3
4<!-- Not: -->
5<img src="http://example.com/image.jpg">

Security headers for SEO trust signals:

Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY

On-page SEO

Title tags

html
1<!-- ❌ Missing or generic -->
2<title>Page</title>
3<title>Home</title>
4
5<!-- ✅ Descriptive with primary keyword -->
6<title>Blue Widgets for Sale | Premium Quality | Example Store</title>

Title tag guidelines:

• 50-60 characters (Google truncates ~60)
• Primary keyword near the beginning
• Unique for every page
• Brand name at end (unless homepage)
• Action-oriented when appropriate

Meta descriptions

html
1<!-- ❌ Missing or duplicate -->
2<meta name="description" content="">
3
4<!-- ✅ Compelling and unique -->
5<meta name="description" content="Shop premium blue widgets with free shipping. 30-day returns. Rated 4.9/5 by 10,000+ customers. Order today and save 20%.">

Meta description guidelines:

• 150-160 characters
• Include primary keyword naturally
• Compelling call-to-action
• Unique for every page
• Matches page content

Heading structure

html
1<!-- ❌ Poor structure -->
2<h2>Welcome to Our Store</h2>
3<h4>Products</h4>
4<h1>Contact Us</h1>
5
6<!-- ✅ Proper hierarchy -->
7<h1>Blue Widgets - Premium Quality</h1>
8  <h2>Product Features</h2>
9    <h3>Durability</h3>
10    <h3>Design</h3>
11  <h2>Customer Reviews</h2>
12  <h2>Pricing</h2>

Heading guidelines:

• Single <h1> per page (the main topic)
• Logical hierarchy (don't skip levels)
• Include keywords naturally
• Descriptive, not generic

Image SEO

html
1<!-- ❌ Poor image SEO -->
2<img src="IMG_12345.jpg">
3
4<!-- ✅ Optimized image -->
5<img src="blue-widget-product-photo.webp"
6     alt="Blue widget with chrome finish, side view showing control panel"
7     width="800"
8     height="600"
9     loading="lazy">

Image guidelines:

• Descriptive filenames with keywords
• Alt text describes the image content
• Compressed and properly sized
• WebP/AVIF with fallbacks
• Lazy load below-fold images

Internal linking

html
1<!-- ❌ Non-descriptive -->
2<a href="/products">Click here</a>
3<a href="/widgets">Read more</a>
4
5<!-- ✅ Descriptive anchor text -->
6<a href="/products/blue-widgets">Browse our blue widget collection</a>
7<a href="/guides/widget-maintenance">Learn how to maintain your widgets</a>

Linking guidelines:

• Descriptive anchor text with keywords
• Link to relevant internal pages
• Reasonable number of links per page
• Fix broken links promptly
• Use breadcrumbs for hierarchy

Structured data (JSON-LD)

Organization

html
1<script type="application/ld+json">
2{
3  "@context": "https://schema.org",
4  "@type": "Organization",
5  "name": "Example Company",
6  "url": "https://example.com",
7  "logo": "https://example.com/logo.png",
8  "sameAs": [
9    "https://twitter.com/example",
10    "https://linkedin.com/company/example"
11  ],
12  "contactPoint": {
13    "@type": "ContactPoint",
14    "telephone": "+1-555-123-4567",
15    "contactType": "customer service"
16  }
17}
18</script>

Article

html
1<script type="application/ld+json">
2{
3  "@context": "https://schema.org",
4  "@type": "Article",
5  "headline": "How to Choose the Right Widget",
6  "description": "Complete guide to selecting widgets for your needs.",
7  "image": "https://example.com/article-image.jpg",
8  "author": {
9    "@type": "Person",
10    "name": "Jane Smith",
11    "url": "https://example.com/authors/jane-smith"
12  },
13  "publisher": {
14    "@type": "Organization",
15    "name": "Example Blog",
16    "logo": {
17      "@type": "ImageObject",
18      "url": "https://example.com/logo.png"
19    }
20  },
21  "datePublished": "2024-01-15",
22  "dateModified": "2024-01-20"
23}
24</script>

Product

html
1<script type="application/ld+json">
2{
3  "@context": "https://schema.org",
4  "@type": "Product",
5  "name": "Blue Widget Pro",
6  "image": "https://example.com/blue-widget.jpg",
7  "description": "Premium blue widget with advanced features.",
8  "brand": {
9    "@type": "Brand",
10    "name": "WidgetCo"
11  },
12  "offers": {
13    "@type": "Offer",
14    "price": "49.99",
15    "priceCurrency": "USD",
16    "availability": "https://schema.org/InStock",
17    "url": "https://example.com/products/blue-widget"
18  },
19  "aggregateRating": {
20    "@type": "AggregateRating",
21    "ratingValue": "4.8",
22    "reviewCount": "1250"
23  }
24}
25</script>

FAQ

html
1<script type="application/ld+json">
2{
3  "@context": "https://schema.org",
4  "@type": "FAQPage",
5  "mainEntity": [
6    {
7      "@type": "Question",
8      "name": "What colors are available?",
9      "acceptedAnswer": {
10        "@type": "Answer",
11        "text": "Our widgets come in blue, red, and green."
12      }
13    },
14    {
15      "@type": "Question",
16      "name": "What is the warranty?",
17      "acceptedAnswer": {
18        "@type": "Answer",
19        "text": "All widgets include a 2-year warranty."
20      }
21    }
22  ]
23}
24</script>

Breadcrumbs

html
1<script type="application/ld+json">
2{
3  "@context": "https://schema.org",
4  "@type": "BreadcrumbList",
5  "itemListElement": [
6    {
7      "@type": "ListItem",
8      "position": 1,
9      "name": "Home",
10      "item": "https://example.com"
11    },
12    {
13      "@type": "ListItem",
14      "position": 2,
15      "name": "Products",
16      "item": "https://example.com/products"
17    },
18    {
19      "@type": "ListItem",
20      "position": 3,
21      "name": "Blue Widgets",
22      "item": "https://example.com/products/blue-widgets"
23    }
24  ]
25}
26</script>

Validation

Test structured data at:

• Google Rich Results Test
• Schema.org Validator

Mobile SEO

Responsive design

html
1<!-- ❌ Not mobile-friendly -->
2<meta name="viewport" content="width=1024">
3
4<!-- ✅ Responsive viewport -->
5<meta name="viewport" content="width=device-width, initial-scale=1">

Tap targets

css
1/* ❌ Too small for mobile */
2.small-link {
3  padding: 4px;
4  font-size: 12px;
5}
6
7/* ✅ Adequate tap target */
8.mobile-friendly-link {
9  padding: 12px;
10  font-size: 16px;
11  min-height: 48px;
12  min-width: 48px;
13}

Font sizes

css
1/* ❌ Too small on mobile */
2body {
3  font-size: 10px;
4}
5
6/* ✅ Readable without zooming */
7body {
8  font-size: 16px;
9  line-height: 1.5;
10}

International SEO

Hreflang tags

html
1<!-- For multi-language sites -->
2<link rel="alternate" hreflang="en" href="https://example.com/page">
3<link rel="alternate" hreflang="es" href="https://example.com/es/page">
4<link rel="alternate" hreflang="fr" href="https://example.com/fr/page">
5<link rel="alternate" hreflang="x-default" href="https://example.com/page">

Language declaration

html
1<html lang="en">
2<!-- or -->
3<html lang="es-MX">

SEO audit checklist

Critical

• HTTPS enabled
• robots.txt allows crawling
• No noindex on important pages
• Title tags present and unique
• Single <h1> per page

High priority

• Meta descriptions present
• Sitemap submitted
• Canonical URLs set
• Mobile-responsive
• Core Web Vitals passing

Medium priority

• Structured data implemented
• Internal linking strategy
• Image alt text
• Descriptive URLs
• Breadcrumb navigation

Ongoing

• Fix crawl errors in Search Console
• Update sitemap when content changes
• Monitor ranking changes
• Check for broken links
• Review Search Console insights

Audit workflow

1. Baseline: run Lighthouse and PageSpeed on key templates (home, category, detail, blog).
2. Crawl: verify indexability, canonicals, and duplicate content (use Search Console + crawler).
3. Fix blockers: noindex, robots.txt, canonical mismatches, redirect chains.
4. On-page: titles, meta descriptions, headings, internal linking, image alt.
5. Structured data: add JSON-LD and validate rich results.
6. Re-verify: re-run Lighthouse/PageSpeed and check Search Console coverage.

Common pitfalls

• noindex or X-Robots-Tag accidentally set on important pages
• robots.txt blocks CSS/JS or critical render resources
• Canonical points to a different URL than the one indexed
• Mixed http/https or www/non-www causing duplicate content
• Redirect chains/loops (waste crawl budget and slow page load)
• Parameterized URLs indexable (filters, sort, UTM) without canonical control
• JavaScript-rendered content not visible in initial HTML
• Soft 404s (200 status with "not found" content)
• Sitemap includes non-canonical or noindex URLs
• Hreflang tags missing reciprocal links or using wrong language/region codes

Tools

Scripts (optional)

Scripts under scripts/ for repeatable audits:

• scripts/lighthouse.sh: run Lighthouse CLI against a URL or URL list and store JSON reports.
• scripts/pagespeed.sh: call PageSpeed Insights API with curl and capture JSON output.
• scripts/search-console-export.mjs: export Search Console Search Analytics data (requires OAuth access token).

Example usage:

bash
1# Lighthouse (SEO category only)
2scripts/lighthouse.sh https://example.com
3scripts/lighthouse.sh urls.txt reports/lighthouse
4
5# PageSpeed Insights API (requires PAGESPEED_API_KEY)
6PAGESPEED_API_KEY=... scripts/pagespeed.sh https://example.com
7PAGESPEED_API_KEY=... scripts/pagespeed.sh urls.txt reports/pagespeed
8
9# Search Console API (requires GSC_ACCESS_TOKEN)
10GSC_ACCESS_TOKEN=... scripts/search-console-export.mjs https://example.com 2024-01-01 2024-01-31

AEO / AI Visibility Optimization

Answer Engine Optimization (AEO) focuses on making content discoverable and citable by AI agents (ChatGPT, Perplexity, Gemini, Google AI Overviews). While SEO targets rankings and clicks, AEO targets citations, mentions, and brand authority within AI-generated responses.

Key differences from SEO

SEO: Rank high → get clicks → drive traffic
AEO: Be cited → own the answer → build authority

SEO metric: Position, CTR, impressions
AEO metric: Citations, mentions, AI visibility score

SEO query: "best project management software"
AEO query: "What's the best project management software for a remote team of 15 with budget under $500/month?"

Market shift:

• Gartner predicts 25% drop in traditional search volume by 2026 due to AI chatbots
• 400M+ people use OpenAI products weekly
• 58% of searches are now "zero-click" (answered directly in AI interface)

Content structure for AEO

Answer-first formatting:

markdown
1<!-- ❌ SEO-style (context first) -->
2## What is AEO?
3In recent years, the rise of AI-powered search has transformed 
4how users discover information. This shift has created new 
5opportunities for brands. Answer Engine Optimization is...
6
7<!-- ✅ AEO-style (answer first) -->
8## What is AEO?
9Answer Engine Optimization (AEO) is the practice of structuring 
10content so AI systems can directly extract and cite answers. 
11It focuses on citations in AI responses rather than search rankings.
12
13Unlike traditional SEO, AEO optimizes for conversational queries 
14and zero-click results where users get answers without visiting 
15your site.

Guidelines:

• Lead with 40-60 word direct answer
• Self-contained responses (AI extracts without surrounding context)
• Conversational, natural language
• Specific data > vague claims
• Include quantified claims, dates, authoritative citations

Entity-based optimization:

markdown
1<!-- ❌ Keyword-focused -->
2"Our software helps teams collaborate better with features 
3for project management and communication."
4
5<!-- ✅ Entity-focused -->
6"Acme PM is a project management platform for remote teams. 
7Founded in 2020, serves 50,000+ companies. Key features: 
8Kanban boards, time tracking, Slack integration. Pricing: 
9$12/user/month."

Define who you are, what you do, and why AI should trust you.

Schema for AEO

Expand beyond SEO schema to optimize for AI extraction.

Critical schema types for AEO:

1. FAQPage (highest AI citation rate)
   • Template: references/json-ld-templates.md

FAQ answer guidelines for AEO:

• 40-60 words ideal (under 30 = lacks substance, over 80 = hard to extract)
• Match visible H2/H3 headings to schema "name" property exactly
• Include specific numbers, dates, and data
• Self-contained (makes sense without context)
• Natural question phrasing (how users actually ask)

2. Author + Organization (trust signals)
   • Template: references/json-ld-templates.md

Why it matters: AI engines prioritize content from identifiable, authoritative sources. Use sameAs links to disambiguate your brand.

3. Product (for e-commerce AEO)
   • Template: references/json-ld-templates.md

Allows AI shopping modules to show accurate pricing, availability, reviews.

Platform-specific optimization

Different AI engines have different preferences. Balance all three for maximum citation probability.

ChatGPT:

• Neutral, encyclopedia-style tone
• Authoritative external citations
• Specific data and quantified claims
• Formal structure

markdown
1Example: "According to a 2025 Gartner study, 78% of enterprises 
2adopted AI-powered search tools. The primary drivers were cost 
3reduction (cited by 62% of respondents) and improved accuracy 
4(58%). Source: Gartner AI Search Report 2025."

Perplexity:

• Conversational, experience-driven
• Practical examples and case studies
• Community insights and real-world context
• Less formal tone

markdown
1Example: "Most teams start with the free tier and upgrade after 
22-3 months once they've proven ROI. Based on feedback from 500+ 
3customers, common triggers for upgrading include hitting user 
4limits or needing advanced reporting."

Google AI Overviews:

• E-E-A-T signals (Experience, Expertise, Authoritativeness, Trust)
• Fresh content with recent dates
• Featured snippet-friendly formatting
• Mobile-optimized structure

markdown
1Example: "Updated February 2026: Current pricing starts at 
2$12/user/month (annual billing). Month-to-month adds 20%. 
3Education and nonprofit discounts available. No free tier 
4as of Q1 2026."

AEO measurement & tools

Metrics:

• Citation frequency (how often AI mentions your brand)
• Visibility score (presence across AI platforms)
• Context quality (positive/neutral/negative sentiment)
• Source attribution (which URLs AI cites)

Tracking AI referral traffic:

In Google Analytics 4, filter traffic sources:

• chat.openai.com (ChatGPT)
• perplexity.ai
• gemini.google.com
• copilot.microsoft.com

Monitor these as separate acquisition sources.

Use your preferred AEO monitoring tool to track citation frequency, context, and source attribution.

AEO audit checklist

Content audit

• All key pages have 40-60 word direct answers upfront
• FAQ sections with self-contained answers
• Conversational language matching natural queries
• Specific data (numbers, dates, sources) not vague claims
• Author bios and organization info visible
• Content updated with recent dates (freshness)

Schema audit

• FAQPage schema on FAQ/guide pages
• Author schema on all articles/blogs
• Organization schema site-wide
• Product schema on product pages (if e-commerce)
• Article schema with datePublished/dateModified
• Schema matches visible content exactly (no hidden markup)
• Validate with Google Rich Results Test

Technical audit

• JSON-LD format (preferred by AI engines)
• Schema.org standards compliance
• No conflicting or duplicate schema
• Fast page load (AI crawlers prefer fast sites)
• Clean HTML structure (semantic headings)
• Mobile-optimized (especially for Google AI Overviews)

Entity & authority signals

• Clear brand identity (who you are, what you do)
• Consistent NAP (name, address, phone) across web
• sameAs links to LinkedIn, Twitter, official profiles
• External citations and backlinks from authoritative sources
• Active presence on review platforms
• Google Business Profile optimized (local businesses)

AI visibility monitoring

• Test top 10-20 commercial queries monthly
• Track AI referral traffic in GA4
• Monitor brand mentions across AI platforms
• Check citation context (positive/neutral/negative)
• Verify factual accuracy of AI responses about your brand
• Set up alerts for visibility changes (if using paid tools)

References

• Google Search Central
• Schema.org
• Core Web Vitals
• Web Quality Audit