Industry Research

You conduct deep, intent-driven industry research. The core question is "what are people looking for?" -- not "what are competitors doing?" Keyword intent, search demand, and real audience language are the primary signals. Competitor analysis serves the intent research by finding gaps in what's being served.

Before Starting

Check for product marketing context first:
If .agents/product-marketing-context.md exists (or .claude/product-marketing-context.md in older setups), read it before asking questions. Use that context and only ask for information not already covered or specific to this task.

Then determine:

1. 1. Client name -- Which client to research for
2. Industry/market -- The market category and key services/products
3. Seed keywords -- 5-8 starting keyword phrases reflecting core services
4. Competitor URLs -- 3-5 known competitor websites to analyze
5. Geographic focus -- Target region for keyword data (default: US)

If dispatched via cron or orchestrator with a specific client name, use the product-marketing-context for that client to derive seed keywords and competitors automatically.

Workflow

Step 1: Keyword Research (Ahrefs)

Use Ahrefs to gather keyword data. Try the Ahrefs MCP server first (if available via mcporter or MCP tools list). If MCP is not available, fall back to the Ahrefs REST API at https://api.ahrefs.com/v3 with Authorization: Bearer $AHREFS_API_KEY.

Regardless of access method, gather data from these endpoints/capabilities:

Keywords Explorer overview -- seed keywords (batch up to 10 per request) for volume, difficulty, traffic potential:
CODEBLOCK0

Keywords Explorer matching terms -- for each seed keyword, find related keywords (limit: 100 results per seed):
CODEBLOCK1

Keywords Explorer related terms -- semantically similar keywords:
CODEBLOCK2

Cluster results by topic (group keywords sharing the same parent topic or SERP overlap).

Classify each keyword's intent:

• - Informational -- how/what/why questions, guides, educational content
• Transactional -- near me, cost, buy, hire, service, pricing queries

Rate limit: Max 60 requests/min. Budget cap: 15 API calls per research run.

If neither Ahrefs MCP nor AHREFSAPIKEY is available, skip this step and note "Ahrefs data unavailable -- no MCP server or API key configured" in the artifact. Continue with Firecrawl+Exa only.

Step 2: Audience Research (Firecrawl + Exa)

Use exa.js search to find Reddit threads, forum posts, Quora answers about the industry/problem space:

CODEBLOCK3

CODEBLOCK4

CODEBLOCK5

Use firecrawl.js scrape to extract content from top 5 most relevant results:

CODEBLOCK6

Extract:

• - Exact questions people ask
• Pain points in their own words
• Emotional language
• Common objections

Cross-reference with Google's People Also Ask (search for each seed keyword via Exa and extract PAA-style questions):

CODEBLOCK7

Step 3: Content Gap Analysis

For each top keyword cluster, use exa.js search to find what currently ranks:

CODEBLOCK8

Use firecrawl.js scrape on top 3 ranking pages per cluster to analyze content depth:

CODEBLOCK9

Identify gaps:

• - Topics with search demand but weak/missing/outdated content from competitors
• Flag underserved angles -- queries where top results are generic directories (Yelp, WebMD) rather than authoritative guides
• Note city-specific opportunities if geographic focus applies

Step 4: Competitor Landscape

Use firecrawl.js map on each competitor URL to discover their site structure:

CODEBLOCK10

Use firecrawl.js scrape on their key pages (homepage, services, blog, pricing) -- max 5 pages per competitor:

CODEBLOCK11

Analyze:

• - Positioning/messaging
• Content strategy (blog frequency, topics)
• SEO approach (city pages, programmatic content)

If Ahrefs is available (MCP or API), use Site Explorer organic-keywords to see what keywords competitors rank for:
CODEBLOCK12

Identify messaging patterns and gaps -- what positioning angles are unclaimed.

Step 5: Compile Artifact

Write the output to .agents/industry-research-{client}.md where {client} is the lowercase client name (e.g., allcare).

Use this artifact template:

CODEBLOCK13

Target artifact size: 3,000-5,000 words. Synthesize and distill -- do not dump raw scraped content.

Each section has its own Last researched: timestamp so consuming skills can verify recency.

Tips

• - Focus on intent, not just volume -- a 500-volume transactional keyword outperforms a 5,000-volume informational one for conversions
• Capture exact audience language -- "my mom can barely get to the doctor" is more valuable than "transportation barriers to healthcare access"
• Budget API calls carefully -- 15 Ahrefs calls per run, scrape selectively (use firecrawl.js map before scrape)
• Keep the artifact scannable -- downstream skills read specific sections, not the whole document

Related Skills

• - competitive-intelligence -- For detailed competitor analysis (company-level deep dives)
• market-research -- For market sizing, TAM/SAM/SOM, and industry trends
• firecrawl-cli -- For raw Firecrawl scraping (detailed tool documentation)
• exa-company-research -- For raw Exa web search on specific companies
• product-marketing-context -- For foundational product/service context that feeds into research