
domain-intel-ai-auditor
io.github.carlitoun69/domain-intel-ai-auditor
Audit B2B domains for tech stack, SPF/DMARC security, and AI readiness (llms.txt, robots.txt).
Documentation
# B2B Tech-Stack, DNS Security & AI/LLM Readiness Auditor
Enrich thousands of B2B domains in seconds without slow headless browsers or expensive residential proxies. This lightweight, HTTP-only Actor inspects any company domain to extract its technology stack, marketing pixels, email provider, DNS security posture (SPF / DMARC), and **AI/LLM search readiness** (llms.txt, AI bot rules in robots.txt, and JSON-LD structured data).
Built specifically for **B2B lead enrichment pipelines (n8n, Make, Clay)** and **autonomous AI agents via the Apify MCP Server**.
---
## Key Features
- **AI & LLM Readiness Audit (0–100 Score):**
- Checks for /llms.txt and validates that it returns real text rather than an HTML fallback.
- Parses /robots.txt for specific AI crawler directives (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider).
- Extracts JSON-LD / Schema.org types and SEO metadata (title, meta description).
- **Tech Stack & Marketing Pixel Detection:**
- Detects e-commerce platforms & CMS (Shopify, WooCommerce, WordPress, Webflow, Framer, Next.js).
- Detects payment processors (Stripe, Paddle, Polar.sh), analytics (GA4, GTM, PostHog, Plausible), ad pixels (Meta Pixel, LinkedIn Insight), and CRM/support tools (Klaviyo, HubSpot, Intercom, Crisp, Zendesk).
- Identifies CDN and hosting providers from HTTP response headers (Cloudflare, Vercel, Netlify).
- **Email & DNS Security Intelligence:**
- Resolves MX records to identify the company's email provider (Google Workspace, Microsoft 365, Zoho Mail, Proton Mail).
- Checks SPF (v=spf1) and \_dmarc (p=none | quarantine | reject) records for outbound email deliverability and domain security.
- **Fair Pay-Per-Event Pricing:**
- You are charged **only** when a domain is successfully fetched and enriched. Unreachable, invalid, or timed-out domains are skipped at **$0.00** cost.
---
Connect as an MCP Server (Claude, ChatGPT, Cursor)
This Actor works out-of-the-box with the official Apify MCP Server so AI agents can audit domains on demand.
Option 1: Remote MCP URL (Claude.ai / Custom Connectors)
Add this URL as a custom connector and authorize with your Apify account:
[https://mcp.apify.com?tools=carlitossrb/domain-intel-ai-auditor](https://mcp.apify.com?tools=carlitossrb/domain-intel-ai-auditor)
\## Example Output (JSON)
```json
{
  "success": true,
  "domain": "linear.app",
  "finalUrl": "\[https://linear.app/](https://linear.app/)",
  "auditedAt": "2026-11-20T13:25:10.412Z",
  "aiReadiness": {
  "score": 80,
  "hasLlmsTxt": true,
  "hasRobotsTxt": true,
  "blockedAiBots": \[],
  "allowedAiBots": \[
  "GPTBot",
  "OAI-SearchBot",
  "ChatGPT-User",
  "ClaudeBot",
  "Claude-Web",
  "PerplexityBot",
  "Google-Extended",
  "CCBot",
  "Bytespider"
  ],
  "hasJsonLd": false,
  "jsonLdTypes": \[]
  },
  "techStack": \[
  { "name": "Next.js", "category": "Framework" },
  { "name": "Cloudflare", "category": "CDN / Security" }
  ],
  "techNames": \["Next.js", "Cloudflare"],
  "dnsSecurity": {
  "emailProvider": "Google Workspace",
  "mxRecords": \["aspmx.l.google.com"],
  "hasSpf": true,
  "hasDmarc": true,
  "dmarcPolicy": "reject"
  },
  "seo": {
  "title": "Linear – Plan and build products",
  "metaDescription": "Linear streamlines issues, projects, and product roadmaps."
  }
}
No installation packages available.