Repository avatar
AI Tools
v1.0.4
active

domain-intel-ai-auditor

io.github.carlitoun69/domain-intel-ai-auditor

Audit B2B domains for tech stack, SPF/DMARC security, and AI readiness (llms.txt, robots.txt).

Documentation

# B2B Tech-Stack, DNS Security & AI/LLM Readiness Auditor

Enrich thousands of B2B domains in seconds without slow headless browsers or expensive residential proxies. This lightweight, HTTP-only Actor inspects any company domain to extract its technology stack, marketing pixels, email provider, DNS security posture (SPF / DMARC), and **AI/LLM search readiness** (llms.txt, AI bot rules in robots.txt, and JSON-LD structured data).

Built specifically for **B2B lead enrichment pipelines (n8n, Make, Clay)** and **autonomous AI agents via the Apify MCP Server**.

---

## Key Features

- **AI & LLM Readiness Audit (0–100 Score):**

- Checks for /llms.txt and validates that it returns real text rather than an HTML fallback.

- Parses /robots.txt for specific AI crawler directives (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider).

- Extracts JSON-LD / Schema.org types and SEO metadata (title, meta description).

- **Tech Stack & Marketing Pixel Detection:**

- Detects e-commerce platforms & CMS (Shopify, WooCommerce, WordPress, Webflow, Framer, Next.js).

- Detects payment processors (Stripe, Paddle, Polar.sh), analytics (GA4, GTM, PostHog, Plausible), ad pixels (Meta Pixel, LinkedIn Insight), and CRM/support tools (Klaviyo, HubSpot, Intercom, Crisp, Zendesk).

- Identifies CDN and hosting providers from HTTP response headers (Cloudflare, Vercel, Netlify).

- **Email & DNS Security Intelligence:**

- Resolves MX records to identify the company's email provider (Google Workspace, Microsoft 365, Zoho Mail, Proton Mail).

- Checks SPF (v=spf1) and \_dmarc (p=none | quarantine | reject) records for outbound email deliverability and domain security.

- **Fair Pay-Per-Event Pricing:**

- You are charged **only** when a domain is successfully fetched and enriched. Unreachable, invalid, or timed-out domains are skipped at **$0.00** cost.

---


Connect as an MCP Server (Claude, ChatGPT, Cursor)

This Actor works out-of-the-box with the official Apify MCP Server so AI agents can audit domains on demand.

Option 1: Remote MCP URL (Claude.ai / Custom Connectors)

Add this URL as a custom connector and authorize with your Apify account:

[https://mcp.apify.com?tools=carlitossrb/domain-intel-ai-auditor](https://mcp.apify.com?tools=carlitossrb/domain-intel-ai-auditor)

\## Example Output (JSON)



```json

{

  "success": true,

  "domain": "linear.app",

  "finalUrl": "\[https://linear.app/](https://linear.app/)",

  "auditedAt": "2026-11-20T13:25:10.412Z",

  "aiReadiness": {

    "score": 80,

    "hasLlmsTxt": true,

    "hasRobotsTxt": true,

    "blockedAiBots": \[],

    "allowedAiBots": \[

      "GPTBot",

      "OAI-SearchBot",

      "ChatGPT-User",

      "ClaudeBot",

      "Claude-Web",

      "PerplexityBot",

      "Google-Extended",

      "CCBot",

      "Bytespider"

    ],

    "hasJsonLd": false,

    "jsonLdTypes": \[]

  },

  "techStack": \[

    { "name": "Next.js", "category": "Framework" },

    { "name": "Cloudflare", "category": "CDN / Security" }

  ],

  "techNames": \["Next.js", "Cloudflare"],

  "dnsSecurity": {

    "emailProvider": "Google Workspace",

    "mxRecords": \["aspmx.l.google.com"],

    "hasSpf": true,

    "hasDmarc": true,

    "dmarcPolicy": "reject"

  },

  "seo": {

    "title": "Linear – Plan and build products",

    "metaDescription": "Linear streamlines issues, projects, and product roadmaps."

  }

}

No installation packages available.