Polite web scanner with LLM remediation helper
Web Vulnerability Scanner & AI Triage
Web Vulnerability Scanner & AI Triage (PoliteWebScanner) is a security research tool designed for ethical web assessment and vulnerability triage. Built around a strict queue-based worker architecture, it crawls targets without recursive thread spawning, enforcing per-host rate limits, robots.txt compliance, and configurable depth filters. The scanner conducts non-destructive GET-only checks for missing security headers (CSP, HSTS, X-Frame-Options), insecure cookie flags (Secure, HttpOnly, SameSite), dangerous HTTP methods, reflected XSS markers, and database error signatures. It outputs structured JSON alongside an interactive HTML report featuring an embedded AI Help Center proxy that explains findings and generates contextual remediation steps with client-side data anonymization.
Problem
Many automated vulnerability scanners are noisy, aggressive, and risk destabilizing target services, while raw scanner logs can be overwhelming for developers who need clear, contextual remediation advice.
Solution
A polite, queue-based crawler with per-host throttling and robots.txt gates, paired with an interactive HTML dashboard and an optional AI remediation proxy that translates security findings into actionable fixes.
Outcome
A portfolio-grade security research platform showcasing ethical crawler design, multi-threaded socket reuse, automated vulnerability heuristics, and local-first AI assistant integration.
Standout Features
- Polite queue-based crawler with fixed thread pool, robots.txt gates, and per-host throttling
- Non-destructive GET probes for missing security headers, cookie flags, reflected XSS, and SQL errors
- Configurable depth ranges (e.g. depth 1–2) to focus analysis on high-value attack surfaces
- Interactive HTML report with embedded AI Help Center and client-side data anonymization before LLM queries
- Dual output architecture: structured JSON for automation and rich HTML for triage
Stack & Signals
- Python 3.10+
- BeautifulSoup4
- Requests
- Flask
- Groq AI
- HTML/JS Dashboard
Canonical destination