Skip to content
Meta Ad Library scraper is live, spy on any brand's adsExplore

Changelog

What's new in ArrowCrawl. Updates shipped weekly.

v2.2.0June 2026

Conversational Agent, WebGL Particles & Extension Rebrand

  • featConversational agent with session memory - multi-turn chat with persistent context across runs
  • featWebGL2 particle field hero background - 600 GLSL-shader particles reacting to cursor movement
  • featAntigravity-style navbar with wide two-column dropdown menus (Features + Tools)
  • featScroll-scale LiveCode demo - panel grows from 50% to 100% on scroll
  • featViolet ripple click animation on all buttons via useRipple hook
  • featCustom URL support on Marketplace page - scrape any site, not just marketplaces
  • featSparklesBurst component for action state animations
  • featArrowCrawl Chrome Extension rebranded - new logo, light theme, indigo/violet CSS tokens
  • featExtension installation docs at /docs/extension
  • featGradient arrow logo - clean right-pointing arrow, indigo→violet→blue→cyan gradient
v2.1.0June 2026

Production Infrastructure Complete

  • featProxy rotation layer with Redis IP reputation scoring and tier escalation
  • featRate limiter middleware (60/300/1000 RPM by account tier)
  • featCredit reservation pattern - atomic reserve, finalize, refund within 5s
  • featMulti-format scrape engine (markdown, HTML, JSON, screenshot, links)
  • featCrawl engine with BFS, bloom-filter dedup, robots.txt, sitemap
  • featMap engine - fast URL discovery via HEAD requests only (<30s)
  • featBatch engine - up to 1000 URLs per job with webhook delivery
  • featInteract engine - live browser sessions with action DSL + NL-to-action
  • featSession manager - AES-256-GCM encrypted browser session capture + replay
  • featChange tracker - field-level diff, 30 snapshot history, webhook triggers
  • featMonitor service - cron scheduling, exponential backoff webhook delivery
  • featAPI Hunter engine - CDP network interception, replay with auth detection
  • featMarketplace adapters - Amazon IN/US, Flipkart, Myntra, Nykaa, Noon with proxy+TLS
  • feat10 new API endpoints: /crawl, /map, /batch, /interact, /api-hunter
v1.0.0May 2026

Platform Launch

  • featPublic API with /scrape, /crawl, /map, /extract, /search endpoints
  • feat7-provider free LLM router (Groq, Cerebras, Gemini, OpenRouter, NVIDIA, DashScope, Ollama)
  • featBrowser extension with capture upload and network log export
  • featAPI-first extraction. detects real JSON APIs from captured traffic
  • featLive scrapers with cron scheduling and diff detection
  • featPython SDK with async support and typed responses
  • featMarketing website with playground, docs, and dashboard