@pinkpixel/web-scout-mcp NPM

✨ Features

🔍 DuckDuckGo Search: Fast and privacy-focused web search capability
📄 Content Extraction: Clean, readable text extraction from web pages
🚀 Parallel Processing: Support for extracting content from multiple URLs simultaneously
💾 Memory Optimization: Smart memory management to prevent application crashes
⏱️ Rate Limiting: Intelligent request throttling to avoid API blocks
🛡️ Error Handling: Robust error handling for reliable operation

📦 Installation

Global Installation

npm install -g @pinkpixel/web-scout-mcp

Local Installation

npm install @pinkpixel/web-scout-mcp

🚀 Usage

Command Line

After installing globally, run:

web-scout-mcp

With MCP Clients

Add this to your MCP client's config.json (Claude Desktop, Cursor, etc.):

{
  "mcpServers": {
    "web-scout": {
      "command": "npx",
      "args": [
        "-y",
        "@pinkpixel/web-scout-mcp"
      ]
    }
  }
}

🧰 Tools

The server provides the following MCP tools:

🔍 DuckDuckGoWebSearch

Initiates a web search query using the DuckDuckGo search engine and returns a well-structured list of findings.

Input:

query (string): The search query string
maxResults (number, optional): Maximum number of results to return (default: 10)

Example:

{
  "query": "latest advancements in AI",
  "maxResults": 5
}

Output: A formatted list of search results with titles, URLs, and snippets.

📄 UrlContentExtractor

Fetches and extracts clean, readable content from web pages by removing unnecessary elements like scripts, styles, and navigation.

Input:

url: Either a single URL string or an array of URL strings

Example (single URL):

{
  "url": "https://example.com/article"
}

Example (multiple URLs):

{
  "url": [
    "https://example.com/article1",
    "https://example.com/article2"
  ]
}

Output: Extracted text content from the specified URL(s).

🛠️ Development

# Clone the repository
git clone https://github.com/pinkpixel-dev/web-scout-mcp.git
cd web-scout-mcp

# Install dependencies
npm install

# Build
npm run build

# Run
npm start