🤖 detect bots/crawlers/spiders via the user agent.
Keep Bots Away From Your Express App
Verify that a request is from Google using Google's recommended DNS verification steps
koa detect googlebot, facebookbot, ...
isbot for nodejs, Contains most of the world's bot or spider
koa detect googlebot, facebookbot ...
Pluggable, flexible and agnostic prerenderer for sites and SPAs, optimized for SEO. No code changes required.
Magnetic is a tool that makes it easy to fetch web pages that may have dynamic content and render them to static HTML.
Magnetic example - Magnetic is an Express middleware that makes it easy for you to add automatic server-side static rendering to your dynamic single-page app.
Magnetic Express is an Express middleware for Magnetic - a tool that makes it easy for you to add automatic server-side static rendering to your dynamic single-page app.
Keep Bots Away From Your Express App!
Generate an SEO website and sitemap for google escaped fragments
Simple node user-agent inspector that detects bot requests
Handle http request from crawler (Something like Googlebot)
express.js middleware for generating web page html snapshots for web crawlers
isbot Bundle UMD
Express HTML snapshots middleware
detects bots/crawlers/spiders via the user agent.