franklin-bulk-shared v1.31.1

Franklin Bulk Operations Shared Library

Install

npm install https://gitpkg.now.sh/catalan-adobe/franklin-bulk-shared

Usage

Sample script that takes a screenshot of the bottom of a page:

// take-screenshot.js

import * as franklin from 'franklin-bulk-shared';
  
// init headless browser
const [browser, page] = await franklin.Puppeteer.initBrowser();

// load test page
await page.goto('https://www.hlx.live');

// scroll down
await franklin.Puppeteer.scrollDown(page);

// wait 1s.
await franklin.Time.sleep(1000);

// take a screenshot
await page.screenshot({
  fullPage: false,
  path: 'screenshot.png'
});

// close browser
await browser.close();

Crawl a domain for max 50 URLs with specific pattern

// crawl.js

import { Web } from 'franklin-bulk-shared';

const result = Web.crawl( 'https://www.adobe.com', {
  timeout: 30000,
  limit: 50,
  inclusionPatterns: [ '*/blog/*' ]
});

Domains

• Puppeteer (initBrowserAgent, scrollDown, scrollUp)
• Time (sleep, randomSleep)
• Web (crawl, parseRobotsTxt, parseSitemapFromUrl)