3.6.73 • Published 11 months ago

@hishprorg/fuga-repellat v3.6.73

Weekly downloads
-
License
MIT
Repository
github
Last release
11 months ago

@hishprorg/fuga-repellat

NPM version Downloads Node.js CI Coverage

The fast & forgiving HTML/XML parser.

@hishprorg/fuga-repellat is the fastest HTML parser, and takes some shortcuts to get there. If you need strict HTML spec compliance, have a look at parse5.

Installation

npm install @hishprorg/fuga-repellat

A live demo of @hishprorg/fuga-repellat is available on AST Explorer.

Ecosystem

NameDescription
@hishprorg/fuga-repellatFast & forgiving HTML/XML parser
domhandlerHandler for @hishprorg/fuga-repellat that turns documents into a DOM
domutilsUtilities for working with domhandler's DOM
css-selectCSS selector engine, compatible with domhandler's DOM
cheerioThe jQuery API for domhandler's DOM
dom-serializerSerializer for domhandler's DOM

Usage

@hishprorg/fuga-repellat itself provides a callback interface that allows consumption of documents with minimal allocations. For a more ergonomic experience, read Getting a DOM below.

import * as @hishprorg/fuga-repellat from "@hishprorg/fuga-repellat";

const parser = new @hishprorg/fuga-repellat.Parser({
    onopentag(name, attributes) {
        /*
         * This fires when a new tag is opened.
         *
         * If you don't need an aggregated `attributes` object,
         * have a look at the `onopentagname` and `onattribute` events.
         */
        if (name === "script" && attributes.type === "text/javascript") {
            console.log("JS! Hooray!");
        }
    },
    ontext(text) {
        /*
         * Fires whenever a section of text was processed.
         *
         * Note that this can fire at any point within text and you might
         * have to stitch together multiple pieces.
         */
        console.log("-->", text);
    },
    onclosetag(tagname) {
        /*
         * Fires when a tag is closed.
         *
         * You can rely on this event only firing when you have received an
         * equivalent opening tag before. Closing tags without corresponding
         * opening tags will be ignored.
         */
        if (tagname === "script") {
            console.log("That's it?!");
        }
    },
});
parser.write(
    "Xyz <script type='text/javascript'>const foo = '<<bar>>';</script>",
);
parser.end();

Output (with multiple text events combined):

--> Xyz
JS! Hooray!
--> const foo = '<<bar>>';
That's it?!

This example only shows three of the possible events. Read more about the parser, its events and options in the wiki.

Usage with streams

While the Parser interface closely resembles Node.js streams, it's not a 100% match. Use the WritableStream interface to process a streaming input:

import { WritableStream } from "@hishprorg/fuga-repellat/lib/WritableStream";

const parserStream = new WritableStream({
    ontext(text) {
        console.log("Streaming:", text);
    },
});

const htmlStream = fs.createReadStream("./my-file.html");
htmlStream.pipe(parserStream).on("finish", () => console.log("done"));

Getting a DOM

The DomHandler produces a DOM (document object model) that can be manipulated using the DomUtils helper.

import * as @hishprorg/fuga-repellat from "@hishprorg/fuga-repellat";

const dom = @hishprorg/fuga-repellat.parseDocument(htmlString);

The DomHandler, while still bundled with this module, was moved to its own module. Have a look at that for further information.

Parsing Feeds

@hishprorg/fuga-repellat makes it easy to parse RSS, RDF and Atom feeds, by providing a parseFeed method:

const feed = @hishprorg/fuga-repellat.parseFeed(content, options);

Performance

After having some artificial benchmarks for some time, @AndreasMadsen published his htmlparser-benchmark, which benchmarks HTML parses based on real-world websites.

At the time of writing, the latest versions of all supported parsers show the following performance characteristics on GitHub Actions (sourced from here):

@hishprorg/fuga-repellat        : 2.17215 ms/file ± 3.81587
node-html-parser   : 2.35983 ms/file ± 1.54487
html5parser        : 2.43468 ms/file ± 2.81501
neutron-html5parser: 2.61356 ms/file ± 1.70324
@hishprorg/fuga-repellat-dom    : 3.09034 ms/file ± 4.77033
html-dom-parser    : 3.56804 ms/file ± 5.15621
libxmljs           : 4.07490 ms/file ± 2.99869
htmljs-parser      : 6.15812 ms/file ± 7.52497
parse5             : 9.70406 ms/file ± 6.74872
htmlparser         : 15.0596 ms/file ± 89.0826
html-parser        : 28.6282 ms/file ± 22.6652
saxes              : 45.7921 ms/file ± 128.691
html5              : 120.844 ms/file ± 153.944

How does this module differ from node-htmlparser?

In 2011, this module started as a fork of the htmlparser module. @hishprorg/fuga-repellat was rewritten multiple times and, while it maintains an API that's mostly compatible with htmlparser, the projects don't share any code anymore.

The parser now provides a callback interface inspired by sax.js (originally targeted at readabilitySAX). As a result, old handlers won't work anymore.

The DefaultHandler was renamed to clarify its purpose (to DomHandler). The old name is still available when requiring @hishprorg/fuga-repellat and your code should work as expected.

The RssHandler was replaced with a getFeed function that takes a DomHandler DOM and returns a feed object. There is a parseFeed helper function that can be used to parse a feed from a string.

Security contact information

To report a security vulnerability, please use the Tidelift security contact. Tidelift will coordinate the fix and disclosure.

@hishprorg/fuga-repellat for enterprise

Available as part of the Tidelift Subscription.

The maintainers of @hishprorg/fuga-repellat and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact dependencies you use. Learn more.

moduledataViewsharedarraybuffercss variableconstassertionquotereuselesscssconcatMapgdprserializercloudformationvalidatorttyflags[[Prototype]]movepureshellcloneeveryworkflowautoscalingelasticachepackage managershrinkwrap-0hotexitYAMLgradients cssfetchspeeddataramdareact-componentdirmatchesregexpworkspace:*shimJSON-Schemafast-copyfigletconfigurableArray.prototype.containsanimationmergefast-deep-copyES2015sidecallgetless compileriteratorstyled-componentsbyteString.prototype.trimmulti-packagepathlocalentriesInt16ArraygetOwnPropertyDescriptortraverseUint16Arrayimmutableeffect-tscolumnes2018execastbuffersloggingURLSearchParamsfullutil.inspectpluginformattingredux-toolkitArrayBufferarrayUint8Arrayajvfluxreactcolourregexec2whichArraysignalform-validationRxwindowscoerciblekeyES2021utilwriteBigInt64Arrayutilssigneddescriptionpinoreplaypostcss-plugindeep-clonea11yCSSStyleDeclarationbundlingWeakMapsetImmediatees-abstractstylingemitdefinecurriedvariables in cssrecursiveextracensoruser-streamses6sesbddtestapiformsjson-schemaclassnameArray.prototype.flatreact-testing-libraryes-shim APIfullwidthTypedArraycurlcloudtrailreact-hooksReflect.getPrototypeOfcssshamwidthpipecore-jsclasseschildprotobufObject.definePropertyhandlerObject.keysAsyncIteratorchromeignoredependenciesinterruptshooks0lockfileaccessibilitytextlanguageschema.gitignoreenvargumentcliincludesbrowserslistObject.entriesexpressflattyped arraySetroutingStreampyyamllogrobusteslint-pluginzxelectroncompareauthenticationcolorsuperstructformmkdirpRegExp.prototype.flagsswfkeystermcolorsprefixcallbindrangeerrorsuperagentevents3dglacierUint32ArrayRFC-6455circularequalitymetadataFunction.prototype.namelibphonenumberfile systemelmzerospawndiffcommanddeepsigintarraybufferawsserializeES2023babel-corestyleguide.envhttpbindnameES8queuedeletenested cssserializationESnextzodloadingsqsawesomesaucehashperformantSystem.globalescapeloggerreducertoStringTagbyteLengthowncss nestingES2019selfnamesweaksetslotqueueMicrotaskvestsortedfromexpressionglobal this valueIteratormonorepolistenersassertstscacheECMAScript 2023linthookformfixed-widthregular-expressionvpctypedarraystransportfull-widtheslintpluginconsumei18nWebSocketprivate dataobjrequirecloudwatchparsehasOwnPropertyenderArray.prototype.findLastIndexfindLastIndexless cssloadbalancingoperating-systemjsonschemasetPrototypeOfmodulespoint-freebrowserlistredirectECMAScript 2019setteres8jsxfastcopytoSorteddescriptorajaxflatMapfront-endoptimistyamlinstallimmertrimRightgroupidentifiersroutevarstrimStartjsdiffvalidationECMAScript 2022helperArrayBuffer.prototype.slicescheme-validationsubprocesswafHyBimkdirenvironmentrandomfast-deep-cloneStreamsstreamfpstylesroute53querygradients css3kinesiseventDispatchervariablesdomworkerfastprotocol-buffersstableutilityFloat32Arraycompile lesses-shimsunicodebootstrap csslivedirectorydotenvchromiumstreamstouchapolloaccessorauthsymlinkio-tsless256schememruthreespinnerless mixinseslintdeepcloneargsstatehigher-orderelbcryptospinnersexecutedefinePropertyglobglobalsObject.assignartmockpreserve-symlinksesclienttostringtagecmascriptfpsprotocertificatesuninstallpackagespackage.jsonspringCSSreduxasterisksObjectiteratesyntaxECMAScriptes2015dragpropertyestreeidlephoneurlparsersequencecontainslruflagiscorepredictablenegativesyntaxerrorfunctionsintrinsicnodejscallboundextendMicrosoftwarningviewbinflattenprettyreact animationES6yupinvariantmkdirsencryptionback-endrapidpicomatchlinuxformatkoreanstoragegatewaynopevaluesnumberfunction.lengthtddfilterjsbrowser$.extendfast-clonechinesenpmignorewaitECMAScript 2018inferenceterminalmomentspecdropSymbol.toStringTagomiteslintconfigECMAScript 7assignECMAScript 3managertypeofinternal slottimetypesafestartereventEmitteriehttpscss-in-jsstringifyruntimeopensslchaitypehardlinkswritablelocationenvironmentsstylegetintrinsiccompileruploadquerystringansi__proto__efficientqscheckasserteast-asian-widthcommandernegative zerovalueprogressglobal objectsharedES2020es2016inputbusyES3indicatorjapanesereal-timeserviceprototypesimpledbBigUint64ArrayArray.prototype.flatMapletpersistentespreepopmotioncloudsearchRegExp#flagslengthimportsetreducedom-testing-libraryperformancebabelintrimvisualgetoptprocess6to5ES5execfileoutputUint8ClampedArrayhasOwnslicesymlinksfunctionalObservablerulesbootstrap lessasyncmacoses2017inspectstructuredClonetestingtypanionforkasciiPushirqInt8ArraytrimLeftESInt32ArraysafejestfastclonetrimEndwgetWeakSetprivateserverreadablestreamvarstylesheetArrayBuffer#slicexhrECMAScript 2015installerdependency managerReactiveExtensionsbuffer@@toStringTagregular expressionglobalThisfantasy-landpositivemockingexit-codecryptautoprefixerforEachrdsairbnbmapreducetslibwaapibundlerchanneldeterministicpreprocessorconcatPromiseJSONes5collectioncreatereact-hook-forml10nreact posesymboloffsetnodepnpm9sns_.extendwhatwgWebSocketsemrponyfillmatchReactiveXrequestmatchAlljQueryproxystringprunefindarraysoncetypedarraycloudfrontgitignoreclass-validatoragentpostcssjson-schema-validationgetterless.jsbeanstalkresolveES2016takeconfigobjectgetPrototypeOfargvlastremovelinkebshasfsinternalObject.valuesString.prototype.matchAllvalidatedataviewiammake dirpatchimportexportTypeScripts3bounddayjsFloat64ArrayjoitoolkittesterposeECMAScript 5isConcatSpreadablecommand-linemakeshebangtoolsgroupByjsdomwalkamazonES2018URLreadablefnmatchacorndescriptorsframeroptimizercolumnstranspilestatusfilevalidclassnamesObservablesendpointcopycall-boundfastifycharacterUnderscorenativepropertiesutilitiesSymbolTypeBoxECMAScript 2017callbackhas-ownlazybcrypttoArrayObject.fromEntriesreadglobalArray.prototype.includesredacttc39handlersgesturesRxJSsignalsenumerableObject.isES2022typescriptmobilemaptypedpropES2017findLastsigtermequalconsolecss lessfunctiondeepcopywindowStyleSheetsameValueZerostringifierjavascriptiterationoptionArray.prototype.findLastpromisemixinses7settingscomputed-typescall-bindjshintjson-schema-validatorcjkregularpolyfillpasswordcollection.es6tacithelperstypeerrorArray.prototype.filtertranspilerdynamodbECMAScript 2016binariesECMAScript 2020ECMAScript 2021pusherrortoobjecttypesArray.prototype.flattentelephone
3.6.73

11 months ago

3.6.72

11 months ago

3.6.71

11 months ago

3.6.70

11 months ago

3.6.69

11 months ago

3.6.68

11 months ago

3.6.67

11 months ago

3.6.66

11 months ago

3.6.65

11 months ago

3.6.64

11 months ago

3.6.63

11 months ago

3.6.62

11 months ago

3.6.61

11 months ago

3.6.60

11 months ago

3.6.59

11 months ago

3.6.58

11 months ago

3.6.57

11 months ago

3.6.56

11 months ago

3.6.55

11 months ago

3.6.54

11 months ago

3.6.53

11 months ago

3.5.53

11 months ago

3.4.53

11 months ago

3.4.52

12 months ago

3.4.51

12 months ago

3.4.50

12 months ago

3.4.49

12 months ago

3.4.48

12 months ago

3.4.47

12 months ago

3.4.46

12 months ago

3.4.45

12 months ago

3.4.44

12 months ago

3.3.44

12 months ago

3.3.43

12 months ago

3.3.42

12 months ago

3.3.41

12 months ago

3.3.40

12 months ago

3.3.39

12 months ago

3.3.38

12 months ago

3.3.37

12 months ago

3.3.36

12 months ago

3.3.35

12 months ago

3.3.34

12 months ago

3.3.33

1 year ago

3.3.32

1 year ago

3.3.31

1 year ago

3.3.30

1 year ago

3.3.29

1 year ago

3.3.28

1 year ago

3.3.27

1 year ago

3.3.26

1 year ago

3.3.25

1 year ago

3.2.25

1 year ago

3.2.24

1 year ago

3.2.23

1 year ago

3.2.22

1 year ago

2.2.22

1 year ago

2.2.21

1 year ago

2.2.20

1 year ago

2.2.19

1 year ago

2.2.18

1 year ago

2.1.18

1 year ago

2.1.17

1 year ago

2.1.16

1 year ago

2.1.15

1 year ago

2.1.14

1 year ago

2.1.13

1 year ago

2.1.12

1 year ago

2.1.11

1 year ago

2.0.11

1 year ago

2.0.10

1 year ago

1.0.10

1 year ago

1.0.9

1 year ago

1.0.8

1 year ago

1.0.7

1 year ago

1.0.6

1 year ago

1.0.5

1 year ago

1.0.4

1 year ago

1.0.3

1 year ago

1.0.2

1 year ago

1.0.1

1 year ago

1.0.0

1 year ago