@json2csv/formatters v7.0.6
@json2csv/formatters
A formatter is function a used by json2csv (in any of its flavours) to convert javascript values into plain text before adding it into the CSV as a cell.
Supported formatters are given by the types returned by typeof:
undefinedbooleannumberbigintstringsymbolfunctionobject
And a special type that only applies to headers:
headers
Pay special attention to the string formatter since other formatters like the headers or object formatters, rely on the string formatter for the stringification of their value..
json2csv ecosystem
There are multiple flavours of json2csv where you can use formatters:
- Plainjs: Includes the
ParserAPI and a newStreamParserAPI which doesn't the conversion in a streaming fashion in pure js. - Node: Includes the
Node TransformandNode Async ParserAPIs for Node users. - WHATWG: Includes the
WHATWG Transform StreamandWHATWG Async ParserAPIs for users of WHATWG streams (browser, Node or Deno). - CLI: Includes the
CLIinterface.
Built-in formatters
There is a number of built-in formatters provided by this package.
import {
default as defaultFormatter,
number as numberFormatter,
string as stringFormatter,
stringQuoteOnlyIfNecessary as stringQuoteOnlyIfNecessaryFormatter,
stringExcel as stringExcelFormatter,
symbol as symbolFormatter,
object as objectFormatter,
} from '@json2csv/formatters';Default
This formatter just relies on standard JavaScript stringification.
This is the default formatter for undefined, boolean, number and bigint elements.
It's not a factory but the formatter itself.
{
undefined: defaultFormatter,
boolean: defaultFormatter,
number: defaultFormatter,
bigint: defaultFormatter,
}Number
Format numbers with a fixed amount of decimals
The formatter needs to be instantiated and takes an options object as arguments containing:
separator- String, separator to use between integer and decimal digits. Defaults to.. It's crucial that the decimal separator is not the same character as the CSV delimiter or the result CSV will be incorrect.decimals- Number, amount of decimals to keep. Defaults to all the available decimals.
{
// 2 decimals
number: numberFormatter(),
// 3 decimals
number: numberFormatter(3)
}String
Format strings quoting them and escaping illegal characters if needed.
The formatter needs to be instantiated and takes an options object as arguments containing:
quote- String, quote around cell values and column names. Defaults to".escapedQuote- String, the value to replace escaped quotes in strings. Defaults to double-quotes (for example"").
This is the default for string elements.
{
// Uses '"' as quote and '""' as escaped quote
string: stringFormatter(),
// Use single quotes `'` as quotes and `''` as escaped quote
string: stringFormatter({ quote: '\'' }),
// Never use quotes
string: stringFormatter({ quote: '' }),
// Use '\"' as escaped quotes
string: stringFormatter({ escapedQuote: '\"' }),
}String Quote Only Necessary
The default string formatter quote all strings. This is consistent but it is not mandatory according to the CSV standard. This formatter only quote strings if they don't contain quotes (by default "), the CSV separator character (by default ,) or the end-of-line (by default \n or \r\n depending on you operating system).
The formatter needs to be instantiated and takes an options object as arguments containing:
quote- String, quote around cell values and column names. Defaults to".escapedQuote- String, the value to replace escaped quotes in strings. Defaults to 2xquotes(for example"").eol- String, overrides the default OS line ending (i.e.\non Unix and\r\non Windows). Ensure that you use the sameeolhere as in the json2csv options.
{
// Uses '"' as quote, '""' as escaped quote and your OS eol
string: stringQuoteOnlyIfNecessaryFormatter(),
// Use single quotes `'` as quotes, `''` as escaped quote and your OS eol
string: stringQuoteOnlyIfNecessaryFormatter({ quote: '\'' }),
// Never use quotes
string: stringQuoteOnlyIfNecessaryFormatter({ quote: '' }),
// Use '\"' as escaped quotes
string: stringQuoteOnlyIfNecessaryFormatter({ escapedQuote: '\"' }),
// Use linux EOL regardless of your OS
string: stringQuoteOnlyIfNecessaryFormatter({ eol: '\n' }),
}String Excel
Converts string data into normalized Excel style data after formatting it using the given string formatter.
The formatter needs to be instantiated and takes no arguments.
{
string: stringExcelFormatter,
}Symbol
Format the symbol as its string value and then use the given string formatter i.e. Symbol('My Symbol') is formatted as "My Symbol".
The formatter needs to be instantiated and takes an options object as arguments containing:
stringFormatter- String formatter to use to stringify the symbol name. Defaults to the built-instringFormatter.
This is the default for symbol elements.
{
// Uses the default string formatter
symbol: symbolFormatter(),
// Uses custom string formatter
// You rarely need to this since the symbol formatter will use the string formatter that you set.
symbol: symbolFormatter(myStringFormatter()),
}Object
Format the object using JSON.stringify and then the given string formatter.
Some object types likes Date or Mongo's ObjectId are automatically quoted by JSON.stringify. This formatter, remove those quotes and uses the given string formatter for correct quoting and escaping.
The formatter needs to be instantiated and takes an options object as arguments containing:
stringFormatter- tring formatter to use to stringify the symbol name. Defaults to our built-instringFormatter.
This is the default for function and object elements. function's are formatted as empty .
{
// Uses the default string formatter
object: objectFormatter(),
// Uses custom string formatter
// You rarely need to this since the object formatter will use the string formatter that you set.
object: objectFormatter(myStringFormatter()),
}Custom formatters
Users can create their own formatters as simple functions.
function formatType(itemOfType) {
// format type
return formattedItem;
}or using ES6
const formatType = (itemOfType) => {
// format type
return itemOfType;
};For example, let's format functions as their name or 'unknown'.
const functionNameFormatter = (item) => item.name || 'unknown';Then you can add { function: functionNameFormatter } to the formatters object.
A less trivial example would be to ensure that string cells never take more than 20 characters.
const fixedLengthStringFormatter = (stringLength, ellipsis = '...') =>
(item) =>
item.length <= stringLength
? item
: `${item.slice(0, stringLength - ellipsis.length)}${ellipsis}`;Then you can add { string: fixedLengthStringFormatter(20) } to the formatters object.
Or fixedLengthStringFormatter(20, '') to not use the ellipsis and just clip the text.
As with the sample transform in the previous section, the reason to wrap the actual formatter in a factory function is so it can be parameterized easily.
Keep in mind that the above example doesn't quote or escape the string which is problematic. A more realistic example could use our built-in string formatted to do the quoting and escaping like:
import { string as defaultStringFormatter } from 'json2csv/formatters';
const fixedLengthStringFormatter = (stringLength, ellipsis = '...', stringFormatter = defaultStringFormatter()) =>
(item) =>
item.length <= stringLength
? item
: stringFormatter(`${item.slice(0, stringLength - ellipsis.length)}${ellipsis})`;How to use formatters
Formatters are configured in the formatters option when creating a parser.
Programmatic APIs
import { Parser } from '@json2csv/plainjs';
import { number as numberFormatter } from '@json2csv/formatters';
import { fixedLengthStringFormatter } from './custom-formatters';
try {
const opts = {
formatters: {
number: numberFormatter({ decimals: 3, separator: ',' }),
string: fixedLengthStringFormatter(20)
}
};
const parser = new Parser(opts);
const csv = parser.parse(myData);
console.log(csv);
} catch (err) {
console.error(err);
}CLI
At the moment, only some options of the string built-in formatters are supported by the CLI interface.
$ json2csv -i input.json --quote '"' --escaped-quote '\"'or if you want to use the String Excel instead:
$ json2csv -i input.json --excel-stringsComplete Documentation
See https://juanjodiaz.github.io/json2csv/#/advanced-options/formatters.
License
See LICENSE.md.