21.1.0 • Published 2 months ago

truebase v21.1.0

Weekly downloads
-
License
-
Repository
github
Last release
2 months ago

import header.scroll title TrueBase BETA class beta BETA

Information you can trust

Software for building computable encyclopedias

import demos.scroll

startColumns 2

? Where can I try it? The examples above are live-you can play with them right on this page! PLDB.pub and CancerDB.com are both powered by TrueBase. https://pldb.pub PLDB.pub https://cancerdb.com CancerDB

? Where are the Release Notes? Here link releaseNotes.html

? I need a TrueBase for X, can you build one for me? Yes. We offer a paid complete white-glove service for moonshot problems. You can also email moonshots@truebase.pub for a custom quote. https://buy.stripe.com/cN2aIq82JfD7fqU9AJ white-glove service

? What is TrueBase? TrueBase is a new kind of database designed for modeling complex systems. TrueBase is like Wikipedia but fully computable—the focus is on comparable data, not narratives. A TrueBase is a collection of files (concepts which adhere to column schemas) that compile to a single table ("the model") that can be used to answer questions in a data backed way. TrueBase is a way to build an "expert system" out of simple parts. A TrueBase model is fully human readable and auditable—there are no black box parameters.

? What is the relationship between TrueBase and LLMs? TrueBase will benefit greatly from LLMs. First, they will provide a powerful and easy new way to query a TrueBase using natural language. Second, they will help experts building TrueBases add data, identify and fix mistakes, and even help improve the schemas of a TrueBase.

TrueBases may also help solve the "hallucination problem" in LLMs by providing trustworthy data that can be queried and referenced when answering prompts.

? Why TrueBase? Modeling complex systems is hard. In addition to just dealing with complexity one has to worry about propaganda, advertisements, paywalls, trackers, licenses, proprietary formats and so forth. TrueBase is designed to be a simply way to slowly build complex models while making no compromises on truth.

? What are the features?

  • Data is stored in plain text
  • Zero syntax
  • Every word is computable
  • Version control and blockchain handled by git
  • One notation for data, schema, querying, and visualization
  • Entire schema and data can be pivoted in a single commit
  • Every word is error checked
  • Everything is public domain
  • Decentralized so every user can have their own complete copy
  • All data readily available as CSV, JSON, SQLite and Tree Notation
  • Read and write data using file system or via the WebUI

? How do I build a TrueBase on my own? The cutting-edge option is to work from the demo PlanetsDB TrueBase: code git clone https://github.com/breck7/truebase cd truebase npm install . npm run local

Most people will want to use the Getting Started Guide. We are currently beta testing the Getting Started Guide. If you'd like to join the waitlist, please email waitlist@truebase.pub.

? How does it work, in theory? TrueBase helps people build the smallest expert models that can truthfully answer the most valuable questions.

Lack of noise

TrueBase is very minimal. It's built on Tree Notation, a syntax-free notation that can support any data structure. The focus is on structured data (with a small amount of unstructured fields to help data editors). Because of this TrueBase allows for expert models that weigh-in at megabytes, not terabytes.

Triangle of Truth

Traditional encyclopedias are weakly linked articles about things. Question sites are weakly typed narrative answers to user questions. TrueBase is different.

TrueBase is focused on computable structured data. We call this the "triangle of truth": Concepts, Measures and Models.

Concepts

First we start adding concepts to the database. Each concept is a single file about a thing. But it's not enough just to just list and describe the things.

Measures

Typed measures are what make a TrueBase different from a Wiki. A typical TrueBase will have hundreds, to thousands, to tens of thousands of measures.

Our critical question bet is that to really reveal the truth it's just as critical to identify what we don't know and/or what's been purposefully left out. One byte of structured data can be worth more than a billion words of narrative. Especially in expert datasets with no easily repeatable results this is very important. For example, a database of academic studies might be harmful without a measure indicating who paid for a study.

So in a TrueBase, it's just as easy to add a measure as it is to add a concept. Sometimes adding a new measure can completely flip the model or change the certainty of a model, more so than adding more answers to existing measures.

Models

Models are the fun part. Once we have a lot of data, you can use that to build your own models about how things work.

Interconnectedness

Interconnectedness of the data is very important. When you put the effort in to integrate disparate data into one model, the resulting model is worth more than the sum of its parts. Not only does it become more useful because it's easier to compute over, but it also becomes increasingly difficult to lie as the size of a TrueBase increases due to the increasing number of logical constraints that the data would have to violate. A big TrueBase is hard to vary.

? How does TrueBase work, in practice? In TrueBase, you store your data in plain text files. This means your data is readily accessible—you can even view and edit it by hand. You put your data in Tree Notation form. This means your data is all signal—no noise. This ensures you've minimized your data and made it as clean as possible. This also helps make it timeless as no matter what format you need your data in the future it will be preserved in the simplest form possible. You will never regret putting your data in a TrueBase. https://treenotation.org Tree Notation A growing ecosystem of tooling makes it easy to augment your TrueBase with data from Large Language Models, web crawlers, and APIs, and run integrity checks, steadily making your TrueBase truer and truer. You write your TrueBase schemas using the Grammar Language (a Tree Language) which enforces correctness, autofixes errors, and gives you tooling like autocomplete and syntax highlighting. https://jtree.treenotation.org/langs/grammar Grammar Language You can query your TrueBase using TQL (also a Tree Language). https://truebase.pub/tql TQL You can display your data using Scroll (also a Tree Language). https://scroll.pub Scroll So there are many pieces to the TrueBase system, but really just one thing to learn: Tree Notation. Your data, your query language, your schemas, your display language are all in these simple plain text Tree Languages.

? On what systems does TrueBase run? TrueBase runs on Tree Languages, and currently the last mile code is written in Javascript. Therefore TrueBase can run on any device supporting modern Javascript.

? Is TrueBase public domain? Yes. TrueBase is public domain and is designed for public domain databases.

? Since TrueBase is so simple, what hasn't it been done before? For large databases, TrueBase requires fast computers and fast SSD hard drives. TrueBase was not possible before the Apple M1s, which shipped in December 2020. Here is a post about early unsuccessful attempts at using TrueBase before Apple M1s. https://breckyunits.com/building-a-treebase-with-6.5-million-files.html early unsuccessful attempts

permalink index.html

import footer.scroll

css .beta {font-size: 10px;vertical-align: super;}

21.0.0

2 months ago

21.1.0

2 months ago

19.0.0

11 months ago

18.0.1

11 months ago

18.0.0

11 months ago

17.3.0

12 months ago

20.0.0

11 months ago

18.1.0

11 months ago

17.2.3

12 months ago

17.2.2

12 months ago

17.2.1

12 months ago

17.2.0

12 months ago

17.1.0

12 months ago

17.0.2

12 months ago

17.0.1

12 months ago

17.0.0

12 months ago

16.10.0

12 months ago

16.9.0

12 months ago

16.8.0

12 months ago

16.7.0

12 months ago

16.6.0

1 year ago

16.5.0

1 year ago

16.4.2

1 year ago

16.4.1

1 year ago

16.4.0

1 year ago

16.3.0

1 year ago

16.2.0

1 year ago

16.1.0

1 year ago

16.0.0

1 year ago

15.2.0

1 year ago

15.1.0

1 year ago

15.0.3

1 year ago

15.0.2

1 year ago

15.0.1

1 year ago

15.0.0

1 year ago

14.7.1

1 year ago

14.7.0

1 year ago

14.6.0

1 year ago

14.5.0

1 year ago

14.4.0

1 year ago

14.3.0

1 year ago

14.2.0

1 year ago

14.1.0

1 year ago

14.0.1

1 year ago

14.0.0

1 year ago

13.1.0

1 year ago

13.0.0

1 year ago

12.0.1

1 year ago

12.0.0

1 year ago

11.6.0

1 year ago

11.5.0

1 year ago

11.4.0

1 year ago

11.3.0

1 year ago

11.2.1

1 year ago

11.2.0

1 year ago

11.1.0

1 year ago

11.0.1

1 year ago

11.0.0

1 year ago

10.0.0

1 year ago

9.0.2

1 year ago

9.0.1

1 year ago

9.0.0

1 year ago

8.0.0

1 year ago

7.2.1

1 year ago

7.2.0

1 year ago

7.1.0

1 year ago

7.0.1

1 year ago

7.0.0

1 year ago

6.1.1

1 year ago

6.1.0

1 year ago

6.0.0

1 year ago

5.0.2

1 year ago

5.0.1

1 year ago

5.0.0

1 year ago

4.3.0

1 year ago

4.2.0

1 year ago

4.1.0

1 year ago

4.0.0

1 year ago

3.0.2

1 year ago

3.0.1

1 year ago

3.0.0

1 year ago

2.0.1

1 year ago

2.0.0

1 year ago

1.3.0

1 year ago

1.2.0

1 year ago

1.1.0

1 year ago

1.0.0

1 year ago