0.0.2 • Published 9 months ago

evidence-connector-s3 v0.0.2

Weekly downloads
-
License
MIT
Repository
-
Last release
9 months ago

Evidence S3 Source Plugin

Install this plugin in an Evidence app with

npm install evidence-connector-s3

Register the plugin in your project in your evidence.plugins.yaml file with

datasources:
  evidence-connector-s3: {}

Launch the development server with npm run dev and navigate to the settings menu (localhost:3000/settings) to add a data source using this plugin.

Source Options

OptionDescription
accessKeyIdAccess Key ID for the AWS S3 bucket.
secretAccessKeySecret Access Key for the AWS S3 bucket.
regionRegion for the AWS S3 bucket.

Source Queries

Source queries are expected to be in the form of a SQL file with the extension .sql. Use DuckDB syntax for reading files from S3.

from 's3://<bucket>/<path>.<format>'

Where format is one of Parquet, CSV, or ORC.

S3 Configuration

You will need to create or use an IAM user with an Access Key.

Your user should have an access policy that allows DuckDB to read the files in the bucket.

Example policy for a user, accessing a bucket called my-s3-bucket

{
	"Version": "2012-10-17",
	"Statement": [
		{
			"Effect": "Allow",
			"Action": [
				"s3:ListBucket",
				"s3:GetObject",
				"s3:PutObject",
				"s3:DeleteObject",
				"s3:AbortMultipartUpload"
			],
			"Resource": [
				"arn:aws:s3:::my-s3-bucket",
				"arn:aws:s3:::my-s3-bucket/*"
			]
		}
	]
}
0.0.2

9 months ago

0.0.1

9 months ago