@launchql/job-api-server v0.1.2

jobs

getting started

install openfaas on your kubernetes cluster

https://www.openfaas.com/

install tables into Postges

make sure you have lql installed

npm install -g @launchql/cli

make sure you have the jobs SQL installed in your Postgres database

git clone https://github.com/pyramation/pg-utils
cd pg-utils
lql deploy --recursive --createdb --database jobs --yes --project launchql-extension-jobs

deploy job worker

create a deployment that runs @launchql/openfaas-job-worker using nodejs in k8s

kubectl apply -f ./k8s/service.yaml
kubectl apply -f ./k8s/deployment.yaml

build and deploy cloud functions

kubectl port-forward -n openfaas svc/gateway-external 8080:8080

export OPENFAAS_URL=gateway-external.openfaas.svc.cluster.local:8080

yarn build
faas build -f stack.prod.yml 
faas push -f stack.prod.yml 
faas remove -f stack.prod.yml 
faas deploy -f stack.prod.yml 

call it!

http://gateway-external.openfaas.svc.cluster.local:8080/function/hello-openfaas

logging

pod-logs webinc job-worker
pod-logs openfaas-fn example-fn

insert a job

SELECT app_jobs.add_job('example-fn', json_build_object('hello', 'world!'));

insert a scheduled job

SELECT app_jobs.add_scheduled_job(
    'example-fn',
    json_build_object('hello', 'world!'),
    json_build_object(
        'start',
        NOW(),
        'end',
        NOW() + '1 day'::interval,
        'rule',
        '*/1 * * * *'
    )
);

create a trigger on insert

DROP SCHEMA IF EXISTS my_test_schema CASCADE;

CREATE SCHEMA IF NOT EXISTS my_test_schema;

CREATE TABLE my_test_schema.my_table (
    id serial PRIMARY KEY,
    name text NOT NULL,
    val numeric DEFAULT 0
);

CREATE FUNCTION my_test_schema.trigger_job ()
    RETURNS TRIGGER
    AS $$
BEGIN
    PERFORM
        app_jobs.add_job (TG_ARGV[0], json_build_object('id', NEW.id));
    RETURN NEW;
END;
$$
LANGUAGE plpgsql;

CREATE TRIGGER my_trigger
    AFTER INSERT ON my_test_schema.my_table
    FOR EACH ROW
    EXECUTE PROCEDURE my_test_schema.trigger_job ('example-fn');

INSERT INTO my_test_schema.my_table (name, val)
    VALUES ('name1', 0), ('name2', 1), ('name3', 2);

more in depth setup

It's a bit hacky, but it was the most secure and consistent way for BOTH dev + prod I could figure it out.

First edit your /etc/hosts file:

127.0.0.1 gateway-external.openfaas.svc.cluster.local

the deploy requires that you have OPENFAAS_URL=gateway-external.openfaas.svc.cluster.local:8080, which means you should proxy the openfaas gateway if it's not exposed:

kubectl port-forward -n openfaas svc/gateway-external 8080:8080

Then you can build

yarn build:dev
yarn remove:dev
yarn deploy:dev

If you need to login,

echo -n $PASSWORD | faas-cli login --username $USER --password-stdin

Or you can specify your gateway

echo -n $PASSWORD | faas-cli login --username $USER --password-stdin --gateway 127.0.0.1:31112

TODOs

• check if openfaas is up and running before attempting to request