Opinionated serverless event analytics pipeline
scripts/build_cluster.sh
https://github.com/camilb/prometheus-kubernetes
mkdir -p $GOPATH/src/github.com/doitintl/
git clone git@github.com:doitintl/banias.git
cd banias/frontend
export PROJECT_ID=your_project_id
scripts/dockerize.sh
kubectl create secret generic pubsub-key --from-file=key.json=filename
BANIAS_PROJECTID: "my-project"
to your project name in deployfrontend-configmap.yaml
image: "gcr.io/my-project/banias-frontend:test"
to your project name and version in deploy/frontend-deployment.yaml
deploy/frontend-configmap.yaml
kubctl apply -f deploy/.
Project ID - BANIAS_PROJECTID: “your-project-id”
Debug flag for log prints - default level is Info. - BANIAS_DEBUG: “false”
Pub/Sub topic name - BANIAS_TOPIC: “banias”
HTTP port - BANIAS_PORT: “8081”
Prometheus port - BANIAS_METRICSPORT: “8080”
Maximum size of a single batch - BANIAS_PUBSUBMAXBATCH: “1000”
Number of pools that listen for events from users - BANIAS_PUBSUBAGGRIGATORS: “30”
Max time to pass in seconds before publishing. - BANIAS_PUBSUBMAXPUBLISHDELAY: “5”
The default maximum amount of goroutines for publishing - BANIAS_MAXPUBSUBGOROUTINESAMOUNT: “262144”
The default maximum idle duration of a goroutine - BANIAS_MAXPUBSUBGOROUTINEIDLEDURATION: “10”