predigt.io

predigt.io ↗
AI Platform NATS Messaging Microservices Kubernetes Own Product

predigt.io is a fully self-developed SaaS platform for German-speaking congregations — realised from product idea to production operation under sole responsibility. The platform transcribes, translates and analyses sermons automatically in eleven languages and makes them semantically searchable.

At its core is an AI pipeline of three transcription engines: AssemblyAI for express results, OpenAI Whisper on a dedicated GPU for maximum precision and Claude (Anthropic) for summaries, chapter markers and contextual evaluations. All three engines run in parallel and are routed cost-aware.

Communication between eleven independent microservices is handled exclusively via NATS JetStream — with Object Store for audio transport, KV Store for distributed pipeline state and strictly typed Protobuf schemas as service contract. No synchronous RPC, no direct service-to-service dependency.

The operation runs on a self-built Hetzner Kubernetes cluster with a full observability stack, GitLab CI/CD and Helm-based deployments.

11Microservices
4Languages (Go · Java · Python · TS)
3LLM Providers
11Translation Languages
NATS JetStreamProtobufKubernetesHelmGoJava 21PythonTypeScriptClaudeAssemblyAIWhisper GPUPostgreSQLMongoDBGitLab CI/CDPrometheusLokiGrafana
arc42 · Building Block View (Level 1)
CLIENTS Web App React / Vite Mobile App React Native Firebase Auth Google + Microsoft OAuth QUICKSCRIPT BACKEND (Go · Gin) HTTP Handlers REST + WebSocket Auth Middleware JWT Verify Services Download · AI · FCM Repository PostgreSQL NATS Service JetStream · Notify · GPU Dispatch · Worker Coord Worker Health Monitor (Sermo-Captum) NATS JETSTREAM sermo-captum-js audio fetch pipeline gpu-transcription-js Whisper dispatch notify-js notify.user.{hash}.* Object Store Audio 15 GB · GPU 10 GB (4h TTL) KV Store Pipeline-State · Config-Watcher WORKER FLEET Sermo-Captum Workers Go · yt-dlp · DataImpulse / NordVPN Whisper GPU Worker Python · FastAPI · CUDA · large-v3 WisdomNet Go · Multi-LLM · MongoDB AI SERVICES Claude (Anthropic) Summary · Chapters · Translation AssemblyAI Express Transcription Whisper large-v3 GPU · OpenAI · Precision Transcription ChatGPT · Gemini (Fallback) INFRASTRUCTURE Kubernetes (Hetzner Cloud) Helm · Ingress · cert-manager GitLab CI/CD + Watchtower Auto-Deploy · Image Registry Prometheus · Loki · Grafana DATA STORES PostgreSQL 16 Users · Jobs Transcriptions MongoDB AI Responses Documents Protobuf Schemas nats-schemas Repo · Go · Java · Python Stubs HTTP/WSS publish HTTPS NATS Legend Backend System Messaging (NATS) AI Services Worker Fleet synchronous call (HTTP/gRPC) asynchronous (NATS publish) data access

Target Communication Architecture · Critical Infrastructure

Regulated Energy Provider · Critical Infrastructure · Germany
KRITIS arc42 High Availability IT Architecture

For a major operator of critical energy infrastructure, a target communication architecture for time-critical balancing energy processes was developed in collaboration with several partner companies. The project is subject to the BSI KRITIS regulation — every communication path must demonstrate an availability of 99.96 % across the entire process chain.

The core task was the systematic analysis of existing communication paths between European market platforms and the operator's backend systems, the evaluation of alternatives and the development of a consolidated architecture proposal according to arc42 — ready for decision by the relevant technical and IT committees.

The derivation took into account the procedural framework conditions of time-critical balancing energy processes, financial and time-based evaluation of all variants, and scenarios for a possible cloud migration of central system components.

severalPartner Companies
99.96 %SLA Requirement
arc42Documentation Standard
arc42KRITISBSIIT-SecuritySFTPMFTHigh AvailabilityRedundancy ConceptsIT ArchitectureCloud MigrationCompliance
arc42 · Context Boundary
OPERATOR BACKEND Retrieval System · Sync Adapter Retrieval · Plausibility Check · Confirmation Version Management · Logging TARGET ARCHITECTURE (Result) 99.96 % SLA · Redundancy · BSI-KRITIS MARKET PLATFORMS European Balancing Exchanges Tender Clearing Time Window Specifications Merit-Order Extraction PARTNER COMPANIES Other Grid Operators D-A-CH + Benelux Cross-Company COMM. INFRASTRUCTURE Standard Protocols MFT · SFTP Redundant Paths DECISION Technical and IT Committees Approval Committee arc42 Documentation COMPLIANCE BSI-KRITIS-VO ISMS Process IT Security Requirements CLOUD OPTION Cloud Migration Core System Evaluation (qualitative) Time · Resources Control Signals Coordination Transport Path Architecture Proposal KRITIS Proof Option Evaluation Availability Requirement: 99.96 % across the entire process chain per product type

Kafka Integration Layer · Core Banking

Cantonal Bank · Financial Sector · Switzerland
Apache Kafka Microservices OpenShift Core Banking

To extend a core banking platform (Avaloq), a Kafka-based integration layer was designed and implemented. The goal was to decouple the grown monolithic interfaces through a reliable, scalable event streaming backbone — without interrupting ongoing banking operations.

Spring Boot microservices on OpenShift handle the domain processing. Connecting the Avaloq core system, readiness probes, default timeout analysis and performance measurements under load were also part of the task, as was advising the teams on Kafka concepts: partition sizing, event structure and versioning, linger.ms/batch.size tuning and cluster failover.

For mobile apps (Zak), REST interfaces were designed and implemented. An ELK stack enables end-to-end latency analysis across the entire Kafka pipeline.

AvaloqCore Banking System
OpenShiftContainer Platform
ELKObservability
Apache KafkaSpring BootOpenShiftKubernetesGoElasticsearchLogstashKibanaPrometheusJenkinsRESTPostgreSQLAvaloqScrum
arc42 · Building Block View (Level 1) — Kafka Integration Layer
AVALOQ Core Banking Credit · Portfolio Booking · Compliance Default Timeout Analysis & Tuning KAFKA INTEGRATION LAYER Apache Kafka Cluster Broker 1–3 Replication ZooKeeper Cluster Coordination Topics · Partitions · Retention linger.ms / batch.size Tuning Microservices (Spring Boot) Integration Svc Avaloq Adapter Credit Svc Credit Advisory Mobile API REST · Zak App Base Svc Readiness Probe OpenShift Cluster Jenkins CI · Helm · Prometheus Readiness + Liveness Probes OBSERVABILITY ELK Stack Elasticsearch · Logstash · Kibana Prometheus + Grafana Kafka Metrics · Service Health End-to-End Latency Timestamps · Pipeline Measurement Spring Boot Actuator · JMX CONSUMER Business Applications Omnium · Credit Advisory Mobile App Zak REST API · iOS · Android KAFKA ADVISORY Partition Sizing Event Structure & Versioning Cluster Failover Team Coaching Performance Tuning Events publish consume REST / Events Metrics Sync·Timeout

Is your project next?