A Low Code Structured Approach to Deploying Apache Beam ML Workloads on Kubernetes using Beamstack

Olufunbi Babalola | Sep 27, 2024 min read

Overview of Beamstack


Beamstack is an open-source framework currently under development, aimed at facilitating the deployment of Machine Learning and GenAI workflow pipelines with Apache Beam on Kubernetes. Beamstack provides a robust Command Line Interface (CLI) that can potentially reduce pipeline deployment complexity and timelines drastically. It also possesses great monitoring and visualization features.

Architecture Overview


Key Features of Beamstack


Beamstack Use Cases & Demos


Beamstack can currently used in the following ways

Example Use Case: Creating Text Embedding + Saving it to Vector Database

Beamstack Demo

Future Roadmap