Apache Beam
| Company type | Open source software project |
|---|---|
| Industry | Software, Big data |
| Founded | 2014 |
| Founder | |
Area served | Worldwide |
| Products | Unified programming framework for data processing pipelines (ETL, batch, streaming) |
| Parent | Apache Software Foundation |
| Website | beam |
Apache Beam represents an open source unified programming framework designed for defining and executing data processing pipelines, encompassing ETL, batch, and streaming workflows. Developers build Beam pipelines using available SDKs, which can then be executed on compatible runners—distributed processing engines such as Apache Flink, Apache Samza, Apache Spark, and Google Cloud Dataflow.
History
The foundation of Apache Beam[1] lies in the Dataflow programming model introduced in a 2015 publication. This model is an evolution of Google's earlier distributed processing systems, particularly FlumeJava and Millwheel. In 2014, Google launched an open SDK based on the Dataflow model, accompanied by tools to run Dataflows both locally and on the Google Cloud Platform.
Timeline
Apache Beam follows a release schedule with minor updates approximately every six weeks.
| Version | Release date |
|---|---|
| Template:Version | 2025-07-01 |
| Template:Version | 2025-05-12 |
| Template:Version | 2025-03-31 |
| Template:Version | 2025-02-18 |
| Template:Version | 2025-01-21 |
| Template:Version | 2024-11-25 |
| Template:Version | 2024-10-17 |
| Template:Version | 2024-09-11 |
| Template:Version | 2024-08-15 |
| Template:Version | 2024-08-06 |
| Template:Version | 2024-06-26 |
| Version | Release date |
|---|---|
| Template:Version | 2024-05-01 |
| Template:Version | 2024-03-25 |
| Template:Version | 2024-02-14 |
| Template:Version | 2024-01-04 |
See also
References
| Version | Release date |
|---|
- ↑ Cite error: Invalid
<ref>tag; no text was provided for refs namedgoogle.com
- Articles with short description
- Apache Software Foundation
- Projects under Apache Software Foundation
- Big data solutions
- Cluster-based computing
- Distributed stream analytics
- Software developed by Google
- Hadoop ecosystem
- Java technology
- Open source software written in Java
- Free software programmed in Java (programming language)
- Pages with reference errors