Jump to content

Apache Beam

From Alfawiki
Apache Beam
Company typeOpen source software project
IndustrySoftware, Big data
Founded2014
FounderGoogle
Area served
Worldwide
ProductsUnified programming framework for data processing pipelines (ETL, batch, streaming)
ParentApache Software Foundation
Websitebeam.apache.org

Apache Beam represents an open source unified programming framework designed for defining and executing data processing pipelines, encompassing ETL, batch, and streaming workflows. Developers build Beam pipelines using available SDKs, which can then be executed on compatible runners—distributed processing engines such as Apache Flink, Apache Samza, Apache Spark, and Google Cloud Dataflow.

History

The foundation of Apache Beam[1] lies in the Dataflow programming model introduced in a 2015 publication. This model is an evolution of Google's earlier distributed processing systems, particularly FlumeJava and Millwheel. In 2014, Google launched an open SDK based on the Dataflow model, accompanied by tools to run Dataflows both locally and on the Google Cloud Platform.

Timeline

Apache Beam follows a release schedule with minor updates approximately every six weeks.

Version Release date
Template:Version 2025-07-01
Template:Version 2025-05-12
Template:Version 2025-03-31
Template:Version 2025-02-18
Template:Version 2025-01-21
Template:Version 2024-11-25
Template:Version 2024-10-17
Template:Version 2024-09-11
Template:Version 2024-08-15
Template:Version 2024-08-06
Template:Version 2024-06-26
Earlier releases
Version Release date
Template:Version 2024-05-01
Template:Version 2024-03-25
Template:Version 2024-02-14
Template:Version 2024-01-04
{{#vardefine:versionlist | "2.52,2.51,2.50,2.49,2.48,2.47,2.46,2.45,2.44,2.43,2.42,2.41,2.40,2.39,2.38,2.37,2.36,2.35,2.34,2.33,2...

See also

References

Version Release date
  1. ↑ Cite error: Invalid <ref> tag; no text was provided for refs named google.com