Jump to content

Apache ORC

From Alfawiki
Apache ORC
Company typeOpen-source software
IndustryData storage format
FoundedFebruary 2013; 13 years ago (2013-02)
FounderHortonworks and Facebook
ProductsColumnar data storage format
Websiteorc.apache.org

Apache ORC (Optimized Row Columnar) represents a free and open-source column-based data storage format optimized for high-performance data operations. It serves as an alternative to other columnar formats within the Apache Hadoop ecosystem, such as RCFile and Apache Parquet. This format is extensively adopted by numerous data processing frameworks, including Apache Spark, Apache Hive, Apache Flink, and Apache Hadoop.

Launched in February 2013 through a partnership between Hortonworks and Facebook, ORC was created to enhance efficiency in large-scale data scenarios. Shortly thereafter, in March 2013, the Apache Parquet format was introduced by Cloudera and Twitter as a rival columnar storage technology.

The Apache ORC format enjoys wide compatibility with leading cloud services and analytic tools, including Amazon Web Services' AWS Glue,<ref> Google Cloud Platform's BigQuery,<ref> and the popular data analysis library Pandas (software).<ref>

History

Version Initial release date Current version Release date
Template:Version 2016-01-25 1.0.0 2016-01-25
Template:Version 2016-06-10 1.1.2 2016-07-08
Template:Version 2016-08-25 1.2.3 2016-12-12
Template:Version 2017-01-23 1.3.4 2017-10-16
Template:Version 2017-05-08 1.4.5 2019-12-09
Template:Version 2018-05-14 1.5.13 2021-09-15
Template:Version 2019-09-03 1.6.14 2022-04-14
Template:Version 2021-09-15 1.7.8 2023-01-21
Template:Version 2022-09-03 1.8.9 2025-05-06
Template:Version 2023-06-28 1.9.6 2025-05-06
Template:Version 2024-03-08 2.0.5 2025-05-06
Template:Version 2025-01-09 2.1.2 2025-05-06

See also

References