Sqoop
| Company type | Open source software project (retired) |
|---|---|
| Industry | Data transfer, Big data |
| Founded | March 2012 |
| Defunct | June 2021 |
| Fate | Retired and archived in Apache Attic |
| Products | Data transfer utility between relational databases and Hadoop ecosystem |
| Website | sqoop |
Sqoop is a command-line utility designed to facilitate data transfer between relational database systems and the Hadoop ecosystem.
The Apache Sqoop initiative was officially retired in June 2021 and subsequently archived in the Apache Attic.
Description
Sqoop enables incremental data ingestion from tables or custom SQL queries, along with the ability to save jobs that import only database changes since the previous operation. It supports loading data into Apache Hive or HBase tables. Additionally, Sqoop allows exporting data from Hadoop back into relational databases. The term "Sqoop" originates from the phrase "SQL-to-Hadoop." It achieved status as a top-level Apache project in March 2012.
Multiple enterprise providers incorporate Sqoop technology: Informatica has integrated a Sqoop-based connector starting with version 10.1; Pentaho offers open-source Sqoop connectors for both import and export within its ETL platform, Pentaho Data Integration, beginning at version 4.5; Microsoft delivers a Sqoop-based connector facilitating data migration from Microsoft SQL Server to Hadoop; and Couchbase provides a connector linking Couchbase Server with Hadoop through Sqoop.
See also
Bibliography