BI provider Qlik introduced Qlik Open Lakehouse a few weeks ago. The new feature in Qlik Talend Cloud greatly simplifies the collection, management, and optimization of data in Apache Iceberg-based lakehouses for businesses.
More and more companies are now turning to open lakehouses with Apache Iceberg. A data lakehouse is a data management architecture that combines the most important functions of data lakes and data warehouses in a unified platform. It breaks down data silos, improves interoperability, and significantly reduces costs in the cloud. This is achieved, among other things, by reducing data duplication, streamlining data traffic, and independently scaling storage and computing power. But implementing Apache Iceberg lakehouses can be very complex.
BI provider Qlik now offers a new helpful solution for this. Just a few months ago, Qlik announced the acquisition of Upsolver. The integration of the Upsolver platform into Qlik Talend Cloud has finally enabled the launch of Qlik Open Lakehouse. The integration makes it easy to deploy lakehouse architectures in an Amazon S3 environment and load both batch and real-time data directly into Apache Iceberg tables in no time at all. Complex or unstable pipelines, bottlenecks, and manual configurations are eliminated.
Because Qlik Open Lakehouse performs all difficult tasks automatically, the operational complexity of Iceberg implementations is significantly reduced. For example, it maps source schemas to target structures, resolves data type conflicts, applies intelligent partitioning, performs automatic file compression, manages schema evolution, and performs updates and deletions with precision. All of this happens continuously and without manual intervention. In the background, Qlik’s Adaptive Iceberg Optimizer also continuously monitors and optimizes Iceberg tables in real time. This optimizes performance and minimizes storage space requirements.
Improved performance and reduced costs with Qlik Open Lakehouse
Using the new tool not only results in up to 5 times faster query performance through adaptive optimizations, but also up to 50% lower storage costs thanks to efficient compression and cleanup —all with a true no-code experience for enterprise-scale Iceberg management.
All features are included in the Standard Edition (and above) of Qlik Talend Cloud. This makes it much easier and more cost-effective to get started with Apache Iceberg. With Qlik Open Lakehouse, you can leverage the full power of Apache Iceberg without the associated operational overhead, whether you’re using batch or real-time data.