Data-lakes, data warehouses and data lake-houses

Table of Content (ToC)

• Overview
  • Other repositories of Data Engineering helpers
• References
• Articles
  • DuckDB in browser - SQLRooms examples - deck.gl Mosaic
• Frameworks
  • DuckDB
    • Mosaic
    • SQLRooms
    • Examples of DuckDB analyticas in the browser
    • Onager - Graph analytics extension
  • PostgreSQL analytical extensions
    • pg_lake
    • pg_incremental

Created by gh-md-toc

Overview

This project intends to collect, analyze and synthetize referential material about data analytics/analysis.

Even though the members of the GitHub organization may be employed by some companies, they speak on their personal behalf and do not represent these companies.

Other repositories of Data Engineering helpers

• Data Engineering Helpers - Knowledge Sharing - Cheat sheets
• Data Engineering Helpers - Knowledge Sharing - Data products
• Data Engineering Helpers - Knowledge Sharing - Data contracts
• Data Engineering Helpers - Knowledge Sharing - Data quality
• Data Engineering Helpers - Knowledge Sharing - Architecture principles
• Data Engineering Helpers - Knowledge Sharing - Data life cycle
• Data Engineering Helpers - Knowledge Sharing - Data management
• Data Engineering Helpers - Knowledge Sharing - Metadata
• Data Engineering Helpers - Knowledge Sharing - Data pipeline deployment
• Data Engineering Helpers - Knowledge Sharing - Semantic layer

References

Articles

DuckDB in browser - SQLRooms examples - deck.gl Mosaic

• Author: Ilya Boyandin (Ilya Boyandin on LinkedIn)
• Date: Dec. 2025
• LinkedIn post: https://www.linkedin.com/posts/ilyabo_new-sqlroomsorg-example-big-thanks-to-gjore-ugcPost-7410991784463552512-3ZvD/

New sqlrooms.org example, big thanks to Gjore Milevski, showcasing the integration with deck.gl, Kyle Barron's geoarrow layers, and UWData Mosaic idl.uw.edu/mosaic/ for efficient cross-filtering.

Frameworks

DuckDB

• See also Data Engineering Helpers - Knowledge Sharing - DuckDB Cheat sheet

Mosaic

• Mosaic on UW IDL web site
• Overview:
  • Mosaic is a collaboration of the UW Interactive Data Lab (IDL) and the CMU Data Interaction Group (DIG)
  • Mosaic is an extensible framework for linking databases and interactive views
    • Explore massive datasets - Visualize, select, and filter datasets with millions or billions of records
    • Flexible deployment - Build data-driven web apps, or interact with data directly in Jupyter notebooks
    • Interoperable & extensible - Create new components that seamlessly integrate across selections and datasets
    • Powered by DuckDB - Mosaic pushes computation to DuckDB, both server-side and in your browser via WebAssembly

SQLRooms

• SQLRooms
• SQLRooms - Examples
• GitHub - SQLRooms examples
• Overview: an open source React toolkit for human and agent collaborative analytics apps
  • Local Analytics, No Backend Required - Leverage DuckDB's powerful SQL capabilities, enabling fast in browser data processing without a backend
  • Own Your Data - Data remains on your local device for maximum privacy, sub-second analytics on large datasets, and offline functionality
  • Privacy-Preserving AI Integration - Use agents that can write and execute SQL queries, and generate insights without sharing your data with model providers
  • Modular Architecture - Pick and choose the functionality you need for composable, extensible applications, with integrations for popular data visualization libraries
  • Modern UI Components - Comprehensive set of React components including data tables, layouts, and visualization tools for building beautiful analytics interfaces
  • Offline Use - Work with your data, run queries, and analyze results even without an internet connection. SQLRooms supports offline workflows using persistent storage via OPFS

Examples of DuckDB analyticas in the browser

Wildfire history explorer

• GitHub - Wildfire app
• Live on Netlify - Wildfire app
• Author/main contributor: Ross Wygmans (Ross Wygmans on LinkedIn, Ross Wygmans on GitHub)
• LinkedIn post, Dec. 2025

Earthbrake history explorer

• GitHub - deck.gl DuckDB geoArrow - Earthbrake explorer app
• Live on Netlify - Earthbrake explorer app
• Author/main contributor: Gjore Milevski (Gjore Milevski on LinkedIn, Gjore Milevski on GitHub)
• Post on LinkedIn, Dec. 2025

Onager - Graph analytics extension

• GitHub repository
• Doc - Onager
• Author/main contributor: Hassan Abedi (Hassan Abedi on LinkedIn, Hassan Abedi on GitHub)
• Post on LinkedIn: https://www.linkedin.com/posts/hassan-abedi_duckdb-rust-graphanalytics-activity-7410647707998044161-8A17/

PostgreSQL analytical extensions

pg_lake

pg_incremental

• Post on LinkedIn: https://www.linkedin.com/posts/marcoslot_why-we-developed-pgincremental-one-of-activity-7392183986577440770-HCZU/
• Date: Nov. 2025
• Author: Marco Slot