8kdata Explained: ToroDB and PostgreSQL Solutions

Written by

in

Breaking Down Silos: The Story of 8kdata and the Convergence of SQL and NoSQL

In the fast-evolving landscape of enterprise data management, developers have historically faced a stark architectural divide: the rigid, highly structured world of relational SQL databases versus the flexible, schema-less agility of NoSQL document stores.

Enter 8kdata, a pioneering database research and development (R&D) company that sought to bridge this exact divide. By pushing the boundaries of what PostgreSQL could achieve, 8kdata challenged conventional database design and offered a glimpse into a hybrid future where developers no longer had to choose between ACID-compliant reliability and document-oriented flexibility.


The Visionaries Behind the Code

Founded by passionate open-source advocates and prominent figures in the PostgreSQL community—including database expert Álvaro Hernández Tortosa—8kdata positioned itself as an innovation lab for database architecture. Based primarily in Europe, the company actively contributed to the open-source ecosystem, championed PostgreSQL adoption, and sought to solve real-world friction points faced by modern application developers.

Rather than accepting the binary choice between relational structures and document databases, the team at 8kdata asked a disruptive question: What if you could harness the power of a world-class relational database while speaking the native language of NoSQL?


ToroDB: The Flagship Innovation

The crowning achievement of 8kdata’s R&D efforts was ToroDB—an open-source, MongoDB-compatible JSON document store built natively on top of relational database technology (specifically PostgreSQL).

ToroDB was designed to solve a fundamental architectural headache. Many organizations loved MongoDB for its flexible JSON data models and rapid developer onboarding, but they missed the rock-solid consistency, complex analytical capabilities, and ecosystem maturity of relational engines like PostgreSQL.

ToroDB acted as an intelligent middleware and storage layer that:

  • Spoke the MongoDB Protocol: It implemented the standard MongoDB wire protocol, meaning applications built for MongoDB could point to ToroDB with little to no code changes.
  • Leveraged PostgreSQL’s Reliability: Beneath the surface, it decomposed and stored JSON documents inside PostgreSQL tables, mapping document fields into relational columns or structured data types.
  • Enabled Complex Queries: Unlike early NoSQL solutions that struggled with complex multi-document aggregations or relational joins, ToroDB allowed users to execute powerful SQL queries directly against data ingested through a NoSQL interface.

Technical Contributions and Ecosystem Tools

Beyond ToroDB, 8kdata built a suite of foundational libraries and benchmarking utilities that addressed deep performance and interoperability challenges in database engineering:

  • MongoWP (Mongo Wire Protocol Library): A dedicated library built by 8kdata to help developers construct programs and services capable of parsing and speaking the MongoDB wire protocol natively.
  • Performance Tooling (

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *