โœ•

Join us at two must-attend conferences this summer and claim your exclusive SWAG! ๐ŸŽ

IOT TECH EXPO, June 5-6 in Santa Clara! Booth 270 | DATA + AI SUMMIT, June 11-13 in San Francisco! Booth e12

โœ•
Skip to content
On this page

Subscribe to our newsletter

Get the latest dates and news about GreptimeDB.
Biweekly
โ€ข
November 29, 2023

Biweekly Report (Nov.13 - Nov.26) โ€“ Storage Engine Mito2 - Constantly Evolving

A recap of the past two-weeks progress and changes happened on GreptimeDB.

Summary โ€‹

Together with our global community of contributors, GreptimeDB continues to evolve and flourish as a growing open-source project. We are grateful to each and every one of you.

In the past two weeks, we have made steady progress. Below are some highlights:

  • Removed the storage crate from the dependency lists of other crates, and the actual storage engine is Mito2.

  • Enabled distributed tracing in GreptimeDB.

  • A new Decimal128 type has been added to the supported types.

  • A row group level page cache for the Mito engine has been implemented in order to reduce data scan time.

  • New modules region migration and inverted index are currently under accelerated development.

Contributors โ€‹

For the past two weeks, our community has been super active with a total of 58 PRs merged. 7 PRs from 4 external contributors merged successfully and lots pending to be merged.

Congrats on becoming our most active contributors in the past 2 weeks:

๐Ÿ‘ Welcome contributor @bigboss2063 @lyang24 @taobo to the community as new contributors, and congratulations on successfully merging their first PR!

A big THANK YOU to all our members and contributors! It is people like you who are making GreptimeDB a great product. Let's build an even greater community together.

Highlights of Recent PR โ€‹

#2777 This PR removes the storage crate from other crates' dependency lists and the actual storage engine isย Mito2. โ€‹

#2755 To enable distributed tracing in GreptimeDB. โ€‹

Use otlp as exporter protocol, which can support distributed tracing backend like jaeger, tempo etc.

#2788 A new Decimal128 type has been added to the supported types. โ€‹

#2688 โ€‹

This PR implements a row group level page cache for the Mito engine.

A new page reader CachedPageReader is introduced to return pages of a row group from the cache.

When the first time we read a row group, all pages of the row group are loaded and put it into the cache. The next time we read, we can fetch cached pages from the cache and build a CachedPageReader.

Cached pages are decompressed, so we can skip the decompression step and reduce 20% - 30% of the total scan time if a query hits the cache.

Region migration is under development, details can be found at https://github.com/GreptimeTeam/greptimedb/issues/2700 โ€‹

The inverted index is also under intensive development, details can be found at https://github.com/GreptimeTeam/greptimedb/issues/2705 โ€‹

Good First Issue โ€‹

#2637 Add more SQLness case for special characters in identifier โ€‹

#2601 Execute create database in procedure โ€‹

Join our community

Get the latest updates and discuss with other users.

Subscribe to our newsletter

Get the latest dates and news about GreptimeDB.