โœ•

Join us at two must-attend conferences this summer and claim your exclusive SWAG! ๐ŸŽ

IOT TECH EXPO, June 5-6 in Santa Clara! Booth 270 | DATA + AI SUMMIT, June 11-13 in San Francisco! Booth e12

โœ•
Skip to content
On this page

Subscribe to our newsletter

Get the latest dates and news about GreptimeDB.
Biweekly
โ€ข
January 24, 2024

Biweekly Report - Lazy Load of Vector Builder Leads to a 90% Drop in Memory Usage

A recap of the past two-weeks progress and changes happened on GreptimeDB.

Summary โ€‹

Together with our global community of contributors, GreptimeDB continues to evolve and flourish as a growing open-source project. We are grateful to each and every one of you.

In the past two weeks, we have made steady progress. Below are some highlights:

  • Continuous Performance Enhancements:
    • Memory usage reduced by up to 90% in scenarios with high null values.
    • Optimize the filter for reading Parquet files, gaining up to 50% faster TSBS test time.
  • Expanding fuzz testing in GreptimeDB to encompass a wider array of scenarios.
  • Officially launching Inverted Index, set to boost future read performance of GreptimeDB.
  • Further developed support for SQL and PromQL features.

Contributors โ€‹

For the past two weeks, our community has been super active with a total of 77 PRs merged. 6 PRs from 3 individual contributors have been successfully merged, with many more pending merger.

Congrats on becoming our most active contributors in the past 2 weeks:

๐Ÿ‘ Welcome contributor @etolbakov @lyang24 back to the community!

A big THANK YOU to all our members and contributors! It is people like you who are making GreptimeDB a great product. Let's build an even greater community together.

Highlights of Recent PR โ€‹

#3210 Lazy load to delay initialization of Vector Builder time โ€‹

In scenarios with numerous null values, this optimization can slash GreptimeDB's memory consumption by about 90%, significantly enhancing its space efficiency.

#3182 Introduced random generators for create table and alter table SQL in fuzz testing โ€‹

Fuzz testing aids in early bug detection in GreptimeDB.

#3178 More precise filtering when reading Parquet files โ€‹

Optimized performance for reading Parquet files, cutting down time costs by up to 50% in TSBS tests.

#3164 Support for COPY DATABASE FROM statement โ€‹

Facilitates full database export and import, complementing the COPY DATABASE TO functionality.

#3158 Official launch of the Inverted Index feature โ€‹

Inverted indexes can significantly improve query efficiency. For more information about GreptimeDB's Inverted Index, please refer to the RFC: https://github.com/GreptimeTeam/greptimedb/blob/develop/docs/rfcs/2023-11-03-inverted-index.md

Good First Issue โ€‹

#3212 Fix a minor bug in join_path for more elegant code

#3044 Add tests for MetaPeerClientRef to enhance GreptimeDB's stability

#2931 Enhance GreptimeDB's self-observability with information_schema, welcome contributions to improve it

Join our community

Get the latest updates and discuss with other users.

Subscribe to our newsletter

Get the latest dates and news about GreptimeDB.