Join us for a virtual meetup on Zoom at 8 PM, July 31 (PDT) about using One Time Series Database for Both Metrics and Logs 👉🏻 Register Now

Skip to content
On this page
Biweekly
April 16, 2025

100x Faster PromQL Queries and Bloom-Backed Fulltext Index for Efficient Storage | Greptime Biweekly Report

A recap of the past 2 weeks progress and changes happened on GreptimeDB.

Summary

Together with our global community of contributors, GreptimeDB continues to evolve and flourish as a growing open-source project. We are grateful to each and every one of you.

Below are the highlights among recent commits:

  • Multi-backend fulltext index support: Added Bloom backend to fulltext index with matches_term function for precise term matching.
  • Batching mode flow engine: Implemented batch processing for data flows with time-based windowing support.
  • Major PromQL performance improvements: Achieved 100x faster execution and 40% less memory usage.

Contributors

For the past two weeks, our community has been super active with a total of 85 PRs merged. 2 PRs from 2 individual contributors merged successfully and lots pending to be merged.

Congrats on becoming our most active contributors in the past 2 weeks:

👏 Welcome @soisyourface to the community as a new contributor with a successfully merged PR, and more PRs from other individual contributors are waiting to be merged.

(New Contributor of GreptimeDB)
(New Contributor of GreptimeDB)

🎉 A big THANK YOU to all our members and contributors! It is people like you who are making GreptimeDB a great product. Let's build an even greater community together.

Highlights of Recent PRs

db#5806 db#5817 db#5843 db#5845 db#5869 db#5896 db#5886 Multi-backend Support for Fulltext Index

This series of PRs implements multi-backend support for fulltext index (Bloom and Tantivy), adds the matches_term function for term matching, and optimizes term matching performance.

sql
Usage example:
-- Specify fulltext index backend when creating table
CREATE TABLE logs (
  ...
  text_column STRING FULLTEXT INDEX WITH (backend='bloom'),
  ...
);

-- Use `matches_term` for term matching
SELECT * FROM logs WHERE matches_term(text_column, 'foo');

db#5807 db#5881 Batching Mode Engine for Flow Processing

This engine implements batch processing for data flows, with support for time-based windowing and flow management.

db#5691 db#5859 db#5863 Performance Improvements to PromQL Execution

These PRs deliver major performance improvements to the PromQL execution engine:

  • 100x faster and 40% less memory usage by eliminating sorts and adding parallelism
  • 10x faster range operations for complex queries
  • 2x faster by eliminating duplicate NOT NULL filter computations

db#5847 Pushdown Select Distinct for Single-Partition Queries

This PR optimizes query performance by pushing down SELECT DISTINCT to the region level when the query involves only a single partition.

db#5820 Support REPLACE INTO Statement

This PR adds support for the REPLACE INTO statement, which behaves similarly to MySQL's implementation, allowing users to insert or replace existing records in a single statement.

Good First Issue

Issue#5853 Add --user-provider Config in config.toml

Adds the ability to set --user-provider through the config.toml file, making it consistent with the existing command line option functionality.

  • Difficulty: Simple
  • Keywords: Config

About Greptime

Greptime offers industry-leading time series database products and solutions to empower IoT and Observability scenarios, enabling enterprises to uncover valuable insights from their data with less time, complexity, and cost.

GreptimeDB is an open-source, high-performance time-series database offering unified storage and analysis for metrics, logs, and events. Try it out instantly with GreptimeCloud, a fully-managed DBaaS solution—no deployment needed!

The Edge-Cloud Integrated Solution combines multimodal edge databases with cloud-based GreptimeDB to optimize IoT edge scenarios, cutting costs while boosting data performance.

Star us on GitHub or join GreptimeDB Community on Slack to get connected.

Join our community

Get the latest updates and discuss with other users.