Join us at two must-attend conferences this summer and claim your exclusive SWAG! 🎁

IOT TECH EXPO, June 5-6 in Santa Clara! Booth 270 | DATA + AI SUMMIT, June 11-13 in San Francisco! Booth e12

Skip to content
On this page
Biweekly
April 12, 2023

Biweekly Report (Mar.27 - Apr.09) – Support timestamp precision on creating table

A recap of the past two-weeks progress and changes happened on GreptimeDB.

Summary

Together with all our contributors worldwide, we are glad to see GreptimeDB making remarkable progress for the better. Below are some highlights:

  • Have passed over 50% of Prometheus’s compliance tests
  • Impl region manifest checkpoint
  • Support timestamp precision on creating table

Contributor list: (in alphabetical order)

For the past two weeks, our community has been super active with a total of 6 PRs from 2 contributors merged successfully and lots pending to be merged. Congrats on becoming our most active contributors in the past 2 weeks:

👏 Let's welcome @haohuaijin as the new contributor to join our community and have two PRs merged.

A big THANK YOU for the generous and brilliant contributions! It is people like you who are making GreptimeDB a great product. Let's build an even greater community together.

Highlights of Recent PR

Have passed over 50% of Prometheus’s compliance tests

We have initially supported PromQL and passed over 50% of Prometheus’s compliance tests, which greatly improved PromQL compatibility. To improve its compatibility continuously, we have created this issue and gathered all the PromQL compatibility related PRs and tasks here for easier progress tracking.

image1

Impl region manifest checkpoint

Have you encountered the issue of slow restarts after storing a large amount of data in the database? We have recently fixed this problem.

We have implemented the region manifest checkpoint which compresses manifest actions and creates a snapshot for them. This will decrease disk consumption and speed up region recovery. Main changes:

  • Region manifest snapshot structures such as RegionManifestData and RegionSnapshot etc. Please refer to src/storage/src/manifest/action.rs.
  • Adds Checkpointer trait into ManifestImpl.
  • Adds RegionManifestCheckpointer to do checkpointing for region manifest. When saving manifest actions, a checkpoint attempt will be made every tenth time.
  • Recovers region manifest from the checkpointed snapshot.

Support timestamp precision on creating table

We have enhanced Timestamp to support specifying precision when creating tables, following the fractional seconds syntax in MySQL. Fractional seconds option now accepts:

  • 0: no factional seconds, time unit is TimeUnit::Second
  • 3: TimeUnit::Millisecond
  • 6: TimeUnit::Microsecond
  • 9: TimeUnit::Nanosecond

Now we can specify the time precision to microseconds like:

sql
mysql> create table demo (ts timestamp(6) time index, cnt int);
Query OK, 0 rows affected (0.05 sec)

And insert timestamps with different time zones:

sql
mysql> insert into demo(ts,cnt) values ('2023-04-04 08:00:00.52+0000', 1);
Query OK, 1 row affected (0.00 sec)

mysql> insert into demo(ts,cnt) values ('2023-04-04 08:00:00.52+0800', 2);
Query OK, 1 row affected (0.01 sec)

All timestamps will be displayed in UTC time:

sql
mysql> select * from demo order by ts asc;
+------------------------------+------+
| ts                           | cnt  |
+------------------------------+------+
| 2023-04-04 00:00:00.520+0000 |    2 || 2023-04-04 08:00:00.520+0000 |    1 |
+------------------------------+------+
2 rows in set (0.01 sec)

This PR modifies timestamps to follow the ISO8601 format when writing query results to the MySQL protocol writer, ensuring that the time zone and fractional parts are displayed.

New things

Join our community

Get the latest updates and discuss with other users.