Skip to content

[Bug] Incorrect sequenceNumber in manifest after row-tracking compaction #7408

@juntaozhang

Description

@juntaozhang

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version

master

Compute Engine

spark

Minimal reproduce step

  sql(
    "CREATE TABLE t (id INT, data INT) TBLPROPERTIES ('row-tracking.enabled' = 'true', 'compaction.min.file-num'='2')")

  sql("INSERT INTO t VALUES (1, 1)")
  sql("INSERT INTO t VALUES (2, 2)")
  sql("INSERT INTO t VALUES (3, 3)")

  sql("CALL sys.compact(table => 't')")


  sql("INSERT INTO t VALUES (4, '4')")
  sql("INSERT INTO t VALUES (5, '5')")
  sql("CALL sys.compact(table => 't')")

  sql("SELECT min_sequence_number, max_sequence_number FROM `t$files`").show()
  sql("UPDATE t SET data = 22 WHERE id = 2")
  sql("SELECT min_sequence_number, max_sequence_number FROM `t$files`").show()

What doesn't meet your expectations?

snapshot info:

+-----------+---------+--------------------+-------------------+-----------+--------------------+--------------------+--------------------+-----------------------+------------------+------------------+----------------------+---------+-----------+
|snapshot_id|schema_id|         commit_user|  commit_identifier|commit_kind|         commit_time|  base_manifest_list| delta_manifest_list|changelog_manifest_list|total_record_count|delta_record_count|changelog_record_count|watermark|next_row_id|
+-----------+---------+--------------------+-------------------+-----------+--------------------+--------------------+--------------------+-----------------------+------------------+------------------+----------------------+---------+-----------+
|          1|        0|1c795b0d-bfea-4f5...|9223372036854775807|     APPEND|2026-03-13 21:29:...|manifest-list-68a...|manifest-list-68a...|                   null|                 1|                 1|                  null|     null|          1|
|          2|        0|d892f145-0402-431...|9223372036854775807|     APPEND|2026-03-13 21:29:...|manifest-list-ca2...|manifest-list-ca2...|                   null|                 2|                 1|                  null|     null|          2|
|          3|        0|5f831510-712f-436...|9223372036854775807|     APPEND|2026-03-13 21:29:...|manifest-list-d7c...|manifest-list-d7c...|                   null|                 3|                 1|                  null|     null|          3|
|          4|        0|9115810c-4e4d-4a7...|9223372036854775807|    COMPACT|2026-03-13 21:29:...|manifest-list-156...|manifest-list-156...|                   null|                 3|                 0|                  null|     null|          3|
|          5|        0|58256400-9149-48c...|9223372036854775807|     APPEND|2026-03-13 21:29:...|manifest-list-c65...|manifest-list-c65...|                   null|                 4|                 1|                  null|     null|          4|
|          6|        0|1b713730-00f8-4a3...|9223372036854775807|     APPEND|2026-03-13 21:29:...|manifest-list-3b1...|manifest-list-3b1...|                   null|                 5|                 1|                  null|     null|          5|
|          7|        0|3de5ee47-b364-407...|9223372036854775807|    COMPACT|2026-03-13 21:29:...|manifest-list-9bb...|manifest-list-9bb...|                   null|                 5|                 0|                  null|     null|          5|
|          8|        0|b6241ee9-d063-418...|9223372036854775807|  OVERWRITE|2026-03-13 21:29:...|manifest-list-602...|manifest-list-602...|                   null|                 5|                 0|                  null|     null|          5|
+-----------+---------+--------------------+-------------------+-----------+--------------------+--------------------+--------------------+-----------------------+------------------+------------------+----------------------+---------+-----------+

currently min/max sequence number:

+-------------------+-------------------+
|min_sequence_number|max_sequence_number|
+-------------------+-------------------+
|                  6|                 10|
+-------------------+-------------------+

+-------------------+-------------------+
|min_sequence_number|max_sequence_number|
+-------------------+-------------------+
|                  8|                  8|
+-------------------+-------------------+

should be:

+-------------------+-------------------+
|min_sequence_number|max_sequence_number|
+-------------------+-------------------+
|                  1|                  6|
+-------------------+-------------------+

+-------------------+-------------------+
|min_sequence_number|max_sequence_number|
+-------------------+-------------------+
|                  1|                  8|
+-------------------+-------------------+

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions