Start time 20240626-09:27:43-GMT+0900
Build Version el7.3-release-fraser-6.5.5.1-stable-4291da86a7d23431e4192501cde1e531f37a20ed
Build Last Commit Date 2024-01-12 22:43:21 +0000
Component ID 112719388
Incarnation ID 777121362
Can become master true
Master since 20240626-09:58:02-GMT+0900
PC Cluster UUID 0fca3d36-c12c-4448-9573-2c1ed9329d59
Local hypervisor key 58.229.162.147
Local hypervisor type kKvm
Local stargate incarnation ID 777089469
Highest allocated opid 15207073
Highest contiguous completed opid 15207073
Demeter Subpage Demeter

Master

Recovery Info

Start time End time Recovery time (msecs) Checkpoint records Delta records
20240626-09:58:02-GMT+0900 20240626-09:58:03-GMT+0900 1588 64 33

Recovery Counters(8)

Tag Message Count
15 dumpProtectionDomainBasicStateVec 1
16 dumpSnapshotControlBlock 52
17 dumpConsistencyGroupStates 56
27 topLevelMetaOpCompletionStat 1
43 snapshotStats 33
65 mesosWALRecord 1
71 dumpCerebroMasterBasicState 1
107 updatePcClusterCapabilities 1

Checkpoint Info(10)

Creation time Checkpoint id Time taken (msecs) Protection domains Consistency groups Snapshots WAL records Delta records
during checkpoint		 Delta records
before checkpoint
20251105-04:00:04-GMT+0900 8602342 9 16 3 45 56 0 1015
20251105-05:01:15-GMT+0900 8603419 9 16 3 45 56 0 998
20251105-17:14:50-GMT+0900 8604484 11 16 3 45 55 0 1003
20251106-04:00:08-GMT+0900 8605580 6 16 3 48 59 0 1015
20251106-18:07:10-GMT+0900 8606661 13 16 3 45 55 0 1000
20251107-05:00:03-GMT+0900 8607755 12 16 3 45 56 0 1003
20251107-05:01:23-GMT+0900 8608828 7 16 3 45 56 0 1013
20251107-20:15:25-GMT+0900 8609896 11 16 3 45 55 0 1006
20251108-05:00:10-GMT+0900 8610993 12 16 3 45 56 0 1006
20251109-03:00:03-GMT+0900 8612086 27 16 3 46 57 0 1019

Checkpoint Creation Stats(24)

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251029-05:01:43-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251029-13:47:59-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251030-03:05:39-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251030-15:05:27-GMT+0900 0 1 0 0 0 0 0 7 7 7

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251031-03:00:33-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251031-05:01:12-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251031-06:05:56-GMT+0900 0 0 1 0 0 0 0 12 12 12

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251101-03:00:08-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251101-06:05:50-GMT+0900 0 0 1 0 0 0 0 12 12 12

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251102-03:00:08-GMT+0900 0 1 0 0 0 0 0 8 8 8

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251102-14:06:07-GMT+0900 0 1 0 0 0 0 0 8 8 8

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251103-03:06:35-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251103-21:06:25-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251104-05:00:11-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251104-20:43:07-GMT+0900 0 0 1 0 0 0 0 13 13 13

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251105-04:00:04-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251105-05:01:15-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251105-17:14:50-GMT+0900 0 0 1 0 0 0 0 11 11 11

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251106-04:00:08-GMT+0900 0 1 0 0 0 0 0 6 6 6

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251106-18:07:10-GMT+0900 0 0 1 0 0 0 0 13 13 13

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251107-05:00:03-GMT+0900 0 1 1 0 0 0 0 7 12 9.5

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251107-20:15:25-GMT+0900 0 0 1 0 0 0 0 11 11 11

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-05:00:10-GMT+0900 0 0 1 0 0 0 0 12 12 12

Checkpoint creation time (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-03:00:03-GMT+0900 0 0 1 0 0 0 0 27 27 27

Checkpoint Commit Stats(24)

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251029-05:01:43-GMT+0900 0 1 0 0 0 0 0 6 6 6

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251029-13:47:59-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251030-03:05:39-GMT+0900 0 1 0 0 0 0 0 8 8 8

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251030-15:05:27-GMT+0900 0 0 1 0 0 0 0 36 36 36

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251031-03:00:33-GMT+0900 0 1 0 0 0 0 0 5 5 5

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251031-05:01:12-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251031-06:05:56-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251101-03:00:08-GMT+0900 0 1 0 0 0 0 0 6 6 6

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251101-06:05:50-GMT+0900 0 1 0 0 0 0 0 6 6 6

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251102-03:00:08-GMT+0900 0 0 1 0 0 0 0 23 23 23

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251102-14:06:07-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251103-03:06:35-GMT+0900 0 1 0 0 0 0 0 7 7 7

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251103-21:06:25-GMT+0900 0 1 0 0 0 0 0 9 9 9

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251104-05:00:11-GMT+0900 0 1 0 0 0 0 0 7 7 7

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251104-20:43:07-GMT+0900 0 1 0 0 0 0 0 8 8 8

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251105-04:00:04-GMT+0900 0 0 1 0 0 0 0 12 12 12

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251105-05:01:15-GMT+0900 1 0 0 0 0 0 0 4 4 4

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251105-17:14:50-GMT+0900 0 1 0 0 0 0 0 8 8 8

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251106-04:00:08-GMT+0900 0 0 1 0 0 0 0 13 13 13

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251106-18:07:10-GMT+0900 0 0 1 0 0 0 0 10 10 10

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251107-05:00:03-GMT+0900 0 2 0 0 0 0 0 5 7 6

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251107-20:15:25-GMT+0900 0 1 0 0 0 0 0 7 7 7

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-05:00:10-GMT+0900 0 1 0 0 0 0 0 5 5 5

Checkpoint commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-03:00:03-GMT+0900 0 0 1 0 0 0 0 10 10 10

Delta Record Commit Stats(24)

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-05:49:47-GMT+0900 36 2 0 0 0 0 0 2 5 2.921

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-06:49:47-GMT+0900 33 5 0 0 0 0 0 2 6 3.316

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-07:49:48-GMT+0900 40 2 0 0 0 0 0 2 5 3.071

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-08:49:48-GMT+0900 43 2 0 0 0 0 0 2 5 3.133

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-09:49:49-GMT+0900 34 9 2 0 0 0 0 2 12 4.022

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-10:49:50-GMT+0900 41 4 0 0 0 0 0 1 5 3

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-11:49:50-GMT+0900 41 4 0 0 0 0 0 1 5 2.889

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-12:49:51-GMT+0900 45 0 0 0 0 0 0 2 4 2.822

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-13:49:52-GMT+0900 40 4 1 0 0 0 0 2 11 2.911

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-14:49:52-GMT+0900 55 3 1 0 0 0 0 1 10 3.051

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-15:49:53-GMT+0900 42 2 0 0 0 0 0 2 9 2.886

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-16:49:54-GMT+0900 44 0 0 0 0 0 0 2 4 2.773

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-17:49:54-GMT+0900 35 2 0 7 0 0 0 2 97 17.568

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-18:49:55-GMT+0900 42 2 0 0 0 0 0 2 5 2.886

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-19:49:55-GMT+0900 42 2 0 0 0 0 0 2 5 2.909

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-20:49:56-GMT+0900 41 4 0 0 0 0 0 2 5 3.156

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-21:49:57-GMT+0900 39 6 0 0 0 0 0 2 5 3.222

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-22:49:58-GMT+0900 43 2 0 0 0 0 0 2 5 2.911

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251108-23:49:58-GMT+0900 30 15 0 0 0 0 0 2 7 3.8

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-00:49:59-GMT+0900 43 2 0 0 0 0 0 2 7 3.267

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-01:50:00-GMT+0900 41 4 0 0 0 0 0 2 5 3.067

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-02:50:00-GMT+0900 355 48 29 1 0 0 0 1 67 3.674

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-03:50:01-GMT+0900 121 8 1 0 0 0 0 1 11 2.562

Delta record commit latency (msecs)
Stat creation time [0 , 5) [5 , 10) [10 , 50) [50 , 100) [100 , 500) [500 , 1000) [1000 , Infinity) Minimum Maximum Average
20251109-04:50:02-GMT+0900 6 2 0 0 0 0 0 3 5 4.125

Log Counters(17)

Tag Message Count
4 deleteProtectionDomain 2
7 applySchedule 8
8 adjustPendingActions 1699
9 addMetaOpState 12995
10 metaOpCompleted 12995
18 snapshotProtectionDomainMetaOpDeltaState 3345
19 snapshotGarbageCollectorMetaOpDeltaState 11442
20 replicateMetaOpDeltaState 383618
21 receiveSnapshotMetaOpDeltaState 25153
22 entityRecovererMetaOpDeltaState 232
24 entityRestorerMetaOpDeltaState 58
26 modifySnapshot 7
27 topLevelMetaOpCompletionStat 12966
29 modifyProtectionDomain 1
43 snapshotStats 564852
101 upgradeSnapshot 11428
107 updatePcClusterCapabilities 1