Debezium streaming

label:

context="snapshot"

Podstawowe metryki

Dostępne dla wszystkich obsługiwanych baz (postgres, oracle, sqlserver)

Nazwa	Typ	Opis	Używane	Dashboard
LastEvent	string	The last streaming event that the connector has read.
MilliSecondsSinceLastEvent	long	The number of milliseconds since the connector has read and processed the most recent event.
TotalNumberOfEventsSeen	long	The total number of events that this connector has seen since the last start or metrics reset.
TotalNumberOfCreateEventsSeen	long	The total number of create events that this connector has seen since the last start or metrics reset.
TotalNumberOfUpdateEventsSeen	long	The total number of update events that this connector has seen since the last start or metrics reset.
TotalNumberOfDeleteEventsSeen	long	The total number of delete events that this connector has seen since the last start or metrics reset.
NumberOfEventsFiltered	long	The number of events that have been filtered by include/exclude list filtering rules configured on the connector.
CapturedTables	string[]	The list of tables that are captured by the connector.
QueueTotalCapacity	int	The length the queue used to pass events between the streamer and the main Kafka Connect loop.
QueueRemainingCapacity	int	The free capacity of the queue used to pass events between the streamer and the main Kafka Connect loop.
Connected	boolean	Flag that denotes whether the connector is currently connected to the database server.
MilliSecondsBehindSource	long	The number of milliseconds between the last change event’s timestamp and the connector processing it. The values will incoporate any differences between the clocks on the machines where the database server and the connector are running.
NumberOfCommittedTransactions	long	The number of processed transactions that were committed.
SourceEventPosition	Map<String, String>	The coordinates of the last received event.
LastTransactionId	string	Transaction identifier of the last processed transaction.
MaxQueueSizeInBytes	long	The maximum buffer of the queue in bytes. This metric is available if max.queue.size.in.bytes is set to a positive long value.
CurrentQueueSizeInBytes	long	The current volume, in bytes, of records in the queue.

Oracle

Dodatkowe metryki dostępne dla oracle

Nazwa	Typ	Opis	Używane
CurrentScn	BigInteger	The most recent system change number that has been processed.
OldestScn	BigInteger	The oldest system change number in the transaction buffer.
OldestScnAgeInMilliseconds	long	The oldest system change number’s age in milliseconds. If the buffer is empty, the value will be 0.
CommittedScn	BigInteger	The last committed system change number from the transaction buffer.
OffsetScn	BigInteger	The system change number currently written to the connector’s offsets.
CurrentRedoLogFileName	string[]	Array of the log files that are currently mined.
MinimumMinedLogCount	long	The minimum number of logs specified for any LogMiner session.
MaximumMinedLogCount	long	The maximum number of logs specified for any LogMiner session.
RedoLogStatus	string[]	Array of the current state for each mined logfile with the format filename|status.
SwitchCounter	int	The number of times the database has performed a log switch for the last day.
LastCapturedDmlCount	long	The number of DML operations observed in the last LogMiner session query.
MaxCapturedDmlInBatch	long	The maximum number of DML operations observed while processing a single LogMiner session query.
TotalCapturedDmlCount	long	The total number of DML operations observed.
FetchingQueryCount	long	The total number of LogMiner session query (aka batches) performed.
LastDurationOfFetchQueryInMilliseconds	long	The duration of the last LogMiner session query’s fetch in milliseconds.
MaxDurationOfFetchQueryInMilliseconds	long	The maximum duration of any LogMiner session query’s fetch in milliseconds.
LastBatchProcessingTimeInMilliseconds	long	The duration for processing the last LogMiner query batch results in milliseconds.
TotalParseTimeInMilliseconds	long	The time in milliseconds spent parsing DML event SQL statements.
LastMiningSessionStartTimeInMilliseconds	long	The duration in milliseconds to start the last LogMiner session.
MaxMiningSessionStartTimeInMilliseconds	long	The longest duration in milliseconds to start a LogMiner session.
TotalMiningSessionStartTimeInMilliseconds	long	The total duration in milliseconds spent by the connector starting LogMiner sessions.
MinBatchProcessingTimeInMilliseconds	long	The minimum duration in milliseconds spent processing results from a single LogMiner session.
MaxBatchProcessingTimeInMilliseconds	long	The maximum duration in milliseconds spent processing results from a single LogMiner session.
TotalProcessingTimeInMilliseconds	long	The total duration in milliseconds spent processing results from LogMiner sessions.
TotalResultSetNextTimeInMilliseconds	long	The total duration in milliseconds spent by the JDBC driver fetching the next row to be processed from the log mining view.
TotalProcessedRows	long	The total number of rows processed from the log mining view across all sessions.
BatchSize	int	The number of entries fetched by the log mining query per database round-trip.
MillisecondToSleepBetweenMiningQuery	long	The number of milliseconds the connector sleeps before fetching another batch of results from the log mining view.
MaxBatchProcessingThroughput	long	The maximum number of rows/second processed from the log mining view.
AverageBatchProcessingThroughput	long	The average number of rows/second processed from the log mining.
LastBatchProcessingThroughput	long	The average number of rows/second processed from the log mining view for the last batch.
NetworkConnectionProblemsCounter	long	The number of connection problems detected.
HoursToKeepTransactionInBuffer	int	The number of hours that transactions are retained by the connector’s in-memory buffer without being committed or rolled back before being discarded. For more information, see log.mining.transaction.retention.ms.
NumberOfActiveTransactions	long	The number of current active transactions in the transaction buffer.
NumberOfCommittedTransactions	long	The number of committed transactions in the transaction buffer.
NumberOfOversizedTransactions	long	The number of transactions that were discarded because their size exceeded log.mining.buffer.transaction.events.threshold.
NumberOfRolledBackTransactions	long	The number of rolled back transactions in the transaction buffer.
CommitThroughput	long	The average number of committed transactions per second in the transaction buffer.
RegisteredDmlCount	long	The number of registered DML operations in the transaction buffer.
LagFromSourceInMilliseconds	long	The time difference in milliseconds between when a change occurred in the transaction logs and when its added to the transaction buffer.
MaxLagFromSourceInMilliseconds	long	The maximum time difference in milliseconds between when a change occurred in the transaction logs and when its added to the transaction buffer.
MinLagFromSourceInMilliseconds	long	The minimum time difference in milliseconds between when a change occurred in the transaction logs and when its added to the transaction buffer.
AbandonedTransactionIds	string[]	An array of the most recent abandoned transaction identifiers removed from the transaction buffer due to their age. See log.mining.transaction.retention.ms for details.
RolledBackTransactionIds	string[]	An array of the most recent transaction identifiers that have been mined and rolled back in the transaction buffer.
LastCommitDurationInMilliseconds	long	The duration of the last transaction buffer commit operation in milliseconds.
MaxCommitDurationInMilliseconds	long	The duration of the longest transaction buffer commit operation in milliseconds.
ErrorCount	int	The number of errors detected.
WarningCount	int	The number of warnings detected.
ScnFreezeCount	int	The number of times that the system change number was checked for advancement and remains unchanged. A high value can indicate that a long-running transactions is ongoing and is preventing the connector from flushing the most recently processed system change number to the connector’s offsets. When conditions are optimal, the value should be close to or equal to 0.
UnparsableDdlCount	int	The number of DDL records that have been detected but could not be parsed by the DDL parser. This should always be 0; however when allowing unparsable DDL to be skipped, this metric can be used to determine if any warnings have been written to the connector logs.
MiningSessionUserGlobalAreaMemoryInBytes	long	The current mining session’s user global area (UGA) memory consumption in bytes.
MiningSessionUserGlobalAreaMaxMemoryInBytes	long	The maximum mining session’s user global area (UGA) memory consumption in bytes across all mining sessions.
MiningSessionProcessGlobalAreaMemoryInBytes	long	The current mining session’s process global area (PGA) memory consumption in bytes.
MiningSessionProcessGlobalAreaMaxMemoryInBytes	long	The maximum mining session’s process global area (PGA) memory consumption in bytes across all mining sessions.