In this article, we will demonstrate—clearly and practically—how to perform a MySQL database migration with minimal downtime. For this example, our source environment will be Amazon Aurora MySQL 8.0.39, and the target environment will be OCI HeatWave MySQL 8.4.4.
Before initiating the migration procedure, it is essential to ensure that a few infrastructure prerequisites are properly configured and fully operational:
- AWS and OCI infrastructures must be installed, configured, and up and running.
- An existing Amazon Aurora MySQL cluster must be currently operational and serving as the production database (source environment).
- An OCI HeatWave MySQL cluster must already be provisioned and configured, ready to receive the migrated data from Amazon Aurora. This will become the new production database (target environment).
- Network connectivity between the Amazon Aurora MySQL and the OCI HeatWave MySQL instances must be properly established, specifically allowing traffic on the default MySQL port (3306).
The configuration of these prerequisites will not be covered in detail in this article. If you encounter difficulties during this stage or would like to understand each step more thoroughly, we recommend referring to the official documentation available at the link below:
Oracle – Migration Guide from Amazon Aurora to OCI HeatWave MySQL
This document provides a comprehensive guide, covering everything from setting up the AWS and OCI infrastructures to the detailed procedures that will be briefly summarized in this article. There, you will find in-depth explanations of the concepts that will be simplified here in order to keep this article concise and focused.
Below, we present a high-level flowchart outlining the migration process from a MySQL database currently hosted on AWS Amazon Aurora MySQL to the OCI HeatWave MySQL infrastructure.
The primary goal of this approach is to carry out the migration with the least amount of downtime possible. To achieve this, we will employ a technique that consists of two main stages:
1. Initial Data Migration (Baseline)
In this initial phase, the entire database (i.e., the full dataset) is migrated from the source (AWS Amazon Aurora MySQL) to the target (OCI HeatWave MySQL).
This process is performed using MySQL Shell, a powerful and reliable tool that ensures data consistency and integrity throughout the transfer.
2. Continuous Replication of Differential Data (Delta)
Following the baseline migration, a continuous replication process is established to capture and apply any changes that occur on the source database while the final cutover has not yet been completed.
This delta replication is achieved through the use of binary logs (binlogs)—files that record all transactions executed on the source MySQL database.
To enable this real-time replication between AWS Aurora and OCI HeatWave environments, we will utilize a feature known as the OCI HeatWave MySQL Channel. This feature establishes a direct and reliable connection between the two environments, allowing for ongoing synchronization of transactional data.
In practice, during the migration process, the OCI HeatWave MySQL environment will temporarily operate as a replica (slave) database, faithfully tracking all changes made in the primary (master) environment—Amazon Aurora.
Once all differential (delta) changes have been successfully replicated and both environments are fully synchronized, the only remaining step is to redirect the application servers (e.g., web servers, application servers, middleware, etc.) to the new production environment hosted on OCI HeatWave MySQL.
As a result, the only downtime experienced will be the brief period required to reconfigure these connection endpoints, ensuring a fast, safe, and low-impact transition for end users.
The final outcome will be a fully migrated and operational environment hosted on OCI HeatWave, with complete fidelity to the data and structure of the original Amazon Aurora environment, while also benefiting from the enhanced performance and scalability offered by HeatWave technology.
To enhance clarity and streamline the migration process, this article is divided into two main parts, outlining the key steps required to execute a successful migration from AWS Amazon Aurora MySQL to OCI MySQL HeatWave with minimal downtime.
Part 1: Export (AWS Aurora MySQL) and Import (OCI MySQL HeatWave)
In the first part of this article, we will provide a detailed explanation of how to export the database from the source environment (AWS Amazon Aurora MySQL) using MySQL Shell, a powerful and user-friendly tool that enables fast, secure, and consistent data exports.
Following the export, we will guide you step-by-step through the import process to transfer the extracted data into the target environment (OCI MySQL HeatWave).
This section will also include best practices and recommendations to ensure a successful and reliable import, along with important precautions to preserve data integrity throughout the process.
Part 2: Implementing the OCI HeatWave MySQL Channel (Real-Time MASTER-SLAVE Replication)
In the second part, we will explain in detail how to implement the OCI HeatWave MySQL Channel, which enables the establishment of real-time MASTER-SLAVE replication between the AWS Aurora MySQL (MASTER) and OCI MySQL HeatWave (SLAVE) environments.
This approach ensures that all transactions performed on the AWS Aurora MySQL instance are automatically and continuously replicated in real time to the OCI HeatWave MySQL database using binary logs (binlogs).
In doing so, the OCI HeatWave instance will remain synchronized with the source, allowing the final migration cutover to take place with minimal downtime.
Additionally, we will provide detailed instructions for configuring the replication channel, monitoring its status, and troubleshooting potential synchronization issues during the replication phase.
By the end of this article, you will be equipped with all the necessary information to perform a secure, consistent, and low-impact migration from AWS Amazon Aurora MySQL to OCI MySQL HeatWave.
To facilitate understanding, the following flowchart clearly illustrates the steps that will be demonstrated in practice throughout this article.
Before we begin the practical export and import procedures using MySQL Shell, it is essential to ensure that the following parameters are properly configured and enabled in the source environment (AWS Amazon Aurora MySQL):
gtid_mode = ON
enforce-gtid-consistency = ON
log_bin = ON
binlog_format = ROW
log_slave_updates = ON
These parameters are mandatory to ensure that GTID-based replication (Global Transaction Identifiers) and binary logging are correctly enabled, thereby supporting a reliable, consistent, and compliant migration to the OCI HeatWave MySQL environment.
For more detailed information, refer to the official documentation below:
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_LogAccess.MySQL.BinaryFormat.html
EXPORT – util.dumpschemas
Export
In this step, we will perform the export (dump) of the npx database.
The resulting dump file will be stored in the directory /DUMP/NPX/.
Additionally, specific parameters will be used to ensure full compatibility of the dump with the target environment, OCI MySQL HeatWave.
util.dumpSchemas(
["npx"],
"/DUMP/NPX/",
{
threads: 60,
ocimds: true,
compatibility: [
"skip_invalid_accounts",
"strip_restricted_grants",
"ignore_wildcard_grants",
"strip_definers",
"strip_invalid_grants",
"create_invisible_pks" ],
consistent: true
}
);Explanation of the Parameters Used in the util.dumpSchemas Command
util.dumpSchemas
A MySQL Shell command used to generate a database dump (data export).
["npx"]
Specifies the name of the database to be exported.
"/DUMP/NPX/"
The directory path where the generated dump files will be stored.
threads: 60
Defines the number of parallel threads used during the export. In this case, 60 concurrent processes will be executed to speed up the dump operation.
ocimds: true
Automatically optimizes the export for full compatibility with OCI MySQL Database Service (MDS) or OCI MySQL HeatWave.
Parameters in the compatibility Field:
skip_invalid_accounts
Skips invalid or unsupported user accounts during the export to avoid compatibility issues with the target.strip_restricted_grants
Removes restricted privileges that are not supported by the target MySQL environment.ignore_wildcard_grants
Ignores user grants created using wildcards (e.g.,%), enhancing security and preventing potential permission issues on the target system.strip_definers
Removes specific DEFINER clauses from objects such as views, stored procedures, and triggers, preventing errors if the definer user does not exist on the target environment.strip_invalid_grants
Strips out any invalid or incompatible privilege definitions that may cause conflicts in the destination system.create_invisible_pks
Automatically creates invisible primary keys on tables that lack one, ensuring compatibility with platforms like OCI HeatWave, which may require primary keys for certain operations.
consistent: true
Ensures that the dump is transactionally consistent, meaning it reflects the exact state of the database at a single point in time, thus avoiding inconsistencies during the export process.
IMPORT – util.loadDump
Import
In this step, we will perform the import of the previously generated dump into the npx database.
The dump files to be imported are located in the directory /DUMP/NPX/.
To speed up the process, we will use 60 parallel threads and the ignoreVersion parameter, which allows the import to proceed even when there are version differences between the source and target MySQL instances.
The target database will be explicitly defined using the schema parameter, which in this case is also named npx.
It is important to note that in MySQL, the term schema is synonymous with database name.
util.loadDump(
"/DUMP/NPX",
{
threads: 60,
ignoreVersion: true,
schema: 'npx'
}
);Explanation of the Parameters Used in the util.loadDump Command
util.loadDump
A MySQL Shell command used to load (import) a previously exported dump into the target database.
"/DUMP/NPX"
Specifies the directory path where the dump files to be imported are located.
threads: 60
Indicates the number of parallel threads used during the import process. In this example, 60 concurrent threads will be used to speed up data loading.
ignoreVersion: true
Ignores version differences between the source database (where the dump was generated) and the target database. This allows the import to proceed even if there are minor version mismatches.
schema: 'npx'
Explicitly defines the name of the target database (schema) where the data will be imported. In this case, the target schema is npx.
Now that we have a clear understanding of how to perform the export and import procedures, let’s walk through the practical execution of these steps in a real-world lab environment.
Execution export – util.dumpschemas
MySQL XXXXXXXXX-producao-clone.c4xlg1kbktwa.us-west-2.rds.amazonaws.com:3306 ssl JS > util.dumpSchemas(
-> ["npx"],
-> "/DUMP/NPX/",
-> {
-> threads: 60,
-> ocimds: true,
-> compatibility: [
-> "skip_invalid_accounts",
-> "strip_restricted_grants",
-> "ignore_wildcard_grants","strip_definers",
-> "strip_invalid_grants","create_invisible_pks" ],
-> consistent: true
-> }
-> );
->
NOTE: The 'targetVersion' option is set to 9.1.0. This version supports the SET_ANY_DEFINER privilege, using the 'strip_definers' compatibility option is unnecessary.
NOTE: Backup lock is not available to the account 'tksmaster'@'%' and DDL changes will not be blocked. The dump may fail with an error if schema changes are made while dumping.
Acquiring global read lock
WARNING: The current user lacks privileges to acquire a global read lock using 'FLUSH TABLES WITH READ LOCK'. Falling back to LOCK TABLES...
Table locks acquired
Initializing - done
1 schemas will be dumped and within them 276 tables, 0 views, 5 routines.
Gathering information - done
All transactions have been started
Global read lock has been released
NOTE: When migrating to MySQL HeatWave Service, please always use the latest available version of MySQL Shell.
Checking for compatibility with MySQL HeatWave Service 9.1.0
Checking for potential upgrade issues.
The MySQL server at
beecare-producao-clone.c4xlg1kbktwa.us-west-2.rds.amazonaws.com:3306, version
8.0.39 - 2f855dc7, will now be checked for compatibility issues for upgrade to
MySQL 9.1.0.
WARNING: Upgrading MySQL Server from version 8.0.39 to 9.1.0 is not supported.
Please consider running the check using the following option: targetVersion=8.4
1) Checks for foreign keys not referencing a full unique index
(foreignKeyReferences)
No issues found
2) Checks for errors in column definitions (columnDefinition)
No issues found
3) Checks for partitions by key using columns with prefix key indexes
(partitionsWithPrefixKeys)
No issues found
Errors: 0
Warnings: 0
Notices: 0
No known compatibility errors or issues were found.
NOTE: Database `npx` had unsupported ENCRYPTION option commented out
NOTE: Function `npx`.`available_date` had definer clause removed
NOTE: Function `npx`.`available_date` had SQL SECURITY characteristic set to INVOKER
NOTE: Procedure `npx`.`GetEligibilityRecords` had definer clause removed
NOTE: Procedure `npx`.`GetEligibilityRecords` had SQL SECURITY characteristic set to INVOKER
NOTE: Procedure `npx`.`available_date_procedure` had definer clause removed
NOTE: Procedure `npx`.`available_date_procedure` had SQL SECURITY characteristic set to INVOKER
NOTE: Procedure `npx`.`SP_INSERT_PAYMENT_ADVICES` had definer clause removed
NOTE: Procedure `npx`.`SP_INSERT_PAYMENT_ADVICES` had SQL SECURITY characteristic set to INVOKER
NOTE: Procedure `npx`.`cadastar_payment_advice_partners` had definer clause removed
NOTE: Procedure `npx`.`cadastar_payment_advice_partners` had SQL SECURITY characteristic set to INVOKER
NOTE: Table `npx`.`migrations` does not have a Primary Key, this will be fixed when the dump is loaded
NOTE: Table `npx`.`password_resets` does not have a Primary Key, this will be fixed when the dump is loaded
NOTE: Table `npx`.`message_organization` does not have a Primary Key, this will be fixed when the dump is loaded
NOTE: Table `npx`.`message_menu` does not have a Primary Key, this will be fixed when the dump is loaded
Validating MySQL HeatWave Service compatibility - done
NOTE: One or more tables without Primary Keys were found.
Missing Primary Keys will be created automatically when this dump is loaded.
This will make it possible to enable High Availability in MySQL HeatWave Service DB System instance without application impact and without changes to the source database.
Inbound Replication into a DB System HA instance will also be possible, as long as the instance has version 8.0.32 or newer. For more information, see https://docs.oracle.com/en-us/iaas/mysql-database/doc/creating-replication-channel.html.
Compatibility issues with MySQL HeatWave Service 9.1.0 were found and repaired. Please review the changes made before loading them.
Writing global DDL files
Writing schema metadata - done
Running data dump using 60 threads.
NOTE: Progress information uses estimated values and may not be accurate.
NOTE: Table statistics not available for `npx`.`password_securities`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`password_securities`;' first.
Writing DDL - done
Writing table metadata - done
Starting data dump
NOTE: Table statistics not available for `npx`.`incident_types`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`incident_types`;' first.
NOTE: Backup lock is not available to the account 'tksmaster'@'%' and DDL changes were not blocked. The DDL is consistent, the world may resume now.
NOTE: Table statistics not available for `npx`.`comercial_contracts`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`comercial_contracts`;' first.
NOTE: Table statistics not available for `npx`.`comercial_negotiations`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`comercial_negotiations`;' first.
NOTE: Table statistics not available for `npx`.`procedure_info_files`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`procedure_info_files`;' first.
NOTE: Table statistics not available for `npx`.`refute_approval_levels`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`refute_approval_levels`;' first.
NOTE: Table statistics not available for `npx`.`modules`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`modules`;' first.
NOTE: Table statistics not available for `npx`.`organization_payment_types`, chunking operation may be not optimal. Please consider running 'ANALYZE TABLE `npx`.`organization_payment_types`;' first.
110% (3.60G rows / ~3.26G rows), 33.50K rows/s, 25.84 MB/s uncompressed, 1.17 MB/s compressed
Dump duration: 03:17:25s
Total duration: 03:24:46s
Schemas dumped: 1
Tables dumped: 276
Uncompressed data size: 1.45 TB
Compressed data size: 413.88 GB
Compression ratio: 3.5
Rows written: 3597220261
Bytes written: 413.88 GB
Average uncompressed throughput: 122.12 MB/s
Average compressed throughput: 34.94 MB/sExecution import – util.loadDump
MySQL 10.27.2.35:3306 ssl JS > util.loadDump(
-> "/DUMP/NPX",
-> {
-> threads: 60,
-> ignoreVersion: true,
-> schema: 'npx'
-> }
-> );
->
Loading DDL and Data from '/DUMP/NPX' using 60 threads.
Opening dump - done
Target is MySQL 8.4.4-u3-cloud (MySQL HeatWave Service). Dump was produced from MySQL 8.0.39
WARNING: Destination MySQL version is different than the value of the 'targetVersion' option set when the dump was created: 9.1.0
Scanning metadata - done
Checking for pre-existing objects - done
NOTE: The dump contains tables without Primary Keys and it is loaded with the 'createInvisiblePKs' option set to true, Inbound Replication into an MySQL HeatWave Service DB System instance with High Availability can be used with this dump.
Executing common preamble SQL - done
NOTE: [Worker017]: Error processing table `npx`.`comercial_auditor_tables`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker050]: Error processing table `npx`.`comercial_procedures`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker023]: Error processing table `npx`.`comercial_volumes`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker022]: Error processing table `npx`.`users`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker017]: Error processing table `npx`.`comercial_auditor_tables`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker022]: Error processing table `npx`.`users`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker046]: Error processing table `npx`.`payment_advice_partners`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker039]: Error processing table `npx`.`billing_headers`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker022]: Error processing table `npx`.`users`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker057]: Error processing table `npx`.`tax_records`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker006]: Error processing table `npx`.`statements`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker051]: Error processing table `npx`.`statement_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker014]: Error processing table `npx`.`partner_password_addresses`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker022]: Error processing table `npx`.`users`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker039]: Error processing table `npx`.`billing_headers`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker057]: Error processing table `npx`.`tax_records`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker006]: Error processing table `npx`.`statements`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker049]: Error processing table `npx`.`payment_glosa_insight_tmps`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker051]: Error processing table `npx`.`statement_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker014]: Error processing table `npx`.`partner_password_addresses`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker043]: Error processing table `npx`.`payment_glosa_insights`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker039]: Error processing table `npx`.`billing_headers`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker006]: Error processing table `npx`.`statements`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker057]: Error processing table `npx`.`tax_records`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker038]: Error processing table `npx`.`partner_configurations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker023]: Error processing table `npx`.`comercial_volumes`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker017]: Error processing table `npx`.`comercial_auditor_procedure_reference_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker021]: Error processing table `npx`.`partner_integration_windows`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker051]: Error processing table `npx`.`statement_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker014]: Error processing table `npx`.`partner_password_addresses`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker009]: Error processing table `npx`.`procedure_glosa_insights`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker053]: Error processing table `npx`.`glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker037]: Error processing table `npx`.`protocol_payments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker025]: Error processing table `npx`.`document_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker032]: Error processing table `npx`.`erp_refute_glosa_integrations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker054]: Error processing table `npx`.`mass_import_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker029]: Error processing table `npx`.`document_paperless_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker059]: Error processing table `npx`.`rpa_tasks`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker045]: Error processing table `npx`.`refute_glosa_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker056]: Error processing table `npx`.`authorization_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker012]: Error processing table `npx`.`protocol_payment_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker001]: Error processing table `npx`.`authorization_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker027]: Error processing table `npx`.`partner_passwords`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker003]: Error processing table `npx`.`authorizations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker036]: Error processing table `npx`.`refute_glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker030]: Error processing table `npx`.`partners`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker022]: Error processing table `npx`.`users`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker015]: Error processing table `npx`.`comercial_contracts`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker035]: Error processing table `npx`.`reconcile_statement_index_data_tmps`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker021]: Error processing table `npx`.`partner_integration_windows`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker019]: Error processing table `npx`.`resubmission_details`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker038]: Error processing table `npx`.`partner_connections`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker057]: Error processing table `npx`.`tax_records`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker039]: Error processing table `npx`.`billing_headers`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker006]: Error processing table `npx`.`statements`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker023]: Error processing table `npx`.`comercial_volumes`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker011]: Error processing table `npx`.`partner_integration_window_audits`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker013]: Error processing table `npx`.`procedure_glosa_insight_tmps`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker017]: Error processing table `npx`.`comercial_auditor_procedure_reference_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker044]: Error processing table `npx`.`related_glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker051]: Error processing table `npx`.`statement_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker058]: Error processing table `npx`.`procedure_info_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker002]: Error processing table `npx`.`integration_window_logs`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker014]: Error processing table `npx`.`partner_password_addresses`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker049]: Error processing table `npx`.`payment_glosa_insight_tmps`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker025]: Error processing table `npx`.`document_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker040]: Error processing table `npx`.`partner_status_relations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker027]: Error processing table `npx`.`partner_passwords`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker007]: Error processing table `npx`.`guide_payments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker004]: Error processing table `npx`.`document_paperless`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker048]: Error processing table `npx`.`refute_glosa_replies`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker029]: Error processing table `npx`.`document_paperless_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker054]: Error processing table `npx`.`mass_import_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker032]: Error processing table `npx`.`erp_refute_glosa_integrations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker045]: Error processing table `npx`.`refute_glosa_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker056]: Error processing table `npx`.`authorization_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker031]: Error processing table `npx`.`organization_from_to_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker012]: Error processing table `npx`.`protocol_payment_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker001]: Error processing table `npx`.`authorization_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker059]: Error processing table `npx`.`rpa_tasks`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker036]: Error processing table `npx`.`refute_glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker030]: Error processing table `npx`.`partners`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker030]: Error processing table `npx`.`partners`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker043]: Error processing table `npx`.`payment_glosa_insights`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker019]: Error processing table `npx`.`resubmission_details`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker037]: Error processing table `npx`.`protocol_payments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker003]: Error processing table `npx`.`authorizations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker009]: Error processing table `npx`.`procedure_glosa_insights`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker048]: Error processing table `npx`.`refute_glosa_replies`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker053]: Error processing table `npx`.`glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker035]: Error processing table `npx`.`reconcile_statement_index_data_tmps`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker007]: Error processing table `npx`.`guide_payments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker013]: Error processing table `npx`.`procedure_glosa_insight_tmps`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker030]: Error processing table `npx`.`partners`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker019]: Error processing table `npx`.`resubmission_details`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker037]: Error processing table `npx`.`protocol_payments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker057]: Error processing table `npx`.`tax_records`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker011]: Error processing table `npx`.`erp_reconcile_integrations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker025]: Error processing table `npx`.`document_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker045]: Error processing table `npx`.`refute_glosa_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker029]: Error processing table `npx`.`document_paperless_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker027]: Error processing table `npx`.`partner_passwords`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker056]: Error processing table `npx`.`authorization_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker032]: Error processing table `npx`.`erp_refute_glosa_integrations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker031]: Error processing table `npx`.`organization_from_to_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker012]: Error processing table `npx`.`protocol_payment_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker001]: Error processing table `npx`.`authorization_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker054]: Error processing table `npx`.`mass_import_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker053]: Error processing table `npx`.`glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker048]: Error processing table `npx`.`refute_glosa_replies`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker036]: Error processing table `npx`.`refute_glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker019]: Error processing table `npx`.`resubmission_details`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker007]: Error processing table `npx`.`guide_payments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker022]: Error processing table `npx`.`users`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker002]: Error processing table `npx`.`organizations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker048]: Error processing table `npx`.`refute_glosa_replies`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker045]: Error processing table `npx`.`refute_glosa_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker029]: Error processing table `npx`.`document_paperless_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker032]: Error processing table `npx`.`erp_refute_glosa_integrations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker001]: Error processing table `npx`.`authorization_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker012]: Error processing table `npx`.`protocol_payment_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker056]: Error processing table `npx`.`authorization_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker054]: Error processing table `npx`.`mass_import_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker036]: Error processing table `npx`.`refute_glosas`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker027]: Error processing table `npx`.`partner_passwords`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker030]: Error processing table `npx`.`partners`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker045]: Error processing table `npx`.`refute_glosa_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker001]: Error processing table `npx`.`authorization_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker054]: Error processing table `npx`.`mass_import_files`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker056]: Error processing table `npx`.`authorization_attachments`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker029]: Error processing table `npx`.`document_paperless_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker012]: Error processing table `npx`.`protocol_payment_histories`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker032]: Error processing table `npx`.`erp_refute_glosa_integrations`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
NOTE: [Worker027]: Error processing table `npx`.`partner_passwords`, will retry after delay: MySQL Error 1213 (40001): Deadlock found when trying to get lock; try restarting transaction
Executing DDL - done
Executing view DDL - done
Starting data load
2 thds indexing - 100% (1.45 TB / 1.45 TB), 0.00 B/s (15.64K rows/s), 276 / 276 tables done
Building indexes - done
Executing common postamble SQL - done
43064 chunks (3.60G rows, 1.45 TB) for 276 tables in 1 schemas were loaded in 7 hours 44 min 26 sec (avg throughput 51.91 MB/s, 129.09K rows/s)
277 DDL files were executed in 16 sec.
Data load duration: 7 hours 44 min 26 sec
2 indexes were built in 1 min 21 sec.
Total duration: 7 hours 45 min 54 sec
0 warnings were reported during the load.At this point in the article, we have the following consolidated scenario:
We have already performed a database export using the util.dumpSchemas command in the source environment (AWS Amazon Aurora MySQL), and a data import into the target environment (OCI HeatWave MySQL) using the util.loadDump command.
With this, we now move on to the second part of our article, where we will walk through the step-by-step configuration of the OCI HeatWave MySQL Channel.
This configuration will enable the creation of a MASTER/SLAVE replication setup between the two environments mentioned earlier—designating AWS Amazon Aurora MySQL as the MASTER and OCI HeatWave MySQL as its SLAVE replica.
As a result, all transactions executed on the Aurora MySQL database will be automatically replicated in real time to the OCI HeatWave MySQL instance.
At this stage, it is important to ensure that the replication-specific user has already been created in the source environment, that is, in the AWS Amazon Aurora MySQL database.
If this step has not yet been completed, use the commands below to create the user and grant the necessary replication privileges:
CREATE USER 'repuser'@'%' IDENTIFIED BY 'my_password';
GRANT REPLICATION SLAVE ON *.* TO 'repuser'@'%';
Verifying GTID Consistency Before Replication
When performing a database export using the util.dumpSchemas command, a special metadata file named @.json is automatically generated in the directory specified for storing the dump files.
This @.json file contains a comprehensive set of metadata, including critical information about the export process. Among the most important elements within this file is the GTID set (Global Transaction Identifiers), which plays a fundamental role in ensuring data consistency and the accurate tracking of replicated transactions.
It is strongly recommended to review and validate the contents of the @.json file prior to initiating the import process, as the GTID set recorded in this file will later be used during the replication configuration, particularly for the execution of the SET GTID_PURGED statement.
Failure to review or correctly apply the GTID information from this metadata file can result in common errors and may cause serious data consistency issues during the database migration and replication process.
[root@gateway-furushima-linux ~]# cd /DUMP/NPX/
[root@gateway-furushima-linux NPX]# pwd
/DUMP/NPX
[root@gateway-furushima-linux NPX]# cat @.json | grep -i '"gtidExecuted"'
"gtidExecuted": "415d143e-3653-30b3-980b-657ad05d72bd:1-44171859",
[root@gateway-furushima-linux NPX]# mysql -u sys -p'#SENHA_DO_MYSQL#' -h 192.168.1.35 -P 3306
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 886
Server version: 8.4.4-u4-cloud MySQL Enterprise - Cloud
Copyright (c) 2000, 2024, Oracle and/or its affiliates.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> call sys.SET_GTID_PURGED("+415d143e-3653-30b3-980b-657ad05d72bd:1-44171859");
Query OK, 0 rows affected (0.00 sec)mysql> SHOW GLOBAL VARIABLES LIKE 'gtid_executed';
+---------------+-----------------------------------------------------------------------------------------------+
| Variable_name | Value |
+---------------+-----------------------------------------------------------------------------------------------+
| gtid_executed | 415d143e-3653-30b3-980b-657ad05d72bd:1-49842480,
df21fd43-067a-11f0-b189-020017028ccd:1-44462 |
+---------------+-----------------------------------------------------------------------------------------------+
1 row in set (0.00 sec)
Using the SET_GTID_PURGED Command Correctly
When executing the SET_GTID_PURGED command, it is essential to strictly follow the format shown below to prevent replication errors:
CALL sys.SET_GTID_PURGED("+<gtidSet>");
Practical Example:
CALL sys.SET_GTID_PURGED("+415d143e-3653-30b3-980b-657ad05d72bd:1-44171859");
Special Attention to the “+” Symbol
It is mandatory to include the plus sign (“+”) before the GTID set (<gtidSet>).
This symbol instructs MySQL to append the provided GTID set to the existing one, rather than completely replacing the current GTID values.
This subtle yet critical detail is often overlooked or forgotten, and is one of the most common causes of errors during GTID-based database migration and replication.
Always double-check the presence of the “+” symbol when executing this command to ensure the process completes successfully.
How to Identify Replication Issues in MySQL
The most effective way to identify replication-related issues in MySQL is to connect directly to the replica instance of the MySQL DB System and run specific diagnostic commands.
For this purpose, we recommend using MySQL Shell, which provides a practical and robust interface for administering MySQL environments.
Replication issues are typically reported in four main locations:
1. SHOW REPLICA STATUS\G Command
This is the most commonly used method, though not the most comprehensive.
It provides a quick overview of the replication status, particularly useful for identifying problems with the replication threads—namely, SQL_thread and IO_thread.
2. performance_schema.replication_connection_status Table
This table should be consulted when the IO_thread (responsible for communication between the master and the replica) is not functioning properly.
It provides detailed information about connection failures with the master server.
3. performance_schema.replication_applier_status_by_coordinator and replication_applier_status_by_worker Tables
These two tables offer detailed diagnostics for issues related to the SQL_thread, which is responsible for applying replication events received from the master.
They are especially useful for identifying failures or stalls in the event applier process.
4. MySQL Error Log
The most critical and detailed errors are logged directly in the MySQL error log, which can also be accessed via the performance_schema.error_log table.
This method is particularly helpful in cloud environments, such as MySQL HeatWave Database Service, allowing for detailed tracking and analysis of replication issues.
By leveraging these methods together, you can quickly and accurately diagnose any replication problem occurring in your MySQL environment, speeding up resolution and restoring proper replication as efficiently as possible.
SELECT logged,
prio,
error_code,
data
FROM performance_schema.error_log
WHERE subsystem = 'Repl'
AND prio = 'Error'
ORDER BY 1 DESC;
mysql> select LOGGED , PRIO, ERROR_CODE, DATA from performance_schema.error_log where SUBSYSTEM = 'Repl' and PRIO = 'Error' order by 1 desc ;
+----------------------------+-------+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| LOGGED | PRIO | ERROR_CODE | DATA |
+----------------------------+-------+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 2025-03-24 20:48:35.415561 | Error | MY-010586 | Error running query, replica SQL thread aborted. Fix the problem, and restart the replica SQL thread with "START REPLICA". We stopped at log 'mysql-bin-changelog.001714' position 79540834 |
| 2025-03-24 20:48:35.414871 | Error | MY-010584 | Replica SQL for channel 'replication_channel': Worker 1 failed executing transaction '415d143e-3653-30b3-980b-657ad05d72bd:49842481' at source log mysql-bin-changelog.001714, end_log_pos 81453887; Error 'Plugin 'mysql_native_password' is not loaded' on query. Default database: 'npx'. Query: 'ALTER USER 'replication_user'@'%' IDENTIFIED WITH 'mysql_native_password' AS '*102732A660139466B3EC305AF2DB488933474F4A'', Error_code: MY-001524 |
| 2025-03-24 16:14:25.868055 | Error | MY-010569 | Replica I/O thread aborted while waiting for relay log space |
| 2025-03-24 08:50:37.531874 | Error | MY-010586 | Error running query, replica SQL thread aborted. Fix the problem, and restart the replica SQL thread with "START REPLICA". We stopped at log 'INVALID' position 0 |
| 2025-03-24 08:50:37.531007 | Error | MY-013146 | Replica SQL for channel 'replication_channel': Worker 1 failed executing transaction '415d143e-3653-30b3-980b-657ad05d72bd:1' at source log mysql-bin-changelog.000002, end_log_pos 3163; Column 32 of table 'npx.authorizations' cannot be converted from type 'blob' to type 'mediumblob', Error_code: MY-013146 |
| 2025-03-24 08:31:17.961232 | Error | MY-010569 | Replica I/O thread aborted while waiting for relay log space |
+----------------------------+-------+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
6 rows in set (0.00 sec)
-- Check Replication Channel
SELECT
concat(
conn_status.channel_name, ' (', worker_id,
')'
) AS channel,
conn_status.service_state AS io_state,
applier_status.service_state AS sql_state,
format_pico_time(
if(
GTID_SUBTRACT(
LAST_QUEUED_TRANSACTION, LAST_APPLIED_TRANSACTION
) = "",
"0",
abs(
time_to_sec(
if(
time_to_sec(
APPLYING_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP
)= 0,
0,
timediff(
APPLYING_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP,
now()
)
)
)
)
) * 1000000000000
) latency,
format_pico_time(
(
LAST_QUEUED_TRANSACTION_START_QUEUE_TIMESTAMP - LAST_QUEUED_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP
) * 100000000000
) transport_time,
format_pico_time(
(
LAST_QUEUED_TRANSACTION_END_QUEUE_TIMESTAMP - LAST_QUEUED_TRANSACTION_START_QUEUE_TIMESTAMP
) * 1000000000000
) time_to_relay_log,
format_pico_time(
(
LAST_APPLIED_TRANSACTION_END_APPLY_TIMESTAMP - LAST_APPLIED_TRANSACTION_START_APPLY_TIMESTAMP
) * 1000000000000
) apply_time,
conn_status.LAST_QUEUED_TRANSACTION AS last_queued_transaction,
applier_status.LAST_APPLIED_TRANSACTION AS last_applied_transaction
FROM
performance_schema.replication_connection_status AS conn_status
JOIN performance_schema.replication_applier_status_by_worker AS applier_status ON applier_status.channel_name = conn_status.channel_name;
+---------------------------+----------+-----------+---------+----------------+-------------------+------------+-----------------------------------------------+-----------------------------------------------+
| channel | io_state | sql_state | latency | transport_time | time_to_relay_log | apply_time | last_queued_transaction | last_applied_transaction |
+---------------------------+----------+-----------+---------+----------------+-------------------+------------+-----------------------------------------------+-----------------------------------------------+
| replication_channel (1) | ON | ON | 2.56 d | 2.36 d | 20.00 us | 1.86 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:50002732 |
| replication_channel (2) | ON | ON | 0 ps | 2.36 d | 20.00 us | 2.54 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:50002601 |
| replication_channel (3) | ON | ON | 0 ps | 2.36 d | 20.00 us | 3.85 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:50001734 |
| replication_channel (4) | ON | ON | 0 ps | 2.36 d | 20.00 us | 3.63 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:50001736 |
| replication_channel (5) | ON | ON | 0 ps | 2.36 d | 20.00 us | 3.45 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:50001727 |
| replication_channel (6) | ON | ON | 0 ps | 2.36 d | 20.00 us | 9.59 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49998021 |
| replication_channel (7) | ON | ON | 0 ps | 2.36 d | 20.00 us | 3.18 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49992586 |
| replication_channel (8) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.18 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49959713 |
| replication_channel (9) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.19 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49959714 |
| replication_channel (10) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.19 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49959715 |
| replication_channel (11) | ON | ON | 0 ps | 2.36 d | 20.00 us | 4.34 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49959717 |
| replication_channel (12) | ON | ON | 0 ps | 2.36 d | 20.00 us | 4.52 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49907064 |
| replication_channel (13) | ON | ON | 0 ps | 2.36 d | 20.00 us | 4.48 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49907065 |
| replication_channel (14) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.25 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866179 |
| replication_channel (15) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.21 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866180 |
| replication_channel (16) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.18 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866181 |
| replication_channel (17) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.17 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866182 |
| replication_channel (18) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.15 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866183 |
| replication_channel (19) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.13 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866184 |
| replication_channel (20) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.10 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866185 |
| replication_channel (21) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.09 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866186 |
| replication_channel (22) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.06 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866187 |
| replication_channel (23) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.04 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866188 |
| replication_channel (24) | ON | ON | 0 ps | 2.36 d | 20.00 us | 5.02 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866189 |
| replication_channel (25) | ON | ON | 0 ps | 2.36 d | 20.00 us | 4.98 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49866190 |
| replication_channel (26) | ON | ON | 0 ps | 2.36 d | 20.00 us | 6.01 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49850471 |
| replication_channel (27) | ON | ON | 0 ps | 2.36 d | 20.00 us | 6.01 ms | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | 415d143e-3653-30b3-980b-657ad05d72bd:49850472 |
| replication_channel (28) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (29) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (30) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (31) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (32) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (33) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (34) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (35) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (36) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (37) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (38) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (39) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (40) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (41) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (42) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (43) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (44) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (45) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (46) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (47) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (48) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (49) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (50) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (51) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (52) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (53) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (54) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (55) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (56) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (57) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (58) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (59) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (60) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (61) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (62) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (63) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (64) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (65) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (66) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (67) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (68) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (69) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (70) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (71) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (72) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (73) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (74) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (75) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (76) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (77) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (78) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (79) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (80) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (81) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (82) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (83) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (84) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (85) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (86) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (87) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (88) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (89) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (90) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (91) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (92) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (93) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (94) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (95) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (96) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (97) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (98) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (99) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (100) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (101) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (102) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (103) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (104) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (105) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (106) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (107) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (108) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (109) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (110) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (111) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (112) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (113) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (114) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (115) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (116) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (117) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (118) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (119) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (120) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (121) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (122) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (123) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (124) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (125) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (126) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (127) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (128) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (129) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (130) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (131) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (132) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (133) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (134) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (135) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (136) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (137) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (138) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (139) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (140) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (141) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (142) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (143) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (144) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (145) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (146) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (147) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (148) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (149) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (150) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (151) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (152) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (153) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (154) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (155) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (156) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (157) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (158) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (159) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (160) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (161) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (162) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (163) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (164) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (165) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (166) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (167) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (168) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (169) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (170) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (171) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (172) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (173) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (174) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (175) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (176) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (177) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (178) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (179) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (180) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (181) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (182) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (183) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (184) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (185) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (186) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (187) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (188) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (189) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (190) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (191) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (192) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (193) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (194) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (195) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (196) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (197) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (198) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (199) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (200) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (201) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (202) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (203) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (204) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (205) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (206) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (207) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (208) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (209) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (210) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (211) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (212) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (213) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (214) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (215) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (216) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (217) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (218) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (219) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (220) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (221) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (222) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (223) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (224) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (225) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (226) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (227) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (228) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (229) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (230) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (231) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (232) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (233) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (234) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (235) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (236) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (237) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (238) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (239) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (240) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (241) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (242) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (243) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (244) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (245) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (246) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (247) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (248) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (249) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (250) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (251) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (252) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (253) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (254) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (255) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
| replication_channel (256) | ON | ON | 0 ps | 2.36 d | 20.00 us | 0 ps | 415d143e-3653-30b3-980b-657ad05d72bd:50467766 | |
+---------------------------+----------+-----------+---------+----------------+-------------------+------------+-----------------------------------------------+-----------------------------------------------+
256 rows in set (0.01 sec)
🔸 channel
Identifies the name of the replication channel, along with the specific thread or worker number.
Example: replication_channel (1)
🔸 io_state
Indicates the state of the channel related to binlog connection and transfer (I/O Thread).
Possible values:
ON→ The connection is active and functioning normally.OFF→ The connection is inactive or disconnected.
🔸 sql_state
Reflects the state of transaction application (SQL Thread).
Possible values:
ON→ Transactions are being applied correctly.OFF→ Transaction application is halted or experiencing issues.
🔸 latency
Represents the overall replication lag, indicating the delay between the last GTID received by the replica and the last GTID actually applied.
Example: 2.56 d means that channel (1) is 2.56 days behind in applying transactions.
🔸 time_to_relay_log
The time it takes for the replica to write the received data to the relay log.
This value is typically very small.
Example: 20.00 µs (microseconds), which is an acceptable and fast response time.
🔸 apply_time
The time taken by the replica to apply the last transaction to its local database.
Example: 1.86 ms, 5.18 ms — these are considered good and acceptable values.
🔸 last_queued_transaction
Indicates the last GTID received (queued) from the master.
🔸 last_applied_transaction
Indicates the last GTID successfully applied by the replica.
The difference between this GTID and the last_queued_transaction represents the current replication lag.
mysql> show replica status \G ;
*************************** 1. row ***************************
Replica_IO_State: Waiting for source to send event
Source_Host: 100.22.20.186
Source_User: replication_user
Source_Port: 3306
Connect_Retry: 60
Source_Log_File: mysql-bin-changelog.001778
Read_Source_Log_Pos: 66207953
Relay_Log_File: relay-log-replication_channel.000006
Relay_Log_Pos: 70856500
Relay_Source_Log_File: mysql-bin-changelog.001716
Replica_IO_Running: Yes
Replica_SQL_Running: Yes
Replicate_Do_DB:
Replicate_Ignore_DB:
Replicate_Do_Table:
Replicate_Ignore_Table:
Replicate_Wild_Do_Table:
Replicate_Wild_Ignore_Table:
Last_Errno: 0
Last_Error:
Skip_Counter: 0
Exec_Source_Log_Pos: 70856263
Relay_Log_Space: 8521164737
Until_Condition: None
Until_Log_File:
Until_Log_Pos: 0
Source_SSL_Allowed: Yes
Source_SSL_CA_File:
Source_SSL_CA_Path:
Source_SSL_Cert:
Source_SSL_Cipher:
Source_SSL_Key:
Seconds_Behind_Source: 232722
Source_SSL_Verify_Server_Cert: No
Last_IO_Errno: 0
Last_IO_Error:
Last_SQL_Errno: 0
Last_SQL_Error:
Replicate_Ignore_Server_Ids:
Source_Server_Id: 925869836
Source_UUID: 415d143e-3653-30b3-980b-657ad05d72bd
Source_Info_File: mysql.slave_master_info
SQL_Delay: 0
SQL_Remaining_Delay: NULL
Replica_SQL_Running_State: Waiting for dependent transaction to commit
Source_Retry_Count: 0
Source_Bind: 10.27.2.35
Last_IO_Error_Timestamp:
Last_SQL_Error_Timestamp:
Source_SSL_Crl:
Source_SSL_Crlpath:
Retrieved_Gtid_Set: 415d143e-3653-30b3-980b-657ad05d72bd:49842481-50356353
Executed_Gtid_Set: 415d143e-3653-30b3-980b-657ad05d72bd:1-49854029,
df21fd43-067a-11f0-b189-020017028ccd:1-44464
Auto_Position: 1
Replicate_Rewrite_DB:
Channel_Name: replication_channel
Source_TLS_Version: TLSv1.2,TLSv1.3
Source_public_key_path:
Get_Source_public_key: 1
Network_Namespace: mysql
1 row in set (0.01 sec)
Monitoring MySQL Replication
Replication Status
- Replica_IO_Running and Replica_SQL_Running:
Indicate whether the I/O and SQL threads are active—critical for verifying the replication’s operational status. - Replica_IO_State:
Displays the current state of the I/O thread, such as"Waiting for source to send event", indicating that the replica is ready to receive new events.
Source Server Connection
- Source_Host, Source_User, and Source_Port:
Show the host address, user, and port of the source (master) server—key for validating the replication connection. - Connect_Retry:
Defines the retry interval before attempting to reconnect to the source, reflecting the connection’s resilience in case of failure.
Log Position Tracking
- Source_Log_File and Read_Source_Log_Pos:
Indicate the current binary log file and read position on the source server—useful for tracking replication progress. - Relay_Log_File and Relay_Log_Pos:
Refer to the relay log file and position on the replica—important for monitoring the processing of incoming events. - Exec_Source_Log_Pos:
The position up to which SQL statements have been executed on the replica—critical for understanding how much of the transaction stream has been applied.
Performance and Lag
- Seconds_Behind_Source:
Shows the replication lag in seconds between the replica and the source—a vital metric for performance and stability monitoring.
Security
- Source_SSL_Allowed and Source_SSL_Verify_Server_Cert:
Indicate whether SSL encryption is enabled for the connection and whether the source server’s certificate is verified, helping ensure data security and integrity.
Global Transaction Identifiers (GTIDs)
- Auto_Position:
Enables GTID-based auto-positioning, which simplifies the configuration and management of replication. - Retrieved_Gtid_Set and Executed_Gtid_Set:
Represent the sets of GTIDs that have been retrieved and executed, respectively—essential for verifying consistency and integrity in GTID-based replication.
Error Diagnostics
- Last_IO_Errno, Last_IO_Error, Last_SQL_Errno, and Last_SQL_Error:
Provide information about the most recent I/O and SQL thread errors, essential for diagnosing and resolving replication issues.
mysql> select * from performance_schema.replication_connection_status\G
*************************** 1. row ***************************
CHANNEL_NAME: replication_channel
GROUP_NAME:
SOURCE_UUID: 415d143e-3653-30b3-980b-657ad05d72bd
THREAD_ID: 1651
SERVICE_STATE: ON
COUNT_RECEIVED_HEARTBEATS: 3
LAST_HEARTBEAT_TIMESTAMP: 2025-03-25 15:16:16.930055
RECEIVED_TRANSACTION_SET: 415d143e-3653-30b3-980b-657ad05d72bd:49842481-50396683
LAST_ERROR_NUMBER: 0
LAST_ERROR_MESSAGE:
LAST_ERROR_TIMESTAMP: 0000-00-00 00:00:00.000000
LAST_QUEUED_TRANSACTION: 415d143e-3653-30b3-980b-657ad05d72bd:50396683
LAST_QUEUED_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP: 2025-03-23 09:16:47.013504
LAST_QUEUED_TRANSACTION_IMMEDIATE_COMMIT_TIMESTAMP: 2025-03-23 09:16:47.013504
LAST_QUEUED_TRANSACTION_START_QUEUE_TIMESTAMP: 2025-03-25 15:18:35.587187
LAST_QUEUED_TRANSACTION_END_QUEUE_TIMESTAMP: 2025-03-25 15:18:35.587199
QUEUEING_TRANSACTION: 415d143e-3653-30b3-980b-657ad05d72bd:50396684
QUEUEING_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP: 2025-03-23 09:16:47.201468
QUEUEING_TRANSACTION_IMMEDIATE_COMMIT_TIMESTAMP: 2025-03-23 09:16:47.201468
QUEUEING_TRANSACTION_START_QUEUE_TIMESTAMP: 2025-03-25 15:18:35.587203
1 row in set (0.00 sec)Monitoring Replication via performance_schema.replication_connection_status
MySQL provides the performance_schema.replication_connection_status table to monitor the current state of the I/O thread that manages the replica’s connection to the source server.
This table offers detailed insights into the replication connection, including service status, received transactions, and potential errors.
Below are the key metrics for effectively monitoring replication:
Replication Connection State
- SERVICE_STATE:
Indicates the current state of the replica’s I/O thread. Possible values include:ON: The connection is active.OFF: The connection is inactive.CONNECTING: The replica is attempting to connect to the source.
Connection Identification
- CHANNEL_NAME:
Name of the replication channel associated with this connection. - SOURCE_UUID:
The unique universal identifier (UUID) of the source server — useful for tracking the origin of the replication.
Transaction Information
- RECEIVED_TRANSACTION_SET:
The set of GTIDs (Global Transaction Identifiers) representing all transactions received by the replica. - LAST_QUEUED_TRANSACTION:
The GTID of the last transaction queued in the relay log. - LAST_QUEUED_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP:
Timestamp when the last queued transaction was originally committed on the source server. - LAST_QUEUED_TRANSACTION_IMMEDIATE_COMMIT_TIMESTAMP:
Timestamp when the last queued transaction was committed on the immediate upstream source (e.g., an intermediate master). - LAST_QUEUED_TRANSACTION_START_QUEUE_TIMESTAMP:
Timestamp indicating when the I/O thread started queuing the last transaction. - LAST_QUEUED_TRANSACTION_END_QUEUE_TIMESTAMP:
Timestamp indicating when the transaction was fully queued into the relay log.
Replication Heartbeats
- LAST_HEARTBEAT_TIMESTAMP:
Timestamp of the last heartbeat signal received from the source server, confirming the connection is alive even in the absence of recent events. - COUNT_RECEIVED_HEARTBEATS:
Total number of heartbeat signals received since the replica was last restarted or reset.
Error Information
- LAST_ERROR_NUMBER:
The error code of the most recent I/O thread failure. A value of0indicates no errors. - LAST_ERROR_MESSAGE:
The error message associated with the most recent failure. An empty string indicates no recent errors. - LAST_ERROR_TIMESTAMP:
Timestamp of the last I/O thread error occurrence.
Timestamps for Current Transactions
- QUEUEING_TRANSACTION:
The GTID of the transaction currently being queued. - QUEUEING_TRANSACTION_ORIGINAL_COMMIT_TIMESTAMP:
Timestamp when the currently queued transaction was committed on the original source server. - QUEUEING_TRANSACTION_IMMEDIATE_COMMIT_TIMESTAMP:
Timestamp when the transaction was committed on the immediate upstream source. - QUEUEING_TRANSACTION_START_QUEUE_TIMESTAMP:
Timestamp when the first event of the currently queued transaction was written to the relay log.
✅ Final Checklist – Migration from AWS Aurora MySQL to OCI HeatWave MySQL
To conclude this article, we present a practical and detailed checklist of the main steps required to successfully perform a migration from AWS Amazon Aurora MySQL to OCI HeatWave MySQL, with minimal downtime.
This high-level summary offers a clear and structured view of the entire process, serving as a quick reference for readers with varying levels of technical background and time availability.
1. Validation of Prerequisites
- Ensure that the MySQL infrastructures on AWS and OCI are fully provisioned.
- Confirm network connectivity between AWS (Aurora MySQL) and OCI (HeatWave MySQL), with port 3306 open.
- Use a bridge server with MySQL Shell installed, ensuring full bidirectional connectivity between the environments.
- Refer to the Official Oracle Documentation for in-depth prerequisite validation.
2. Mandatory Configuration in AWS Aurora MySQL (Source)
Enable and verify the following parameters:
gtid_mode = ON
enforce-gtid-consistency = ON
log_bin = ON
binlog_format = ROW
log_slave_updates = ON
These configurations are essential to ensure technical feasibility and data integrity during replication.
For details, consult the Official AWS Documentation.
3. Export and Import Using MySQL Shell
- Use MySQL Shell as the primary tool for the export/import process.
- Ensure proper execution, including the correct handling of JSON metadata files for GTID consistency.
- Follow best practices provided throughout the article for a smooth transfer.
4. Replication User Configuration
- Confirm that the replication user is properly created on AWS Aurora MySQL (source) and has the required privileges.
- A full example for creating the user
repuseris provided earlier in this article to avoid permission-related issues.
5. OCI HeatWave MySQL Channel Configuration
- Ensure GTID consistency between source and target using the
.jsonfile generated during export. - If needed, adjust GTIDs with the
SET GTID_PURGEDcommand. - Pay special attention to the step-by-step instructions previously outlined for the correct implementation of the replication channel in OCI.
6. Troubleshooting and Monitoring
- Use the monitoring techniques and scripts provided in this article to detect issues proactively.
- Leverage MySQL Shell,
performance_schematables, and error logs for effective diagnosis and resolution.
- https://docs.oracle.com/en-us/iaas/mysql-database/doc/replication.html
- https://docs.oracle.com/pt-br/learn/oci-mysql-heatwave-gcp-migration/index.html#next-steps
- https://blogs.oracle.com/mysql/post/mysql-heatwave-database-service-inbound-replication-channel-troubleshooting-guide
- http://dasini.net/blog/2021/01/26/replicate-from-mysql-5-7-to-mysql-database-service/
- Setup Disaster Recovery for OCI MySQL Database Service
- MySQL HeatWave Replication Filters and Sources Without GTIDs
- Live Migration from Azure Database for MySQL to MySQL HeatWave Database Service on OCI
- Successful RDS to OCI MySQL HeatWave Migration with Replication Channel Filters
- https://www.slideshare.net/lefred.descamps/mysql-database-service-webinar-upgrading-from-onpremise-mysql-to-mds
- https://blog.shadabmohammad.com/zero-downtime-migration-from-rds-mysql-to-oci-mysql-heatwave-using-inbound-replication-channel-9319dfaff0bd
