GridGain Developers Hub

Data Center Replication

Overview

The Data Replication screen lets users view various statistics related to the data replication process and provides controls to manage the process via a user interface. Data Center Replication is a GridGain feature that allows caches to be replicated from one cluster to another (or multiple clusters at once).

The Data Replication screen contains two tabs:

  • Sender tab — displays the statistics related to the master cluster: data transfer rate, sender nodes, replication-enabled caches. This tab displays useful information only when Web Console is connected to the active cluster, i.e. the cluster that is configured to send data to the replica(s).

  • Receiver tab — displays the statistics related to the replica cluster, i.e. the cluster that receives the data from the master cluster(s). This tab contains information when Web Console is connected to the replica cluster.

Log in to your GridGain Web Console account and click on the Data Replication icon on the left-hand navigation bar.

wc dr


Managing Replication Process

You can pause/resume the replication process for specific caches using the Data Node Caches widget on the Sender tab.

Sender Tab

The Sender tab contains a number of widgets that display statistics on the data sent to the remote clusters. If you use active-passive replication mode, this tab provides an insight into what happens in the master cluster. In case of the active-active mode, this information is relevant to both clusters, because both clusters send data to each other.

wc dr sender

The following sections provide a brief description of each widget.

Data Node Metrics

This widget displays the statistics on the data sent from the current cluster to the remote clusters. The widget is a chart with four time series:

  • Batches Sent — The number of batches per second sent to the remote clusters.

  • Batches Acked — The number of batches per second that have been acknowledged by the remote clusters.

  • Entries Sent — The number of entries per second sent to the remote clusters.

  • Entries Acked — The number of entries per second that have been acknowledged by the remote clusters.

Hovering over the chart will show the metrics in detail.

sender tab data node metrics


Sender Hubs Metrics

This widget displays statistics on the number of batches/entries received on the sender nodes of the current cluster from all other cluster nodes. It displays two time series:

  • Batches Received — The number of batches per second that the sender nodes received from the other nodes of the cluster.

  • Entries Received — The number of cache entries per second that the sender nodes received from the other nodes of the cluster.

sender tab sender hubs metrics


Data Nodes

A list of all nodes that host the caches that are configured to be replicated.

sender tab data nodes


Data Node Caches

A list of replication-enabled caches. The table displays the current state of the replication process and the statistics on the number of entries/bytes that have been replicated since the start of replication.

sender tab data node caches

The table contains the following columns:

Column Description

State

The state of the replication process for the cache. If the process is paused, the column also displays the reason for the pause.

Cache Name

The name of the cache.

Batches Sent

The number of batches sent to the remote cluster.

Batches Acked

The number of batches sent to the remote clusters that have been acknowledged.

Batches Failed

The number of failed batches. A batch is considered failed if it couldn’t be sent to the sender nodes (for example, if all sender nodes are not available).

Entries Sent

The number of entries of this cache sent to the remote cluster.

Entries Acked

The number of entries sent to the remote clusters that have been acknowledged.

Entries Filtered

The number of entries filtered using an entry filter.

Queue

Makes no sense at the moment.


The Actions drop-down menu can be used to:

  • stop/resume the replication process for the selected caches

  • perform a full state transfer for the selected caches

actions


Sender Hubs

A list of sender nodes configured in this cluster. The table shows the ID of the node and its IP-address.

sender tab sender hubs


Sender Hubs Caches

The table displays the statistics on the data the sender nodes received from other nodes for the given caches since the start of the replication process.

sender tab sender hub caches

The table has the following columns:

Column Description

Cache Name

The name of the cache.

Batches Received

The number of batches the sender nodes received from the cluster nodes that host the cache.

Entries Received

The number of entries the sender nodes received from the cluster nodes that host the cache.

Bytes Received

The number of bytes the sender nodes received from the cluster nodes that host the cache.


Remote Receiver Hubs

A list of addresses of the remote cluster nodes this cluster is connected to. The table shows the ID of the remote cluster and the endpoint of the receiver.

sender tab remote receiver hubs


Remote DC

Each sender node must have at least one connection to at least one remote cluster. This table displays a list of remote clusters.

sender tab remote dc

The table has the following columns:

Column Description

Remote DC ID

The ID of the remote cluster.

Batches Sent

The number of batches (from all caches) sent to the remote cluster.

Batches Acked

The number of batches that have been acknowledged by the remote cluster.

Entries Sent

The number of entries (from all caches) sent to the remote cluster.

Entries Acked

The number of entries that have been acknowledged by the remote cluster.


Receiver Tab

The Receiver tab contains a number of widgets that display various statistics about the receiver nodes and the amount of data received from the remote clusters.

wc dr receiver

The widgets are described in the following sections.

Data Node Metrics

  • Entries Received — The number of entries received from the remote clusters.

  • Conflict New — The number of conflicts between existing and updated entries that were resolved in favor of the new values.

  • Conflict Old — The number of conflicts between existing and updated entries that were resolved in favor of the existing values.

  • Conflict Merge — The number of conflicts between existing and updated entries that were resolved to a value that is different from both the new and existing ones.

receiver tab data node metrics


Receiver Hubs Metrics

This widget contains two charts:

  • Batches received — The number of batches all receiver nodes received from the remote clusters.

  • Entries received — The number of entries all receiver nodes received from the remote clusters.

receiver tab receiver hub metrics


Data Nodes

A list of nodes that host the caches that are replicated from the remote clusters.

receiver tab data nodes


Caches

A list of caches that are replicated from the remote clusters.

receiver tab caches

The table contains the following columns:

Column Description

Cache Name

The name of the cache.

Entries Received

The number of entries received from the remote clusters.

Conflicts New

The number of conflicts between existing and updated entries that were resolved in favor of the new values.

Conflicts Old

The number of conflicts between existing and updated entries that were resolved in favor of the existing values.

Conflicts Merge

The number of conflicts between existing and updated entries that were resolved to a value that is different from both the new and existing ones.


Receiver Hubs

A list of receiver nodes configured in this cluster.

receiver tab receiver hubs


Remote DC

This table displays the list of remote clusters that send data to the current cluster.

receiver tab remote dc

The table contains the following columns:

Column Description

DC

The ID of the remote cluster.

Batches Received

The number of batches that this cluster received from the remote cluster.

Entries Received

The number of entries that this cluster received from the remote cluster.

Bytes Received

The number of bytes that this cluster received from the remote cluster.


Receiver Hub Metrics

This widget displays various statistics about the data received on specific receiver nodes in a tabular form.

receiver tab receiver hub metrics table

The table has the following columns:

Column Description

Hub ID8

The ID of the receiver node.

Hub IP

The IP-address of the node.

Batches Sent

The number of batches that this receiver node sent to the cluster node.

Batches Acked

The number of batches this receiver has sent to another cluster nodes that have been acknowledged.

Average Batch Acked Time

Average acknowledgement time.

Entries Sent

The number of entries that this receiver node put into the caches in this cluster.

Entries Acked

The number of entries that this receiver node put into the caches in this cluster.

Bytes Sent

The number of bytes this receiver node put into the caches in this cluster.

Bytes Acked

The number of bytes this receiver node put into the caches in this cluster.