Quickstart (On-Premise)

BladePipe is an efficient and secure tool for data migration and sync. This page describes how to move data using BladePipe On-Premise in just a few steps.

Install BladePipe

Follow the instructions in Install All-In-One (Binary) to deploy BladePipe.

Add a DataSource

Here we use a self-managed MySQL DataSource as an example. For more details, see Add Self-managed DataSource. For the other supported DataSources, see Supported DataSources.

1. Log in to the BladePipe Console.
2. In the top navigation bar, click DataSource.
3. In the upper right corner of the page, click Add DataSource.
4. Choose Self Maintenance for Deployment.
5. Select MySQL as the datasource type.
6. Fill out the required fields, including address, account and password, etc.
7. Click Test Connection to verify the connection.
8. Click Add DataSource.

Create a DataJob

Here we take a MySQL-MySQL data synchronization as an example. For more details, see Create General DataJob.

1. Log in to the added MySQL database.
2. Run the provided script to prepare the test data.

   # source database
   create database sample_src;
        
   # target database
   create database sample_dst;
         
   # prepare tables and data for migration and sync
   use sample_src;
   CREATE TABLE IF NOT EXISTS `sample_src`.`test_table`(
   `id` INT UNSIGNED AUTO_INCREMENT,
   `name` VARCHAR(32) NOT NULL,
   `age` int not null ,
   PRIMARY KEY ( `id` )
   )ENGINE=InnoDB DEFAULT CHARSET=utf8;
     
   # prepare test data 
   insert into  `sample_src`.`test_table`(id,name,age) values(1,'hello',18);
   insert into  `sample_src`.`test_table`(id,name,age) values(2,'world',18);
   insert into  `sample_src`.`test_table`(id,name,age) values(3,',',18);
   insert into  `sample_src`.`test_table`(id,name,age) values(4,'cloudcanal',18);
3. In BladePipe, click DataJob in the top navigation bar.
4. In the upper right corner, click Create DataJob.
5. Select the added MySQL instance as both the Source and Target, and click Test Connection. Then click Next Step.
6. Choose Incremental as the DataJob type, and select Full Data. Then click Next Step.
7. Choose the tables you want to sync, then click Next Step.
8. Select all columns, then click Next Step.
9. Click Create DataJob.
10. Go to the DataJob list page to check the progress of the DataJob.

Verify the Data

1. Insert, update, and delete data in the source database.
2. Check whether the data in the target database is consistent with the data in the source.