Quickstart (BYOC)

BladePipe is an efficient and secure tool for data migration and sync. This page describes how to move data using BladePipe BYOC in just a few steps.

Install BladePipe

Follow the instructions in Install Worker (Docker) / Install Worker (Binary) to install BladePipe.

Select Region

1. Log in to the BladePipe Cloud.
2. In the upper right corner of the page, select the region which is closer to your data center.

Add a DataSource

Here we use a self-managed MySQL DataSource as an example. For more details, see Add Self-managed DataSource. For the other supported DataSources, see Supported DataSources.

1. In the top navigation bar, click DataSource.
2. In the upper right corner of the page, click Add DataSource.
3. Choose Self Maintenance for Deployment.
4. Select MySQL as the datasource type.
5. Fill out the required fields, including address, account and password, etc.
6. Click Test Connection to verify the connection.
7. Click Add DataSource.

Payment (Optional)

1. Add a card.
   1. Navigate to Settings > Payment page.
   2. Click Add New Card.
   3. Enter card info and save.
2. Subscribe BladePipe.
   1. Navigate to Settings > Payment page.
   2. Choose one card already added.
   3. Click Subscribe.

info

A new user of BladePipe will receive a voucher by default, so a new user can skip this step.

Please note that after the voucher is used up, the DataJobs will be suspended within 24 hours. To avoid DataJob interruption, please add a payment card and subscribe to BladePipe service in time.

Create a DataJob

Here we take a MySQL-MySQL data synchronization as an example. For more details, see Create General DataJob.

1. Log in to the added MySQL database.
2. Run the provided script to prepare the test data.

   # source database
   create database sample_src;
        
   # target database
   create database sample_dst;
         
   # prepare tables and data for migration and sync
   use sample_src;
   CREATE TABLE IF NOT EXISTS `sample_src`.`test_table`(
   `id` INT UNSIGNED AUTO_INCREMENT,
   `name` VARCHAR(32) NOT NULL,
   `age` int not null ,
   PRIMARY KEY ( `id` )
   )ENGINE=InnoDB DEFAULT CHARSET=utf8;
     
   # prepare test data 
   insert into  `sample_src`.`test_table`(id,name,age) values(1,'hello',18);
   insert into  `sample_src`.`test_table`(id,name,age) values(2,'world',18);
   insert into  `sample_src`.`test_table`(id,name,age) values(3,',',18);
   insert into  `sample_src`.`test_table`(id,name,age) values(4,'cloudcanal',18);
3. In BladePipe, click DataJob in the top navigation bar.
4. In the upper right corner, click Create DataJob.
5. Select the added MySQL instance as both the Source and Target, and click Test Connection. Then click Next Step.
6. Choose Incremental as the DataJob type, and select Full Data. Then click Next Step.
7. Choose the tables you want to sync, then click Next Step.
8. Select all columns, then click Next Step.
9. Click Create DataJob.
10. Go to the DataJob list page to check the progress of the DataJob.

Verify the Data

1. Insert, update, and delete data in the source database.
2. Check whether the data in the target database is consistent with the data in the source.