If you have a local IDC, COS offers the following migration methods to help you quickly migrate massive amounts of local data to COS.
Migration Method | Description |
---|---|
COS Migration(online migration) | COS Migration is an all-in-one tool integrating COS data migration features. You can migrate data to COS quickly after completing simple configurations. |
Cloud Data Migration (CDM) (offline migration) | CDM uses a dedicated offline migration device provided by Tencent Cloud to help you migrate your local data to the cloud, solving the problems that arise from online migration from a local IDC to cloud, such as long time, high costs, and low security. |
You can determine how to migrate data based on the data volume, IDC egress bandwidth, IDC idle server resources, acceptable completion time, and other factors. The estimated time needed for online migration is shown in the figure below. As can be seen, if data migration needs to take more than 10 days or the amount of data to be migrated exceeds 50 TB, you are recommended to use CDM for offline migration; otherwise, online migration is a better choice.
Data migration may be affected if there is a high number of small files below 1 MB or the performance of disk IO is insufficient.
The steps are as follows:
For more information, please see COS Migration Tool.
Below describes how to configure COS Migration to maximize the migration speed:
[common]
section of the config.ini
configuration file:Parameter Name | Parameter Description |
---|---|
smallFileThreshold | Threshold for small files. If the size of a file is higher than or equal to this threshold, multipart upload will be used; otherwise, simple upload will be used. The default value is 5 MB. |
bigFileExecutorNum | Concurrence of large files, which is 8 by default. If COS is connected to over the public network with low bandwidth, reduce this value. |
smallFileExecutorNum | Concurrence of small files, which is 64 by default. If COS is connected to over the public network with low bandwidth, reduce this value. |
executeTimeWindow | This parameter defines the time range when the migration tool will execute a task every day, which will enter sleep mode at other times. In sleep mode, the migration will be paused and the migration progress will be retained until the next time window when the migration will be resumed automatically. |
The steps are as follows:
For more information, please see Cloud Data Migration (CDM).
Below describes how to migrate data to COS offline efficiently and securely.
Was this page helpful?