“This is my 21st day of participating in the First Challenge 2022. For more details: First Challenge 2022
Abstract:
Many DBA students often encounter the problem of real-time synchronization from one database to another. Homogeneous data is relatively easy, but it is difficult to synchronize heterogeneous data, multiple tables and large amount of data. Oracle Data sync to Elasticsearch in real time I tested a way to synchronize data to Elasticsearch in real time.
Real-time synchronization of Oracle data to Elasticsearch is generally used for full text search. This article Tapdata Cloud as an example, this tool is free, the test effect is ok, the following is to give you a specific demonstration operation
Step 1: Configure the Oracle connection
- Click [Connection Management] in the left menu bar of Tapdata Cloud operation background, and then click [Create Connection] in the upper right corner of [Connection List] in the right area to open the connection type selection page, and then select Oracle
2. On the connection information configuration page that is displayed, enter the required configuration information
[Connection name] : Indicates the name of the connection. The name of multiple connections must be unique
Database address: indicates the DATABASE IP address/Host
[Port] : database port
[Database name] : TapData Database connection takes a DB as a data source. Db here refers to the database in a database instance, not a schema.
[Account Number] : account that can access the database
Key code: password of the database account
[Time zone] : Time zone of the database is used by default. If the time zone is specified, the specified time zone is used
Step 2: Configure the Elasticsearch connection
- Click The “Create Connection” button in the upper right corner of the “Connect List” area to open the connection type selection page, and then select Elasticsearch
- On the displayed connection information configuration page, enter the required configuration information one by one. After the configuration is complete, save the test connection.
Step 3: Select the synchronization mode – full/Incremental/Full + Increment
Enter the Tapdata Cloud operation background task management page and click the Add Task button to enter the task setting process
Select the libraries and tables to be synchronized based on data requirements. If you need to modify table names, you can set the table names of the target end in batches by using the table name batch modification function on the page.
After setting the above options, select the synchronization type. The platform provides full synchronization, incremental synchronization, and full + incremental synchronization, and set the write mode and read quantity.
If **** full and incremental synchronization is selected, **** automatically enters the incremental synchronization state after the full task is completed. In this state, Tapdata Agent will continuously monitor data changes (including write, update and delete) at the source end and write these data changes to the target end in real time.
Click Task Monitoring to view the task execution details page.
Part four: data verification
After the completion of the general synchronization, I am used to the data check, to prevent stepping pits.
There are three verification modes in Tapdata Cloud. I often use the fastest fast count verification, which is simple and convenient. I only need to select the table to be verified without setting other complicated parameters and conditions.
You can sync your data to Elasticsearch in real time. Code word is not easy, reproduced please indicate the source ~
Recommended reading:
How Oracle data real-time synchronization to MySQL | close to measure dry share suggestion collection
How Oracle data real-time synchronization to SQL Server | close to measure dry share suggestion collection
How Oracle data real-time synchronization to DM DB database dry | close test suggested that collection of dream
How Oracle data real-time synchronization to directing a dry | close test share suggestion collection
How Oracle data real-time synchronization to Kafka | close to measure dry share suggestion collection
How Oracle data real-time synchronization to PgSQL | close to measure dry share suggestion collection
Clocked articles updated 33/100 days
You can like, collect, pay attention to, comment on me, there are database related questions to contact me or exchange yo ~!
