2. 3 v + 3

2.1) 3V in the era of big data

  • Mass Volume
  • Multiple segments
  • Real-time Velocity

2.2) Internet demand is 3 high

  • High concurrency
  • High scalability
  • A high performance

3. The current NoSql classic application

3.1) The current application is SQL and NOSQL together

3.2) How to store commodity information on Alibaba Chinese website

3.2.1 Look at the home page of Alibaba’s Chinese website and take women’s/women’s bags as an example

3.2.1.1 Architecture development history

1. Evolution

2. The fifth generation

3. Fifth Generation Architecture mission

3.2.1.2) related to us, multi-data source and multi-data type storage problems

3.2.2) Basic commodity information

  • Name, price, date of manufacture, manufacturer, etc
  • Mysql/Oracle database: mysql/ Oracle databaseNote that the Mysql used in Taobao is transformed by daniu himself

Why go to IOE?

In 2008, Wang jian joined Alibaba as group chief architect, which is now the chief technology officer. The former executive vice president of Microsoft Research Asia is positioned by Ma to help Alibaba group build a world-class technology team and be responsible for the group’s technology architecture and infrastructure technology platform. After joining Ali, Wang Jian, with his technical gene and academic style, put forward the idea called “IOE removal” (removing IBM minicomputer, Oracle database and EMC storage equipment in the process of IT construction) in Alibaba Group, and began to implant the essence of cloud computing into Ali IT gene. Wang Jian summarized the relationship between the “go IOE” movement and Ali Cloud in this way: “Go IOE” has completely changed the basis of Ali Group’S IT architecture, which is the basis of Ali’s embrace of cloud computing and output of computing services. The essence of “de-IOE” is distribution, which makes Commodity PC architecture available everywhere possible and the primary condition for cloud computing to be implemented.

3.2.3) Product description, details and evaluation information (multi-text)

  • The I/O read and write performance deteriorates
  • Document database MongDB

3.2.4) pictures of goods

  • Commodity picture display category
  • Distributed file system

① Taobao’s own TFS

② Google的GFS ③ Hadoop的HDFS

3.2.5) keywords of goods

  • Search engine, Taobao for internal use
  • ISearch

3.2.6) hot high-frequency information of the band nature of commodities

  • In-memory database
  • Tair, Redis, Memcache

3.2.5) Commodity trading, price calculation and point accumulation

  • External system, external third party payment interface
  • Alipay

3.2.6) Summarize the difficulties and solutions of large-scale Internet applications (big data, high concurrency, diverse data types)

3.2.6.1) the difficulties

  • Data type diversity
  • Data source diversity and variation refactoring
  • Data source transformation and data service platform does not require extensive reconstruction

3.2.6.2) Solutions

1 Draw a picture to introduce EAI and unified data platform service layer

2 What did Ali and Taobao do? UDSL2.1) what is it

2.2) what