Abstract:

Dynamic description of Aliyun e-MapReduce

E – graphs team

Version 1.5.0 (released)

  • Added overview page to EMR console
  • Added the emR console function for users to view cluster process status
  • Presto components support OSS by default
  • Launched region in West America and Singapore
  • Hive supports TEZ by default
  • You do not need to enter complex OSS AK parameters in job parameters. You can automatically obtain user AK information and access OSS resources (only for VPC networks).

1.6.0 version

  • Interactive query (Support Hive and Spark)
  • Emr Hive metadata uses RDS or other external databases
  • Open source software interface view entry
  • Modify configuration items and restart cluster services
  • Some optimizations of other points

information

  • Deep reading: The intention of the era of big data search intention and originated from the Internet search engine, is based on Internet of Shanghai unorganized, heterogeneous, dynamic data and information under the environment of the search engine can’t accurately understand the user’s search intention, and that such as neural network algorithm of machine learning methods, such as the realization of intelligent automatic search, Thus more accurate, subject to provide personalized service
  • Shi Liyong, chief architect of Aliyun Basic Ecology: The perspective of industry upgrade Internet era of big data, a lot of independent innovation and technology is to promote the industry upgrading of the Internet in the next decade will actually have some change, all the innovation enterprise is the mind industry, the future of artificial intelligence is more and more developed, people need innovation will be less and less, most is enjoying innovative achievements
  • Depth profiling | BI application based on large data architecture of the Internet, electricity business data analysis, more talk about use case, how to practice digital management operations. Here, we are going to share the technical architecture of data from a technical perspective, how to apply BI
  • What is the ghost of big data in agriculture?
  • Apache Hadoop 3.0.0-Alpha1 was released and updated, including error correction codes, Intra-Datanode equalizer, and MapReduce task-level local optimization
  • Interview with Zheng Kai, R&D Manager of HDFS Committer Intel: With erasure Coding as the biggest improvement since the birth of HDFS, what is the next step for HDFS in the Hadoop open source ecosystem?
  • Kafka, Spark and Flink software supporting streaming computing will become more and more popular. The field of big data is bound to move towards more real-time, more intelligent and more diversified data. Streaming software such as Kafka, Spark, and Flink will become more popular, and machine learning platforms and tools will mature.

Domestic big data related conference

| | | site meeting time cost | | | — – | — – | — – | — – | | the cloud conference] [2016 hangzhou hangzhou | | | charges in October 2016 + | free of charge