Brief introduction: The client built the data warehouse and analysis system in the Hadoop cluster of IDC or the public cloud environment, purchased the AliCloud DataBricks data insight cluster, and involved the migration of data warehouse and metadata and the revision and update of the Hive version.

The Best Practices channel provides a wealth of enterprise cloud best practices, starting with typical scenarios, and providing a range of project practices to meet your needs while lowering the barriers to enterprise cloud access!

Scene description

After customers build their own Hadoop cluster in IDC or public cloud environment to build data warehouse and analysis system, and purchase Ali Cloud Databricks data insight cluster, it involves the migration of data warehouse and metadata and the revision and update of Hive version.

Practical advantages

  • Full-managed Spark cluster is free of operation and maintenance, saving labor costs.
  • Databricks Data Insight is deeply integrated with other AliCloud products (OSS, RDS, MaxCompute, EMR) to support input and output from these products as data sources.
  • Using the commercial version of the Databricks Runtime engine provides a 3-5x performance improvement over the open source Spark.

Product list

  • Databricks Data Insights
  • Cloud server ECS
  • The file is stored in HDFS
  • Object Storage OSS
  • Proprietary network VPC

Business architecture

Direct best practices

Copyright Notice:The content of this article is contributed by Aliyun real-name registered users, and the copyright belongs to the original author. Aliyun developer community does not own the copyright and does not bear the corresponding legal liability. For specific rules, please refer to User Service Agreement of Alibaba Cloud Developer Community and Guidance on Intellectual Property Protection of Alibaba Cloud Developer Community. If you find any suspected plagiarism in the community, fill in the infringement complaint form to report, once verified, the community will immediately delete the suspected infringing content.