Introduction to the
Datashops-data Factory is an enterprise-level PaaS platform that provides enterprises with a full range of products and services, such as workflow scheduling, data development, data integration and data services, as well as a one-stop development and management interface, reducing the cost of big data development and maintenance and helping enterprises focus on data value mining and exploration.
function
Fully managed scheduling
DataShops provides a powerful scheduling function that does not care about the server resources being scheduled and provides isolation to ensure that tasks between different tenants do not interfere with each other.
-
Supports task triggering based on time and dependency
-
Support daily tens of millions of tasks, according to the DAG relationship accurately, on time
-
Supports multiple scheduling periods of minutes, hours, days, weeks, and months
Supports multiple task types
-
Offline operation
-
Hive
-
Shell
-
Python
-
Spark
-
-
Data integration
-
Hive -> MySQL
-
MySQL -> Hive
-
-
Current job
-
Flink
-
Flink SQL
-
Kafka -> HDFS
-
Kafka -> Hive
-
Visual development
DataShops provides a visual code development page that can be easily configured to perform complex data analysis tasks without any development tools
Monitoring alarm
-
The O&M center provides a visual task monitoring and management tool that displays the global status of tasks in a DAG diagram
-
It can easily configure various alarm methods such as email and telephone, and timely notify relevant personnel when the task is wrong to ensure the normal operation of business.
interface
contact
If you have any questions in use, please feel free to give me feedback. You can contact me through the following contact information
-
Email: shiwei138#163.com # replaced with @
-
Public account: Enterpit, enterpit
demo
Demo address
Account: Guest Password: 123456Copy the code