Tag: Big data

The back-end

Machine learning-Kmeans algorithm principle & Spark implementation

February 1, 2024

by Donna Sixtus

No Comments

Do not understand the algorithm of the data developer is not a good algorithm engineer, still remember graduate school, the tutor talked about some data...

Read More

Artificial intelligence (ai)

I’m Flink, and I’m feeling pressure on my back!

February 1, 2024

by Hazel Sims

No Comments

Why is your Flink running slowing down? Why did you try Flink parameters and still can't solve it? Flink back pressure often occurs in production...

Read More

The back-end

Hive: Create table,create table AS, and create like

February 1, 2024

by Shayak Krishnan

No Comments

Hive HQL is based on SQL, and THERE are several ways to create tables in SQL. Hive also supports creation of these tables.

Read More

The back-end

Flink CDC series – Flink MongoDB CDC production practices in XTransfer

February 1, 2024

by Lavanya Khosla

No Comments

How to implement Flink MongoDB CDC Connector through MongoDB Change Streams feature on the basis of Flink CDC

Read More

The back-end

Sentry Developer Contribution Guide – Testing Tips

February 1, 2024

by Shayak Vasa

No Comments

As part of the CI process, we ran a variety of tests in Sentry. This section aims to document some Sentry-specific helpers and provide guidance...

Read More

Artificial intelligence (ai)

Use Pandas and SQLite to increase the reading speed of large data

February 1, 2024

by Lauren Mendoza

No Comments

Let's imagine that you have a data set that is so large that reading it into memory will cause it to overflow, but you want...

Read More

The back-end

Calculation practice of big data quantile value in ten billion level monitoring scenarios

February 1, 2024

by Nathan Mitchell-Smith

No Comments

Baidu advertising business system is built on a distributed system and is oriented to business services. Every day, PV of various interfaces is called tens...

Read More

reading

Elasticsearch searchable snapshot: Reduces storage cost significantly

February 1, 2024

by Caitlin Taylor DDS

No Comments

Before Searchablesnapshots was released, snapshots that were indexed by calling _snapshotAPI could not be accessed directly, no matter they were stored in S3, HDFS, or...

Read More

reading

Power BI tutorial: Use Flow and Power BI to trigger a data set refresh of a SharePoint list or OneDrive Excel file

February 1, 2024

by Jill Singh

No Comments

When discussing with customers how they are using Power BI to improve collaborative business processes in their organizations, we often hear that Power BI is...

Read More

reading

Maxcompute Spark Job control tool – Cupid Console

February 1, 2024

by Jeffrey Rodriguez

No Comments

The Maxcompute platform supports Spark jobs. Spark jobs can be submitted to Maxcompute in a community-compatible way by the Cupid platform based on Maxcompute. Share...

Read More

The code of life

Python: Common built-in attributes — __getAttribute__ attribute interceptors use detailed explanation

February 1, 2024

by Patricia Meyer

No Comments

Because all classes in Python inherit from the Object class by default. The Object class provides many of the original built-in properties and methods, so...

Read More

reading

More than 20 days later, the cryptography will be in effect.

February 1, 2024

by Edward Wilson

No Comments

There are still more than 20 days left before the Cryptography Law of the People's Republic of China (hereinafter referred to as the "Cryptography Law")...

Read More

reading

Common data types in Python: tuples

February 1, 2024

by Denise Smith-Lewis

No Comments

Tuple: An unmodifiable sequence, including strings, that can be created simply by using commas or parentheses to create a tuple. (2) The tuple function takes...

Read More

reading

【 update 】Power BI Desktop is available in January 2019. The Power BI API is available with the service body!

February 1, 2024

by Frankie Harris

No Comments

In the new release, Power BI authentication with service principals (also known as App-only authentication) is supported and is now available in the public preview....

Read More

The back-end

Retrieve Inner hits for Elasticsearch 7.10

February 1, 2024

by Aarush Rao

No Comments

Parent-join and nested functions allow matching documents to be returned in different ranges. In the parent/child case, the parent document is returned based on a...

Read More

reading

What new operations will Tencent Cloud Elasticsearch play?

February 1, 2024

by 王怡萱

No Comments

Introduction | tencent online meeting at the end of December 2019, two months, live above 10 million, has been widely used in epidemic prevention and...

Read More

The back-end

Billion level storage challenge! Take a look, wechat advertising, wechat pay, small programs are in use of the storage system is how to carry? !

February 1, 2024

by Julie Moran

No Comments

Level 1 billion | leads, is WeChat user orders of magnitude. Behind this huge figure is the reading and writing demand of 1 billion levels...

Read More

The code of life

Python: Installation of common Python libraries under Windows

February 1, 2024

by Hilary Reed

No Comments

The Python development environment of Annaconda has been installed before the installation of common Python libraries in Windows. Once you've installed Anaconda, it's easy to...

Read More

Artificial intelligence (ai)

Construct tag cloud map based on douban movie reviews

February 1, 2024

by Gregory Harris

No Comments

Follow the big guy to achieve the film review analysis gadget, according to douban film review, do the analysis of the film's praise, more interesting,...

Read More

reading

Anjia0532 / Elastalert – Shear-Plugin: ElastAlert wechat Enterprise alarm plugin

February 1, 2024

by Robert Wiley

No Comments

Elastalert wechat Enterprise Alarm plug-in

Read More

reading

Talk about technology development from electric vehicles and Internet of vehicles

February 1, 2024

by Akarsh Kota

No Comments

Due to a slight advantage, I had the honor to attend the 2021 China 5G+ Industrial Internet Conference last year. Say to attend, that is...

Read More

The back-end

R software is installed in RedHat8

February 1, 2024

by Lori May

No Comments

Why this article? Because RedHat's warehouse source does not include R, installing R is a problem. Quite a few articles on the web are installed...

Read More

The back-end

Flink CDC series – Implements Real-Time writing of MySQL data to Apache Doris

February 1, 2024

by Tushar Sunder

No Comments

Flink CDC and Doris Flink Connector realize real-time feed of MySQL data into Apache Doris.

Read More

The code of life

Building trusted Data products from Zero to one: Analyzing how data governance works in the process trust revolution

February 1, 2024

by Tessa McIntyre

No Comments

In order to realize the credibility of cloud service development process, it is necessary to conduct data collection, progress visualization, target traction and capability evaluation...

Read More

The back-end

Apache Flink is more than just computing, and the warehouse architecture may usher in a new revolution

February 1, 2024

by Parinaaz Sheth

No Comments

Flink Forward Asia 2021 kicked off with an online meeting on The morning of January 8. Under the general trend of real-time transformation of big...

Read More

The back-end

Autohouse is based on Apache Flink’s cross-database exploration of real-time materialized views

February 1, 2024

by 黃思穎

No Comments

Some practical experience and exploration of real-time materialized view based on Flink are discussed in autohome, and Flink Streaming SQL task is developed by using...

Read More

The back-end

Flink CDC series – Real-time extraction of Oracle data, demining and tuning practices

February 1, 2024

by Russell Bibi-Burke

No Comments

Flink CDC version 2.1 adds support for Oracle by introducing built-in Debezium components. This article shares some of the key details of real-time data capture...

Read More

The back-end

Sentry Developer Contribution Guide – Configuring PyCharm

February 1, 2024

by Jessica Bridges

No Comments

If you are developing using PyCharm, you need to configure something to run and debug. This document describes some configurations that are useful for Sentry...

Read More

The back-end

Sentry Developer Guide – Django Rest Framework(Serializers)

February 1, 2024

by 田雅萍

No Comments

Serializer is used to take complex Python models and convert them to JSON. The serializer can also be used to deserialize JSON back into the...

Read More

reading

Nacos 1.1.4 was released, the first in the industry to support the Istio MCP protocol

January 31, 2024

by Cheryl Harrison-White

No Comments

Nacos is an open source service discovery and configuration management project of Alibaba. Version 1.1.4 of this release mainly brings the docking function with Istio,...

Read More