Newlife. Redis is a Redis client component that aims to handle real-time computing of big data with high performance. Redis protocol base implementation Redis/RedisClient is located in the X component, this library for the extension of the implementation, mainly increase the list structure, hash structure, queue and other advanced functions.

Source: github.com/NewLifeX/Ne… Nuget: NewLife. Redis

features

  • ZTO is widely used in real-time computing of big data. More than 200 Redis instances have been working stably for more than one year, processing nearly 100 million package data every day, and adjusting consumption 8 billion times a day

  • Low latency, average Get/Set operation time 200~600us (including round-trip network communication)

  • Large throughput, built-in connection pool, supports a maximum of 1000 concurrent

  • High performance, supporting binary serialization

Redis experience sharing

  • In Linux, the number of instances is equal to the number of processors. The maximum memory of each instance is the local physical memory, avoiding memory overflow of a single instance

  • The massive data (1 billion +) according to the key hash (Crc16/Crc32) stored on multiple instances, read and write performance increased exponentially

  • Binary serialization is used, as opposed to Json serialization

  • Reasonably design the Value size of each pair of keys, including but not limited to batch acquisition. The principle is to control each network packet within 1.4K bytes to reduce communication times

  • On average, Get/Set operations on the Redis client take 200 to 600us seconds (including round-trip network communication) to evaluate the network environment and Redis client components

  • Merge a batch of commands using a Pipeline

  • The main performance bottlenecks of Redis are serialization, network bandwidth, and memory size, and the processor can also reach bottlenecks when abused

  • Other check optimization skills above experience, from more than 300 instances of more than 4T space more than a year of stable work experience, and in accordance with the importance of the order, can be used according to the needs of the scene!

10 billion Small Data Real-time Computing Platform directory

With Redis to do second kill and current limiting thinking

How does Redis achieve 2.2 million OPS in big data analysis

4 billion SQLite orders per day big data test (source code)

I don’t believe in myths, I only believe in sweat! I don’t believe in fate, I only believe in hands!