Hello everyone, I am a ruffian balance, is a serious technical ruffian. This series of riffraff to introduce you is the high performance MCU audio and video application development related knowledge.

The first chip in the I.MX RT series, I.MX RT1052, launched by NXP Semiconductor in 2017, is equipped with cortex-M7 core, main frequency up to 600MHz, and CoreMark running score up to 3020. This kind of high-performance MCU brings the possibility of embedded Media processing. Therefore, we can realize real-time board-level Video processing (soft codec) and Audio processing (noise reduction, keyword recognition, etc.) with the help of such high-performance MCU.

This series of articles will provide a step-by-step introduction to audio and video application development for high-performance MCU.

Standard part (continuing to be updated… A third)

PCM coding and Waveform audio file (.waV) format details image color mode RGB and YUV and its commonly used coding formats (RGB24, YUV420, YUV422) details fast Fourier Transform (FFT) and its Cooley — Tukey(butterfly) algorithm source brief analysis

Devices (continuing to be updated… 0/1)

Introduction to the classic audio CODEC series chips (WM89xx)

Peripherals (in constant update…)

RT four digits (0/13)

NXP I.MX RT1xxx series MCU audio peripherals (1) – Synchronous audio interface (SAI), NXP I.MX RT1xxx series MCU audio peripherals (2) – SONY Philips Digital Audio Interface protocol (S/PDIF), NXP I.MX RT1xxx series MCU audio peripherals (3) – Medium sound quality output (MQS), NXP I. MX RT1xxx series MCU audio peripherals (4) – Asynchronous sampling rate converter (ASRC), NXP I. MX RT1xxx series MCU audio peripherals (5) – Digital Microphone Interface (MICFIL)

NXP I. X RT1xxx series MCU video peripherals those things (1) – CMOS image sensor interface (CSI), NXP I. X RT1xxx series MCU video peripherals those things (2) – Enhanced LCD display interface (eLCDIF), NXP I. X RT1xxx series MCU video peripherals those things (3) – pixel processing pipeline (PXP) NXP I. MX RT1xxx series MCU video peripherals those things (4) – second generation LCD display interface (LCDIFv2) NXP I. MX RT1xxx series MCU video peripherals those things (5) – MIPI Image Acquisition Subsystem (MIPI CSI2). NXP I.MX RT1xxx series MCU VIDEO peripheral (MIPI CSI2).

The Verisilicon Vivante GC355 is a series of MCU coprocessors designed for the NXP I. MX RT1xxx series

RT three-digit number (0/8)

Intel I.MX RTxxx series MCU Audio peripherals (1) – IC built-in audio bus (I2S) – DIGITAL Microphone Sub-system (DMIC)

NXP I.MX RTxxx series VIDEO peripherals (1) – Improved I2C interface (I3C) – LCD display interface (LCDIF)

Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel Intel RTxxx series MCUS Coprocessors (3) – Cadence Tensilica Fusion F1 (200MHz) – Verisilicon Vivante GCNanoLiteV

RT Universal (0/1)

– MIPI DISPLAY Interface (MIPI DSI)

Framework (Continuously updated… 0/4)

MAD(libmad) FFmpeg ARM digital signal processing library CMSIS-DSP

Testing (in ongoing update… 0/1)

NXP I. MX RT1xxx series MCU operation performance those things (1) – 512 point FFT measurement

Actual combat (continue to update… By 2/4)

Based on NXP i. mx rt1010 MP3 music player (rt-mp3player) design based on NXP i. mx rt1060 FLAC7.1 channel player (rt-flac7p1player) design The design of AUDIO signal analyzer (RT-MIxinstrument) based on NXP I. MXRT1060