Zhouyi Compass Deployment and Simulation (16) | More challenging in August
Writing in the front
Do some hardware work this month, just in time to record the potholes.
Related background
Zhouyi Compass is a collection of tools for the NPU. Here, you can use the AIPU NN Compiler and Simulator.
Refer to the tutorial
Just go to the tutorial in the link, it’s no fun copying and pasting.
Tutorial Supplement
- Download the environment
This step in the Docker environment is not difficult to do, installation just need a good network, and then need to pull the mirror may be scientific Internet access, this kind of thing to solve, everyone is a programmer, this is not called matter.
- Generate model files
In this step, these Python files are from a source. Do not copy them from a second-hand document website.
Pre-training model
export_inference_graph.py
freeze_graph.py
Note: The TensorFlow version of TF 1 is used for most of the results obtained in the current paper that can be deployed on embedded devices. As pointed out in the original tutorial, I used TF 1.15.3, which is relatively new in TF 1. But there are still a lot of warnings when the code is running. (It’s normal for officials to force researchers to update the version of the tool.)
It involves converting TF models from.ckpt to.pb. Export_inference_graph.py You need to install the tF_slim library, otherwise the code will not be used.
To solve the problem of freezing model design, we just need to fix the environment of TF 1 and directly pull a single file from the official warehouse instead of pulling down the entire TF kulla. This design to Git fancy play, do not do an introduction, a search on the Internet.
summary
Official conversion method from CKPT model to PB model and freezing model with pre-training parameters
reference
R329 tutorial book a | AIPU deployment and simulation tutorial