—  Illustrations by Tom Haugomat —

yxdragon

Open source image processing framework Imagepy core developer.

[email protected]

GitHub ID:yxdragon

\

ImagePy

\

Open source image processing framework, plug-in design, can quickly integrate any image processing algorithm based on or support NUMPY, after simple configuration, quickly generate interactive environment, for non-computer professionals to use, can be understood as algorithm research and development personnel to use professional personnel to do the bridge.

\

To a certain extent, it can be considered as a PhotoShop with OpenCV as the core, but it is more focused on image analysis, which can be used for scientific experiment analysis of medicine, biology and materials.

\

The project borrows from ImageJ, but takes full advantage of Python to make the overall project architecture and extension development more concise and efficient.

\

ImagePy has partnered with a number of universities and research institutes and has been published in Oxford University’s Bioinformatic journal.

\

\

ImagePy Basic Tutorial

Copy the code
  1. https: //github.com/yxdragon/imagepy.git

Introduction: ImagePy is an image processing software developed in Python, supporting bmp, rgb, png and other commonly used image formats. It can handle grayscale images and multi-channel (color) images, and supports image stack (sequence) operations. It supports a variety of selection operations (point, line, surface, multi-line, multi-face, hollow polygon). It can carry out a variety of commonly used mathematical operations, commonly used filter operation, image measurements, as well as pixel statistics. It can carry on dem surface reconstruction and three-dimensional reconstruction of image sequences. And the framework is based around Python development. The image data is represented by numpy. And thus it can easily access scikit-image, opencv, itk, mayavi and other third-party mature image processing libraries.

Download and install

Works on Windows, Linux, MAC, under PYTHon2.7 and Python3.4 +

Copy the code
  1. # Now ImagePy is on Pypi
  2. pip install imagepy
  3. ` `
  4. # Or install with conda
  5. conda install imagepy
  6. ` `
  7. # Then start imagepy like this
  8. python -m imagepy

some trouble

  1. ImagePy is a ui framework based on wxpython, which can not install with pip on Linux. You need download the whl acrodding to your Linux system.
  2. On Linux and Mac, there may be permission denied promblem, for ImagePy will write some config information, So please start with sudo. If you install with pip, please add –user parameter like this: pip install -user imagepy
  3. If you install ImagePy in a Anaconda virtual environment, you may got a error when start like this: This program needs access to the screen. Please run with a Framework build of python, and only when you are logged in on the main display, if so, please start with pythonw -m imagepy.

Main Interface

The main interface consists of four parts, from top to bottom: the title bar, menu bar, toolbar, and status bar. Here are a few examples to illustrate what ImagePy can do.

First example: Mathematical operations, filter operations.

Selection Introduction: Selection refers to processing the image only in the the specific identification areas on the image. ImagePy supports single point, multi-point, single line, multi-line, rectangular, circular, arbitrary polygon and free curve selection. It can superimpose something using Shift key, hollow out something using Ctrl key. In addition, all the selection objects can carry out expansion, shrink, convex hull and other geometric operations.

Geometric Transformation: ImagePy supports geometric transformations. It can carry out rotation, Translation and Other Conventional matrix doubling. these rotations are interactive and support selection.

Second example: An example of a cell count

Look up table introduction:

Index color is also called false color. The essence of it is to map the gray color to a predefined spectrum. The index color does not increase the amount of information in the image, but does enhance the visual contrast.

Here, for a cell under a microscope, we organize the image and compute statistics.

  1. Open the original image and go on Gaussian blur to anti-noise.
  2. In order to highlight the cells, a large-scale USM mask treatment was performed.
  3. After processing the picture, it is easy to use the threshold function to carry on binarization.
  4. Label the binary image, mark unicom area.
  5. Calculate the centroid of each Unicom area
  6. Calculate the area occupied by each cell

Third example: Image matching

Use the Surf feature matching algorithm implemented in OpenCV.

  1. The two graphs are covered by points, that is, Surf feature points, where the correct match is shown in yellow.
  2. Also output a log of the opations. Identify the feature points of the two graphs, the correct number of matches, and the rotation matrix between the two graphs.
  3. When a point is clicked with the mouse, the dot will be red with the corresponding match point of the other picture at the same time.

Fourth example: Dem Reconstruction

Use the mayavi library, to perform a large number of three-dimensional reconstructions and three-dimensional visualization functions.

Dem is the digital elevation model, which means that the brightness of the image represents the elevation. Through the Dem data, you can calculate the height, slope. You can draw contours, and perform surface reconstruction.

Fifth example: CT data 3D reconstruction

The following image represents dental MicroCT data. The data were filtered, segmented and three-dimensional reconstructed, as well as visually manipulated.

The figure above is a tooth CT data. Importing the image sequence, you can view the three views, and then go on its three-dimensional reconstruction.

Image Stack: ImagePy supports image stack processing, it has the following two characteristics:

  1. Images in the image stack have the same format and the same size.
  2. They will act on each image in the stack when processed.

Plugins and Macros:

In ImagePy itself, each functional component is plug-in (all menus, tools). The implementation of each function, in essence, is through interaction to get a group of parameters and then act on the current image. We can view the plug-in’s organizational structure in Plugin Tree View, find plug-ins quickly in Plugin List View, record macros in Macros Recorder, and batch process when needed to do series of related functions and improve work efficiency.

From the two views above, you can get a global view of all the plug-ins, like viewing its related information, introduction, and source code. You can quickly find the commands. You can run a related command directly by double-clicking.

Macro Recording of Cell Count Example: We open the Plugins -> Macros -> Macros Recorder plug-in, and then re-operate the cell counting process…

After each step, Macros Recorder will add a log. When all is completed, you can get the following log:

These logs, Click “Run> Run Macros (F5)” to perform each action of the essentially records “plug-in name> {parameter}” Record in turn. You can also use the mouse to select a line or a few lines. Click “Run> Run line (F6)” to implement the selected line. In addition macros have the following characteristics.

  1. You can save a file where the suffix of macro is (.mc). You can run the specified macro file via Plugins -> Macros -> Run Macros.
  2. Put the macro file on the menus directory or any of its subdirectories in the project. Starting once again, the macro will be loaded as a menu item. The title is the file name. In fact, some project function are in series by the macro.

Extend a filter: The examples above only list some of the functionality of the ImagePy. However, ImagePy is not only an image processing program, but a highly scalable framework. Any numpy-based processing function can be easily incorporated. For example, To make a Gaussian blur filter, we only need:

Copy the code
  1. # -*- coding: utf-8 -*
  2. import scipy.ndimage as nimg
  3. from imagepy.core.engine import Filter
  4. ` `
  5. class Gaussian(Filter):
  6.    title = 'Gaussian'
  7.    note = ['all', 'auto_msk', 'auto_snap','preview']
  8. ` `
  9.    #parameter
  10.    para = {'sigma':2}
  11. View = [(float, (0, 30), 1, 'sigma', 'sigma', 'pix)]
  12. ` `
  13.    #process
  14.    def run(self, ips, snap, img, para = None):
  15.        nimg.gaussian_filter(snap, para['sigma'], output=img)

Create a Filter:

  1. Import related class library. It can be third-party or implemented in C.
  2. Create a class that subclasses Filter.
  3. title, this line is the name of the plug-in and will also serve as the title of the menu.
  4. note indicates how the plug-in works and the associated preprocessing and post-processing work. This includes which types of images can be processed, whether selections are supported or not, and so on.
  5. para is the parameter the kernel function needs.
  6. view and para are corresponding. They inform how the various parameters of the framework plug-in interact (the framework will generate your interactive interface automatically).
  7. run is the core function, if conditional, given img to the results of the process (save memory), or return out (the framework will help you give img).
  8. Place the file in any subdirectory of menus in the project, and it will be loaded as a menu item at startup.

What has the framework helped us do?

They framework enables complex tasks in a uniform way. Simply, you do not need to determine for yourself whether the image type is legitimate. You do not need to make your own image cache to support undo. You do not need to support the selection by yourself. Do not need to monitor the interface by yourself to achieve real-time preview. You do not need to write any interface code after you have defined the required parameters, the type and the range of values for each parameter. When a color image is encountered, the each channel of the image is processed sequentially. When the image stack is encountered, each frame is automatically traversed. You are free to work on either the task of image analysis, or creating new plugins for the framework.

Extend a Tool:

Another scenario is to interact on the canvas through the mouse, like the selection operations mentioned above. Here is an example of a brush:

Copy the code
  1. from imagepy.core.draw import paint
  2. from imagepy.core.engine import Tool
  3. import wx
  4. ` `
  5. class Plugin(Tool):
  6.  title = 'Pencil'
  7.  para = {'width':1}
  8. View = [(int, (0, 30), 0, 'width', 'width', 'pix)]
  9. ` `
  10.  def __init__(self):
  11.    self.sta = 0
  12.    self.paint = paint.Paint()
  13.    self.cursor = wx.CURSOR_CROSS
  14. ` `
  15.  def mouse_down(self, ips, x, y, btn, **key):
  16.    self.sta = 1
  17.    self.paint.set_curpt(x,y)
  18.    ips.snapshot()
  19. ` `
  20.  def mouse_up(self, ips, x, y, btn, **key):
  21.    self.sta = 0
  22. ` `
  23.  def mouse_move(self, ips, x, y, btn, **key):
  24.    if self.sta==0:return
  25.    self.paint.lineto(ips.img,x,y, self.para['width'])
  26.    ips.update = True
  27. ` `
  28.  def mouse_wheel(self, ips, x, y, d, **key):pass

Create Tool:

  1. Inherited from Tool in the engine.
  2. Specify the title, which will be the tool name, and the message of the status bar.
  3. Adds several methods to achieve mousedown, mouseup, mousemove, mousewheel.
  4. If the tool requires parameters (for example, pen width), use the dictionary to assign to para. Similarly, view specifies its interactive interface. When the tool is double-clicked, the dialog box will pop-up in accordance with the specified interface.
  5. Files are stored in the sub-folder of tools, with a generated 16 * 16 thumbnail icon. The icon and the tool are stored in the same name as the gif file.

About ImagePy:

The above only lists some features of ImagePy, covering the basic mathematical operations, filters, pixel statistics, a slightly complex feature extraction, 3D reconstruction and other functions. It gives a brief introduction to macros , how to write new filters, tools and integrate them like ImagePy. Stay tuned for more detail in the coming manual and development documents.

I (yxdragon) have used ImageJ for a long time and also used to use Python for scientific computing. ImageJ’s outstanding plug-in design philosophy allows it to absorb the contributions of industry professionals quickly. However, Python has an advantage over Java in image processing.

  1. Java is a system language, the relative threshold of it is relatively high.
  2. The related open source libraries under Java are not as rich as C / C++.
  3. Python has simple grammar so it is easy to learn. It is a good choice for non-computer professionals.
  4. Python has a wealth of third-party extensions, such as Scikit-image, OpenCV, Matplotlib, Mayavi, etc.
  5. Almost all scientific computing class libraries are based on Numpy! so the framework can be built up easily.
  6. Python can be extended by C/C++ with ctypes/cython.

Because of busy work, I wrote ImagePy in my spare time. All of the development work lasted about two months. Personally I think that this Efficiency is mainly due to a large number of third-party libraries of Python as well as the project’s “borrowlism”. design ideas. The project uses wxpython as the interface library, Numpy as the base data type. Because the time is short, many interactive details of the plug-in will show problems, you please give a positive feedback to me. I will do my best to safeguard the healthy growth of this project.

Python Chinese Community

Python Chinese developers worldwide

The spirit of the tribe

\

To promote the development of the Python developers of open source projects in Chinese Python Chinese community all platform will regularly report the development of Chinese Python developers to open source projects, let more developers to focus on and participate in your open source project, and we will with influence in the industry to develop more resources, to provide more support to the open source project developers, Open source project developers are welcome to register, and you are also welcome to recommend excellent open source projects, please click to read the original article to register.

Python Chinese Community is a decentralized global technical community, aiming to become the spiritual tribe of Python Chinese developers around the world. The community currently covers major media and collaboration platforms, and has established extensive contacts with well-known companies and technical communities in the industry, such as Alibaba, Tencent, Baidu, Open Source China, Geekbang, CSDN, etc. It has tens of thousands of registered members from more than 10 countries and regions, members from government agencies, scientific research institutions, financial institutions and well-known companies at home and abroad represented by the Ministry of Public Security, Tsinghua University, China International Capital Corporation, Chinese Academy of Sciences, BAT, etc., and nearly 200,000 developers follow the platform.

\

Previous open source project introduction

Zmail: A simple way to send mail \

Python open source project introduction: web log analysis tool \

\

▼**** Click below to read the original article to register or recommend