why
  • To popularize the knowledge
  • Make a finishing
  • Improve personal ability


Speak what
  • Data engineering as the core
  • Personal Learning Experience
  • Tools, methods, works
  • The public to


Content website: Zhanghonglun.cn /

Data engineering and programming languages

Data Engineering:
Collection, storage, cleaning, analysis, visualization


Programming language:
C + + and Java
Python solution
R
Web: PHP, HTML, CSS, javascript


Combined with:
  • Acquisition: python
  • Storage: Python + database
  • To clean: python
  • Analysis: python + R
  • Visualization: R+ Web


Bring Python and Sublime

Two pieces of equipment for programmers:
Editor, Sublime, www.sublimetext.com/2
Programming language, Python, www.python.org/


Sublime installation and use:
Download, install, Sublime Text 2


How to install the plug-in:
  1. Press Ctrl+ ‘to bring up console
  2. Paste the following code into the bottom command line and press Enter:import urllib2,os; pf='Package Control.sublime-package'; ipp=sublime.installed_packages_path(); os.makedirs(ipp) if not os.path.exists(ipp) else None; open(os.path.join(ipp,pf),'wb').write(urllib2.urlopen('http://sublime.wbond.net/'+pf.replace(' ','%20')).read())
  3. Restart Sublime Text 2
  4. If you see package Control in Perferences-> Package Settings, the installation is successful


Install plug-in:
  1. Press Ctrl+Shift+P to bring up the command panel
  2. Type Install to bring up the Install Package option and press Enter, then select the plug-in you want to install from the list.


What do plug-ins do: provide some functionality or support for some languages, such as jquery, latex, etc.


Use and operation:


Installation and use of Python
Mac, Linux, Windows, download, install


PIP installation:
Windows, www.tuicool.com/articles/ei…
Mac, www.xuebuyuan.com/593678.html


A better option:
Anaconda, www.continuum.io/downloads


To run Python code:
  1. Type Python on the command line and execute interactively
  2. Use interactive programming tools such as ipython Notebook
  3. Use Sublime to edit and run the code, or run it on the command line after editing

From what you can do to how you can do it, this article will help you quickly learn the basics of Python programming

Yq.aliyun.com/articles/56…

Web crawler is a technology for data collection, which can help us to automatically obtain and screen information. From the technical point of view, there are many implementations of web crawlers, such as PHP, Python (Urllib, Requests, scrapy, Selenium…). … However, the difficulty of web crawler is not the web crawler itself, but the analysis of web page and the overcoming of crawler.

What can Python do?

How to learn Python?

3. Python syntax basics

File operation and database operation

Object – Oriented programming in Python

Five, practice familiar basis: 2048 small game project implementation and actual combat

Hello World