python requests library
Python hosting: Host, run, and code Python in the cloud!
If you want to request data from webservers, the traditional way to do that in Python is using the urllib library. While this library is effective, you could easily create more complexity than needed when building something. Is there another way?
Requests is an Apache2 Licensed HTTP library, written in Python. It’s powered by httplib and urllib3, but it does all the hard work for you.
To install type:
git clone https://github.com/kennethreitz/requests.git |
The Requests library is now installed. We will list some examples below:
Related course:
If you prefer a course or certification:
Grabbing raw html using HTTP/HTTPS requests
We can now query a website as :
import requests |
Save it and run with:
python website.py
It will output the raw HTML code.
Download binary image using Python
from PIL import Image |
An image retrieved using python
Website status code (is the website online?)
import requests |
This returns 200 (OK). A list of status codes can be found here: https://en.wikipedia.org/wiki/List_of_HTTP_status_codes
Retrieve JSON from a webserver
You can easily grab a JSON object from a webserver.
import requests |
HTTP Post requests using Python
from StringIO import StringIO |
SSL verification, verify certificates using Python
from StringIO import StringIO |
Extract data from the HTTP response header
With every request you send to a HTTP server, the server will send you some additional data. You can get extract data from an HTTP response using:
#!/usr/bin/env python |
This will return the data in JSON format. We can parse the data encoded in JSON format to a Python dict.
#!/usr/bin/env python |
Extract data from HTML response
Once you get the data from a server, you can parse it using python string functions or use a library. BeautifulSoup is often used. An example code that gets the page title and links:
from bs4 import BeautifulSoup |
Leave a Reply:
We have to get Pillow Library to execute 'Download binary image using Python'
How to :
pip install Pillow
Hi,
Can you extend this section with adding actions(extracting something from response) on response from get request? I want to learn about this.
Hi, yes I will extend the section