Lc @ s d Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k
Z
d d k Z d d k Z d d k
Z
y d d k l Z Wn# e j
o d d k l Z n Xd d k l Z l Z l Z l Z l Z l Z l Z l Z l Z l Z l Z l Z d d k l Z l Z l Z l! Z! e
i" d Z# d a% d e i& d Z' d Z( d e) f d
YZ* d e* e f d YZ+ e i, d
Z- d Z. d dC d YZ/ d dD d YZ0 d Z1 d dE d YZ2 d e2 f d YZ3 d e2 f d YZ4 d e2 f d YZ5 d Z6 d e2 f d YZ7 d dF d YZ8 d! e8 f d" YZ9 d# dG d$ YZ: d% e: e2 f d& YZ; d' e: e2 f d( YZ< d) Z= d* dH d+ YZ> d, e2 e> f d- YZ? d. e2 e> f d/ YZ@ d0 e2 f d1 YZA d2 eA f d3 YZB eC e d4 o d5 eA f d6 YZD n d7 e2 f d8 YZE d9 e2 f d: YZF d; ZG d< ZH d= e2 f d> YZI d? e2 f d@ YZJ dA eJ f dB YZK d S(I s! An extensible library for opening URLs using a variety of protocols
The simplest way to use this module is to call the urlopen function,
which accepts a string containing a URL or a Request object (described
below). It opens the URL and returns the results as file-like
object; the returned object has some extra methods described below.
The OpenerDirector manages a collection of Handler objects that do
all the actual work. Each Handler implements a particular protocol or
option. The OpenerDirector is a composite object that invokes the
Handlers needed to open the requested URL. For example, the
HTTPHandler performs HTTP GET and POST requests and deals with
non-error returns. The HTTPRedirectHandler automatically deals with
HTTP 301, 302, 303 and 307 redirect errors, and the HTTPDigestAuthHandler
deals with digest authentication.
urlopen(url, data=None) -- Basic usage is the same as original
urllib. pass the url and optionally data to post to an HTTP URL, and
get a file-like object back. One difference is that you can also pass
a Request instance instead of URL. Raises a URLError (subclass of
IOError); for HTTP errors, raises an HTTPError, which can also be
treated as a valid response.
build_opener -- Function that creates a new OpenerDirector instance.
Will install the default handlers. Accepts one or more Handlers as
arguments, either instances or Handler classes that it will
instantiate. If one of the argument is a subclass of the default
handler, the argument will be installed instead of the default.
install_opener -- Installs a new opener as the default opener.
objects of interest:
OpenerDirector -- Sets up the User Agent as the Python-urllib client and manages
the Handler classes, while dealing with requests and responses.
Request -- An object that encapsulates the state of a request. The
state can be as simple as the URL. It can also include extra HTTP
headers, e.g. a User-Agent.
BaseHandler --
exceptions:
URLError -- A subclass of IOError, individual protocols have their own
specific subclass.
HTTPError -- Also a valid HTTP response, so you can treat an HTTP error
as an exceptional event or valid response.
internals:
BaseHandler and parent
_call_chain conventions
Example usage:
import urllib2
# set up authentication info
authinfo = urllib2.HTTPBasicAuthHandler()
authinfo.add_password(realm='PDQ Application',
uri='https://mahler:8092/site-updates.py',
user='klem',
passwd='geheim$parole')
proxy_support = urllib2.ProxyHandler({"http" : "http://ahad-haam:3128"})
# build a new opener that adds authentication and caching FTP handlers
opener = urllib2.build_opener(proxy_support, authinfo, urllib2.CacheFTPHandler)
# install it
urllib2.install_opener(opener)
f = urllib2.urlopen('http://www.python.org/')
iN( t StringIO( t unwrapt unquotet splittypet splithostt quotet
addinfourlt splitportt splitattrt
ftpwrappert splitusert splitpasswdt
splitvalue( t localhostt url2pathnamet
getproxiest proxy_bypassi c C s- t d j o
t a n t i | | | S( N( t _openert Nonet build_openert open( t urlt datat timeout( ( s /usr/lib/python2.6/urllib2.pyt urlopenz s
c C s
| a d S( N( R ( t opener( ( s /usr/lib/python2.6/urllib2.pyt install_opener s t URLErrorc B s e Z d Z d Z RS( c C s | f | _ | | _ d S( N( t argst reason( t selfR ( ( s /usr/lib/python2.6/urllib2.pyt __init__ s c C s d | i S( Ns <urlopen error %s>( R ( R ( ( s /usr/lib/python2.6/urllib2.pyt __str__ s ( t __name__t
__module__R R ( ( ( s /usr/lib/python2.6/urllib2.pyR s t HTTPErrorc B s) e Z d Z e i Z d Z d Z RS( sB Raised when HTTP error occurs, but also acts like non-error returnc C sX | | _ | | _ | | _ | | _ | | _ | d j o | i | | | | n d S( N( t codet msgt hdrst fpt filenameR t _HTTPError__super_init( R R R$ R% R& R' ( ( s /usr/lib/python2.6/urllib2.pyR s
c C s d | i | i f S( Ns HTTP Error %s: %s( R$ R% ( R ( ( s /usr/lib/python2.6/urllib2.pyR s ( R! R" t __doc__R R R) R ( ( ( s /usr/lib/python2.6/urllib2.pyR# s
s :\d+$c C sa | i } t i | d } | d j o | i d d } n t i d | d } | i S( s Return request-host, as defined by RFC 2965.
Variation from RFC: returned value is lowercased, for convenient
comparison.
i t t Host( t get_full_urlt urlparset
get_headert _cut_port_ret subt lower( t requestR t host( ( s /usr/lib/python2.6/urllib2.pyt request_host s
t Requestc B s e Z d h d e d Z d Z d Z d Z d Z d Z d Z
d Z d Z d Z
d
Z d Z d Z d
Z d Z d Z d Z d d Z d Z RS( c C s t | | _ d | _ d | _ d | _ d | _ | | _ h | _ x* | i D] \ } } | i
| | qR Wh | _ | d j o t | } n | | _
| | _ d S( N( R t _Request__originalR t typeR4 t portt _tunnel_hostR t headerst itemst
add_headert unredirected_hdrsR5 t origin_req_hostt unverifiable( R R R R; R? R@ t keyt value( ( s /usr/lib/python2.6/urllib2.pyR s
c C sb | d d j oD | d } t t d | o" t | d | t | | Sn t | d S( Ni t _Request__r_t get_( t hasattrR6 t getattrt AttributeError( R t attrt name( ( s /usr/lib/python2.6/urllib2.pyt __getattr__ s
c C s | i o d Sd Sd S( Nt POSTt GET( t has_data( R ( ( s /usr/lib/python2.6/urllib2.pyt
get_method s
c C s
| | _ d S( N( R ( R R ( ( s /usr/lib/python2.6/urllib2.pyt add_data s c C s
| i d j S( N( R R ( R ( ( s /usr/lib/python2.6/urllib2.pyRM s c C s | i S( N( R ( R ( ( s /usr/lib/python2.6/urllib2.pyt get_data s c C s | i S( N( R7 ( R ( ( s /usr/lib/python2.6/urllib2.pyR- s c C sZ | i d j oC t | i \ | _ | _ | i d j o t d | i qS n | i S( Ns unknown url type: %s( R8 R R R7 t _Request__r_typet
ValueError( R ( ( s /usr/lib/python2.6/urllib2.pyt get_type s
c C sV | i d j o? t | i \ | _ | _ | i o t | i | _ qO n | i S( N( R4 R R RQ t _Request__r_hostR ( R ( ( s /usr/lib/python2.6/urllib2.pyt get_host s
c C s | i S( N( RT ( R ( ( s /usr/lib/python2.6/urllib2.pyt get_selector s c C sM | i d j o | i o | i | _ n | | _ | i | _ | | _ d S( Nt https( R8 R: R4 R7 RT ( R R4 R8 ( ( s /usr/lib/python2.6/urllib2.pyt set_proxy s
c C s | i | i j S( N( RT R7 ( R ( ( s /usr/lib/python2.6/urllib2.pyt has_proxy
s c C s | i S( N( R? ( R ( ( s /usr/lib/python2.6/urllib2.pyt get_origin_req_host
s c C s | i S( N( R@ ( R ( ( s /usr/lib/python2.6/urllib2.pyt is_unverifiable s c C s | | i | i <d S( N( R; t
capitalize( R RA t val( ( s /usr/lib/python2.6/urllib2.pyR= s c C s | | i | i <d S( N( R> R\ ( R RA R] ( ( s /usr/lib/python2.6/urllib2.pyt add_unredirected_header s c C s | | i j p
| | i j S( N( R; R> ( R t header_name( ( s /usr/lib/python2.6/urllib2.pyt
has_header s c C s" | i i | | i i | | S( N( R; t getR> ( R R_ t default( ( s /usr/lib/python2.6/urllib2.pyR/ s c C s) | i i } | i | i | i S( N( R> t copyt updateR; R< ( R R& ( ( s /usr/lib/python2.6/urllib2.pyt header_items$ s N( R! R" R t FalseR RJ RN RO RM RP R- RS RU RV RX RY RZ R[ R= R^ R` R/ Re ( ( ( s /usr/lib/python2.6/urllib2.pyR6 s( t OpenerDirectorc B sS e Z d Z d Z d Z d Z d e i d Z d d Z
d Z RS( c C sM d t } d | f g | _ g | _ h | _ h | _ h | _ h | _ d S( Ns Python-urllib/%ss
User-agent( t __version__t
addheaderst handlerst handle_opent handle_errort process_responset process_request( R t client_version( ( s /usr/lib/python2.6/urllib2.pyR * s
c
C s t | d p t d t | n t } xst | D]e} | d j o q= n | i d } | | } | | d } | i d oq | i d | d } | | d } y t | } Wn t j
o n X| i i
| h } | | i | <nd | d j o | } | i } nD | d
j o | } | i } n$ | d j o | } | i
} n q= | i | g }
|
o t i |
| n |
i | t } q= W| o$ t i | i | | i | n d S(
Nt
add_parents% expected BaseHandler instance, got %rt redirect_requestt do_opent
proxy_opent _i t errorR t responseR3 ( s redirect_requests do_opens
proxy_open( RE t TypeErrorR8 Rf t dirt findt
startswitht intRR Rl Ra Rk Rm Rn t
setdefaultt bisectt insortt appendt TrueRj Rp ( R t handlert addedt metht it protocolt conditiont jt kindt lookupRj ( ( s /usr/lib/python2.6/urllib2.pyt add_handler4 sL
c C s d S( N( ( R ( ( s /usr/lib/python2.6/urllib2.pyt closee s c G sT | i | d } x; | D]3 } t | | } | | } | d j o | Sq Wd S( N( ( Ra RF R ( R t chainR t meth_nameR Rj R t funct result( ( s /usr/lib/python2.6/urllib2.pyt _call_chaini s
c
C s t | t o t | | } n% | } | d j o | i | n | | _ | i } | d } x8 | i i | g D]! } t | | } | | } q| W| i
| | } | d } x; | i i | g D]$ } t | | } | | | } q W| S( Nt _requestt _response( t
isinstancet
basestringR6 R RO R RS Rn Ra RF t _openRm (
R t fullurlR R t reqR R t processorR Rv ( ( s /usr/lib/python2.6/urllib2.pyR u s&
c C sw | i | i d d | } | o | S| i } | i | i | | d | } | o | S| i | i d d | S( NRb t default_openR t unknownt unknown_open( R Rk RS ( R R R R R ( ( s /usr/lib/python2.6/urllib2.pyR s
c G s | d
j o1 | i d } | d } d | } d } | } n | i } | d } d } | | | f | } | i | } | o | S| o! | d d f | } | i | Sd S( Nt httpRW i s
http_error_%si t _errori Rb t http_error_default( R s https( Rl R ( R t protoR t dictR t http_errt orig_argsR ( ( s /usr/lib/python2.6/urllib2.pyRu s
N( R! R" R R R R R t sockett _GLOBAL_DEFAULT_TIMEOUTR R Ru ( ( ( s /usr/lib/python2.6/urllib2.pyRg ) s
1 c s\ d d k f d } t } t t t t t t t t g } t
t d o | i t
n t } xr | D]j } xa | D]Y } | | o% t | | o | i | q q t | | o | i | q q Wqs Wx | D] } | i | q Wx | D] } | i | qWx5 | D]- } | | o
| } n | i | q'W| S( s+ Create an opener object from a list of handlers.
The opener will use several default handlers, including support
for HTTP, FTP and when applicable, HTTPS.
If any of the handlers passed as arguments are subclasses of the
default handlers, the default handlers will not be used.
iNc s t | i p
t | d S( Nt __bases__( R t ClassTypeRE ( t obj( t types( s /usr/lib/python2.6/urllib2.pyt isclass s t HTTPS( R Rg t ProxyHandlert UnknownHandlert HTTPHandlert HTTPDefaultErrorHandlert HTTPRedirectHandlert
FTPHandlert FileHandlert HTTPErrorProcessorRE t httplibR t HTTPSHandlert sett
issubclasst addR t removeR ( Rj R R t default_classest skipt klasst checkt h( ( R s /usr/lib/python2.6/urllib2.pyR s<
t BaseHandlerc B s) e Z d Z d Z d Z d Z RS( i c C s
| | _ d S( N( t parent( R R ( ( s /usr/lib/python2.6/urllib2.pyRp s c C s d S( N( ( R ( ( s /usr/lib/python2.6/urllib2.pyR s c C s% t | d p t S| i | i j S( Nt
handler_order( RE R R ( R t other( ( s /usr/lib/python2.6/urllib2.pyt __lt__ s ( R! R" R Rp R R ( ( ( s /usr/lib/python2.6/urllib2.pyR s R c B s# e Z d Z d Z d Z e Z RS( s Process HTTP error responses.i c C sg | i | i | i } } } d | j o
d j n p% | i i d | | | | | } n | S( Ni i, R ( R$ R% t infoR Ru ( R R3 Rv R$ R% R& ( ( s /usr/lib/python2.6/urllib2.pyt
http_response s
( R! R" R* R R t https_response( ( ( s /usr/lib/python2.6/urllib2.pyR s R c B s e Z d Z RS( c C s" t | i | | | | d S( N( R# R- ( R R R' R$ R% R& ( ( s /usr/lib/python2.6/urllib2.pyR s ( R! R" R ( ( ( s /usr/lib/python2.6/urllib2.pyR s R c B s: e Z d Z d Z d Z d Z e Z Z Z d Z RS( i i
c C s | i } | d j o
| d j p | d j oa | d j oT | i d d } t d
| i i D } t | d | d | i d
t St | i | | | | d S( s Return a Request or None in response to a redirect.
This is called by the http_error_30x methods when a
redirection response is received. If a redirection should
take place, return a new Request to allow http_error_30x to
perform the redirect. Otherwise, raise HTTPError if no-one
else should try to handle this url. Return None if you can't
but another Handler might.
i- i. i/ i3 RL t HEADRK t s %20c s s< x5 | ]. \ } } | i d j o | | f Vq q Wd S( s content-lengths content-typeN( s content-lengths content-type( R2 ( t .0t kt v( ( s /usr/lib/python2.6/urllib2.pys <genexpr>$ s R; R? R@ N( i- i. i/ i3 ( s GETR ( i- i. i/ (
RN t replaceR R; R< R6 RZ R R# R- ( R R R' R$ R% R; t newurlt mt
newheaders( ( s /usr/lib/python2.6/urllib2.pyRq s
c C s d | j o | i d d } n) d | j o | i d d } n d St i | } | i p t | } d | d <n t i | } t i | i | } | i } | i d p | i d p
| i d p$ t | | | d | | | n | i
| | | | | | } | d j o d St | d
oo | i
}
| _
|
i | d | i j p t |
| i j o) t | i | | i | | | qn h }
| _
| _
|
i | d d |
| <| i | i | i i | d | i S(
Nt locationi t urit /i s http://s https://s ftp://s) - Redirection to url '%s' is not allowedt
redirect_dicti R ( t
getheadersR. t patht listt
urlunparset urljoinR- R2 Rz R# Rq R RE R Ra t max_repeatst lent max_redirectionst inf_msgt readR R R R ( R R R' R$ R% R; R t urlpartst newurl_lowert newt visited( ( s /usr/lib/python2.6/urllib2.pyt http_error_3022 sB
so The HTTP server returned a redirect error that would lead to an infinite loop.
The last 30x error message was:
(
R! R" R R Rq R t http_error_301t http_error_303t http_error_307R ( ( ( s /usr/lib/python2.6/urllib2.pyR s " 8c C s t | \ } } | i d p d } | } n[ | i d p t d | n | i d d } | d j o
d } n | d | !} t | \ } } | d j o t | \ } } n d } } | | | | f S( s3 Return (scheme, user, password, host/port) given a URL or an authority.
If a URL is supplied, it must have an authority (host:port) component.
According to RFC 3986, having an authority component means the URL must
have two slashes after the scheme:
>>> _parse_proxy('file:/ftp.example.com/')
Traceback (most recent call last):
ValueError: proxy URL with no authority: 'file:/ftp.example.com/'
The first three items of the returned tuple may be None.
Examples of authority parsing:
>>> _parse_proxy('proxy.example.com')
(None, None, None, 'proxy.example.com')
>>> _parse_proxy('proxy.example.com:3128')
(None, None, None, 'proxy.example.com:3128')
The authority component may optionally include userinfo (assumed to be
username:password):
>>> _parse_proxy('joe:password@proxy.example.com')
(None, 'joe', 'password', 'proxy.example.com')
>>> _parse_proxy('joe:password@proxy.example.com:3128')
(None, 'joe', 'password', 'proxy.example.com:3128')
Same examples, but with URLs instead:
>>> _parse_proxy('http://proxy.example.com/')
('http', None, None, 'proxy.example.com')
>>> _parse_proxy('http://proxy.example.com:3128/')
('http', None, None, 'proxy.example.com:3128')
>>> _parse_proxy('http://joe:password@proxy.example.com/')
('http', 'joe', 'password', 'proxy.example.com')
>>> _parse_proxy('http://joe:password@proxy.example.com:3128')
('http', 'joe', 'password', 'proxy.example.com:3128')
Everything after the authority is ignored:
>>> _parse_proxy('ftp://joe:password@proxy.example.com/rubbish:3128')
('ftp', 'joe', 'password', 'proxy.example.com')
Test for no trailing '/' case:
>>> _parse_proxy('http://joe:password@proxy.example.com')
('http', 'joe', 'password', 'proxy.example.com')
R s //s proxy URL with no authority: %ri iN( R Rz R RR Ry R
R ( t proxyt schemet r_schemet authorityt endt userinfot hostportt usert password( ( s /usr/lib/python2.6/urllib2.pyt _parse_proxyq s 2
R c B s# e Z d Z d d Z d Z RS( id c C sg | d j o
t } n | | _ x= | i D]/ \ } } t | d | | | | i d q0 Wd S( Ns %s_openc S s | | | | S( ( ( t rR R8 R ( ( s /usr/lib/python2.6/urllib2.pyt <lambda> s ( R R t proxiesR< t setattrRs ( R R R8 R ( ( s /usr/lib/python2.6/urllib2.pyR s
c C s | i } t | \ } } } } | d j o
| } n | i | i o t | i o d S| oP | oI d t | t | f } t i | i }
| i
d d |
n t | } | i | | | | j p
| d j o d S| i i
| d | i Sd S( Ns %s:%ss Proxy-authorizations Basic RW R ( RS R R RU R4 R R t base64t b64encodet stripR= RX R R R ( R R R R8 t orig_typet
proxy_typeR R R t user_passt creds( ( s /usr/lib/python2.6/urllib2.pyRs s
N( R! R" R R R Rs ( ( ( s /usr/lib/python2.6/urllib2.pyR s
t HTTPPasswordMgrc B s8 e Z d Z d Z d Z e d Z d Z RS( c C s
h | _ d S( N( t passwd( R ( ( s /usr/lib/python2.6/urllib2.pyR s c C s t | t o
| g } n | | i j o h | i | <n x^ t t f D]P } t g } | D] } | | i | | q_ ~ } | | f | i | | <qK Wd S( N( R R R R Rf t tuplet
reduce_uri( R t realmR R R t default_portt _[1]t ut reduced_uri( ( s /usr/lib/python2.6/urllib2.pyt add_password s
0c C s | i i | h } xl t t f D]^ } | i | | } xC | i D]5 \ } } x& | D] } | i | | o | SqZ WqG Wq" Wd S( N( NN( R Ra R Rf R t iteritemst is_suburiR ( R R t authurit domainsR t reduced_authurit urist authinfoR ( ( s /usr/lib/python2.6/urllib2.pyt find_user_password s
c
C s t i | } | d o) | d } | d } | d p d } n d
} | } d } t | \ } } | o\ | d
j oO | d
j oB h d d 6d d 6i | } | d
j o d | | f } q n | | f S( s@ Accept authority or URI and extract only the authority and path.i i i R iP R i RW s %s:%dN( R. t urlsplitR R Ra (
R R R t partsR R R R4 R9 t dport( ( s /usr/lib/python2.6/urllib2.pyR s
!
c C so | | j o t S| d | d j o t St i | d | d f } t | t | d j o t St S( sc Check if test is below base in a URI tree
Both args must be URIs in reduced form.
i i ( R Rf t posixpatht commonprefixR ( R t baset testt common( ( s /usr/lib/python2.6/urllib2.pyR s
( R! R" R R R R R R ( ( ( s /usr/lib/python2.6/urllib2.pyR s
t HTTPPasswordMgrWithDefaultRealmc B s e Z d Z RS( c C sF t i | | | \ } } | d j o | | f St i | d | S( N( R R R ( R R R R R ( ( s /usr/lib/python2.6/urllib2.pyR ( s
( R! R" R ( ( ( s /usr/lib/python2.6/urllib2.pyR & s t AbstractBasicAuthHandlerc B sD e Z e i d e i Z d d Z d Z d Z d Z
RS( s- (?:.*,)*[ ]*([^ ]+)[ ]+realm=(["'])(.*?)\2c C s? | d j o
t } n | | _ | i i | _ d | _ d S( Ni ( R R R R t retried( R t password_mgr( ( s /usr/lib/python2.6/urllib2.pyR > s
c C s
d | _ d S( Ni ( R ( R ( ( s /usr/lib/python2.6/urllib2.pyt reset_retry_countE s c C s | i | d } | i d j o" t | i d d | d n | i d 7_ | o] t i i | } | o@ | i \ } } } | i d j o | i
| | | Sq n d S( Ni i s basic auth failedi t basic( Ra R R R# R- R t rxt searcht groupsR2 t retry_http_basic_auth( R t authreqR4 R R; t moR R R ( ( s /usr/lib/python2.6/urllib2.pyt http_error_auth_reqedH s c C s | i i | | \ } } | d j oz d | | f } d t i | i } | i i | i d | j o d S| i | i | | i
i | d | i Sd Sd S( Ns %s:%ss Basic %sR (
R R R R R R R; Ra t auth_headerR^ R R R ( R R4 R R R t pwt rawt auth( ( s /usr/lib/python2.6/urllib2.pyR \ s
N( R! R" t ret compilet IR R R R R R ( ( ( s /usr/lib/python2.6/urllib2.pyR 0 s t HTTPBasicAuthHandlerc B s e Z d Z d Z RS( t
Authorizationc C s2 | i } | i d | | | } | i | S( Ns www-authenticate( R- R R ( R R R' R$ R% R; R Rv ( ( s /usr/lib/python2.6/urllib2.pyt http_error_401m s
( R! R" R! R* ( ( ( s /usr/lib/python2.6/urllib2.pyR( i s t ProxyBasicAuthHandlerc B s e Z d Z d Z RS( s Proxy-authorizationc C s2 | i } | i d | | | } | i | S( Ns proxy-authenticate( RU R R ( R R R' R$ R% R; R Rv ( ( s /usr/lib/python2.6/urllib2.pyt http_error_407y s
( R! R" R! R, ( ( ( s /usr/lib/python2.6/urllib2.pyR+ u s c C s t i i d o* t d } | i | } | i | Sg } t | D] } | t t i d d qN ~ } d i
| Sd S( s Return n random bytes.s /dev/urandomi i R+ N( t osR t existsR R R t ranget chrt randomt randranget join( t nt ft sR R t L( ( s /usr/lib/python2.6/urllib2.pyt randombytes s
9t AbstractDigestAuthHandlerc B sS e Z d d Z d Z d Z d Z d Z d Z d Z d Z
RS( c C sQ | d j o
t } n | | _ | i i | _ d | _ d | _ d | _ d S( Ni ( R R R R R t nonce_countt
last_nonce( R R ( ( s /usr/lib/python2.6/urllib2.pyR s
c C s
d | _ d S( Ni ( R ( R ( ( s /usr/lib/python2.6/urllib2.pyR s c C s | i | d } | i d j o" t | i d d | d n | i d 7_ | o8 | i d } | i d j o | i | | Sn d S( Ni i s digest auth failedi i t digest( Ra R R R# R- t splitR2 t retry_http_digest_auth( R R! R4 R R; R R ( ( s /usr/lib/python2.6/urllib2.pyR s c C s | i d d \ } } t t | } | i | | } | oa d | } | i i | i d | j o d S| i | i | | i i
| d | i } | Sd S( NR i s Digest %sR ( R= t parse_keqv_listt parse_http_listt get_authorizationR; Ra R! R R^ R R R ( R R R$ t tokent challenget chalt auth_valt resp( ( s /usr/lib/python2.6/urllib2.pyR> s
c C s< t i d | i | t i t d f i } | d S( Ns %s:%s:%s:%si i ( t hashlibt sha1R: t timet ctimeR8 t hexdigest( R t noncet dig( ( s /usr/lib/python2.6/urllib2.pyt
get_cnonce s c
C sx yK | d } | d } | i d } | i d d } | i d d } Wn t j
o d SX| i | \ } } | d j o d S| i i | | i \ }
} |
d j o d S| i o | i | i | } n d } d |
| | f }
d | i
| i f } | d j o | | i j o | i
d
7_
n d
| _
| | _ d | i
} | i | } d | | | | | | f } | | |
| } nG | d j o) | | |
d | | | f } n t d
| d |
| | | i | f } | o | d | 7} n | o | d | 7} n | d | 7} | o | d | | f 7} n | S( NR RL t qopt algorithmt MD5t opaques %s:%s:%ss %s:%sR$ i s %08xs %s:%s:%s:%s:%ss qop '%s' is not supported.s> username="%s", realm="%s", nonce="%s", uri="%s", response="%s"s
, opaque="%s"s
, digest="%s"s , algorithm="%s"s , qop=auth, nc=%s, cnonce="%s"( Ra R t KeyErrort get_algorithm_implsR R R- RM t get_entity_digestRP RN RV R; R: RN R ( R R RD R RL RO RP RR t Ht KDR R" t entdigt A1t A2t ncvaluet cnoncet noncebitt respdigR ( ( s /usr/lib/python2.6/urllib2.pyRA sV
!
)
c sY | i } | d j o
d n | d j o
d n f d } | f S( NRQ c S s t i | i S( ( RG t md5RK ( t x( ( s /usr/lib/python2.6/urllib2.pyR s t SHAc S s t i | i S( ( RG RH RK ( R` ( ( s /usr/lib/python2.6/urllib2.pyR s c s d | | f S( s %s:%s( ( R6 t d( RV ( s /usr/lib/python2.6/urllib2.pyR s ( t upper( R RP RW ( ( RV s /usr/lib/python2.6/urllib2.pyRT s
c C s d S( N( R ( R R RD ( ( s /usr/lib/python2.6/urllib2.pyRU s N( R! R" R R R R R> RN RA RT RU ( ( ( s /usr/lib/python2.6/urllib2.pyR9 s
= t HTTPDigestAuthHandlerc B s# e Z d Z d Z d Z d Z RS( s An authentication protocol defined by RFC 2069
Digest authentication improves on basic authentication because it
does not transmit passwords in the clear.
R) i c C s? t i | i d } | i d | | | } | i | S( Ni s www-authenticate( R. R- R R ( R R R' R$ R% R; R4 t retry( ( s /usr/lib/python2.6/urllib2.pyR* ) s
( R! R" R* R! R R* ( ( ( s /usr/lib/python2.6/urllib2.pyRd s t ProxyDigestAuthHandlerc B s e Z d Z d Z d Z RS( s Proxy-Authorizationi c C s2 | i } | i d | | | } | i | S( Ns proxy-authenticate( RU R R ( R R R' R$ R% R; R4 Re ( ( s /usr/lib/python2.6/urllib2.pyR, 6 s
( R! R" R! R R, ( ( ( s /usr/lib/python2.6/urllib2.pyRf 1 s t AbstractHTTPHandlerc B s/ e Z d d Z d Z d Z d Z RS( i c C s
| | _ d S( N( t _debuglevel( R t
debuglevel( ( s /usr/lib/python2.6/urllib2.pyR ? s c C s
| | _ d S( N( Rh ( R t level( ( s /usr/lib/python2.6/urllib2.pyt set_http_debuglevelB s c
C sH | i } | p t d n | i ob | i } | i d p | i d d n | i d p | i d d t | q n | } | i o. t | i \ } } t
| \ } } n | i d p | i d | n xJ | i i D]< \ } } | i
} | i | p | i | | qqW| S( Ns
no host givens Content-types! application/x-www-form-urlencodeds Content-lengths %dR, ( RU R RM RP R` R^ R RY R RV R R Ri R\ (
R R3 R4 R t sel_hostR t selt sel_pathRI RB ( ( s /usr/lib/python2.6/urllib2.pyt do_request_E s0
c C s | i } | p t d n | | d | i } | i | i t | i } | i | i d | d <t d | i D } | i
oL h } d } | | j o | | | | <| | =n | i | i
d | n y5 | i | i
| i | i | | i } Wn$ t i j
o } t | n X| i | _ t i | d t }
t |
| i | i } | i | _ | i | _ | S( s Return an addinfourl object for the request, using http_class.
http_class must implement the HTTPConnection API from httplib.
The addinfourl return value is a file-like object. It also
has methods and attributes including:
- info(): return a mimetools.Message object for the headers
- geturl(): return the original request URL
- code: HTTP status code
s
no host givenR R t
Connectionc s s+ x$ | ] \ } } | i | f Vq Wd S( N( t title( R RI R] ( ( s /usr/lib/python2.6/urllib2.pys <genexpr>} s s Proxy-AuthorizationR; ( RU R R t set_debuglevelRh R R; Rd R> R< R: t _set_tunnelR3 RN RV R t getresponseR Ru R t recvt _fileobjectR R R% R- t statusR$ R ( R t
http_classR R4 R R; t tunnel_headerst proxy_auth_hdrR t errR' RF ( ( s /usr/lib/python2.6/urllib2.pyRr b s8
%
( R! R" R Rk Ro Rr ( ( ( s /usr/lib/python2.6/urllib2.pyRg = s R c B s e Z d Z e i Z RS( c C s | i t i | S( N( Rr R t HTTPConnection( R R ( ( s /usr/lib/python2.6/urllib2.pyt http_open s ( R! R" R} Rg Ro t http_request( ( ( s /usr/lib/python2.6/urllib2.pyR s R R c B s e Z d Z e i Z RS( c C s | i t i | S( N( Rr R t HTTPSConnection( R R ( ( s /usr/lib/python2.6/urllib2.pyt
https_open s ( R! R" R Rg Ro t
https_request( ( ( s /usr/lib/python2.6/urllib2.pyR s t HTTPCookieProcessorc B s2 e Z d d Z d Z d Z e Z e Z RS( c C s6 d d k } | d j o | i } n | | _ d S( Ni( t cookielibR t CookieJart cookiejar( R R R ( ( s /usr/lib/python2.6/urllib2.pyR s
c C s | i i | | S( N( R t add_cookie_header( R R3 ( ( s /usr/lib/python2.6/urllib2.pyR~ s c C s | i i | | | S( N( R t extract_cookies( R R3 Rv ( ( s /usr/lib/python2.6/urllib2.pyR s N( R! R" R R R~ R R R ( ( ( s /usr/lib/python2.6/urllib2.pyR s
R c B s e Z d Z RS( c C s | i } t d | d S( Ns unknown url type: %s( RS R ( R R R8 ( ( s /usr/lib/python2.6/urllib2.pyR s ( R! R" R ( ( ( s /usr/lib/python2.6/urllib2.pyR s c C sp h } xc | D][ } | i d d \ } } | d d j o" | d d j o | d d !} n | | | <q
W| S( s> Parse list of key=value strings where keys are not duplicated.t =i i t "i( R= ( t lt parsedt eltR R ( ( s /usr/lib/python2.6/urllib2.pyR? s "c C s g } d } t } } x | D] } | o | | 7} t } q n | oB | d j o
t } q n | d j o
t } n | | 7} q n | d j o | i | d } q n | d j o
t } n | | 7} q W| o | i | n g } | D] } | | i q ~ S( sp Parse lists as described by RFC 2068 Section 2.
In particular, parse comma-separated lists where the elements of
the list may include quoted-strings. A quoted-string could
contain a comma. A non-quoted string could have quotes in the
middle. Neither commas nor quotes count if they are escaped.
Only double-quotes count, not single-quotes.
R+ s \R t ,( Rf R R R ( R6 t rest partt escapeR t curR ( ( s /usr/lib/python2.6/urllib2.pyR@ s6
R c B s) e Z d Z d Z d Z d Z RS( c C sv | i } | d d j oH | d d !d j o4 | i o* | i d j o d | _ | i i | S| i | Sd S( Ni s //i R R
t ftp( RV R4 R8 R R t open_local_file( R R R ( ( s /usr/lib/python2.6/urllib2.pyt file_open s / c C s t i d j oi y7 t t i d d t i t i d t _ Wqy t i j
o t i d f t _ qy Xn t i S( NR
i ( R t namesR R R t gethostbyname_ext gethostnamet gaierrort
gethostbyname( R ( ( s /usr/lib/python2.6/urllib2.pyt get_names s $ c C si d d k } d d k } | i } | i } t | } y t i | } | i } | i i | i
d t } | i | d }
t
i t d |
p d | | f } | o t | \ } } n | p$ | oY t i | | i j o= | o d | | }
n d | }
t t | d | |
SWn! t j
o } t | n Xt d d S( Nit usegmti s6 Content-type: %s
Content-length: %d
Last-modified: %s
s
text/plains file://t rbs file not on local host( t email.utilst mimetypesRU RV R R- t statt st_sizet utilst
formatdatet st_mtimeR t
guess_typet mimetoolst MessageR R R R R R R t OSErrorR ( R R t emailR R4 R( t localfilet statst sizet modifiedt mtypeR; R9 t origurlR% ( ( s /usr/lib/python2.6/urllib2.pyR s0 $
N( R! R" R R R R R ( ( ( s /usr/lib/python2.6/urllib2.pyR s
R c B s e Z d Z d Z RS( c C s d d k } d d k } | i } | p t d n t | \ } } | d j o
| i } n
t | } t | \ } } | o t | \ } } n d } t
| } t
| p d } t
| p d } y t i | } Wn$ t i
j
o } t | n Xt | i \ } }
| i d } t t
| } | d | d } } | o | d o | d } n y9| i | | | | | | i }
| o d p d } xP |
D]H } t | \ } } | i d j o | d j o | i } qqW|
i | | \ } } d } | i | i d } | o | d | 7} n | d j o | d j o | d | 7} n t | } t i | } t | | | i SWn2 | i j
o# } t d | t i d n Xd S( Nis ftp error: no host givenR+ R i i R' t DR8 t at AR Rb s Content-type: %s
s Content-length: %d
s
ftp error: %si ( R R R R' Rb R (! t ftplibR RU R R R t FTP_PORTR{ R
R R R R Ru R RV R= t mapt connect_ftpR R R2 Rc t retrfileR R- R R R R t
all_errorst syst exc_info( R R R R R4 R9 R R R% R t attrst dirst filet fwR8 RH RB R' t retrlenR; R t sf( ( s /usr/lib/python2.6/urllib2.pyt ftp_open3 s^
!
c C s t | | | | | | } | S( N( R ( R R R R4 R9 R R R ( ( s /usr/lib/python2.6/urllib2.pyR h s ( R! R" R R ( ( ( s /usr/lib/python2.6/urllib2.pyR 2 s 5t CacheFTPHandlerc B s5 e Z d Z d Z d Z d Z d Z RS( c C s1 h | _ h | _ d | _ d | _ d | _ d S( Ni i< i ( t cacheR t soonestt delayt max_conns( R ( ( s /usr/lib/python2.6/urllib2.pyR p s
c C s
| | _ d S( N( R ( R t t( ( s /usr/lib/python2.6/urllib2.pyt
setTimeoutw s c C s
| | _ d S( N( R ( R R ( ( s /usr/lib/python2.6/urllib2.pyt setMaxConnsz s c C s | | | d i | | f } | | i j o t i | i | i | <n= t | | | | | | | i | <t i | i | i | <| i | i | S( NR ( R3 R RI R R R t check_cache( R R R R4 R9 R R RA ( ( s /usr/lib/python2.6/urllib2.pyR } s "
c C s t i } | i | j oZ xW | i i D]B \ } } | | j o) | i | i | i | =| i | =q, q, Wn t | i i | _ t | i | i j oe xF | i i D]5 \ } } | | i j o | i | =| i | =Pq q Wt | i i | _ n d S( N(
RI R R R< R R t mint valuesR R ( R R R R ( ( s /usr/lib/python2.6/urllib2.pyR s"
( R! R" R R R R R ( ( ( s /usr/lib/python2.6/urllib2.pyR m s
( ( ( ( ( ( (L R* R RG R R R- R R1 R% R R RI R. R} t cStringIOR t ImportErrort urllibR R R R R R R R R R
R R R
R R R t versionRh R R R R R t IOErrorR R# R& R0 R5 R6 Rg R R R R R R R R R R R( R+ R8 R9 Rd Rf Rg R RE R R R R? R@ R R R ( ( ( s /usr/lib/python2.6/urllib2.pyt <module>L sp R"
n 'i H-@
9 f
+4;
y~or5J ={Eeu磝Qk ᯘG{?+]ן?wM3X^歌>{7پK>on\jy R g/=fOroNVv~Y+ NGuÝHWyw[eQʨSb> >}Gmx[o[<{Ϯ_qF vM IENDB`
