3
ReE @ s( d dl mZ d dlZd dlZd dlZd dlZddlmZ ddlm Z m
Z
ddlm Z ddl m
Z
mZmZmZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZ d
ddgZej e Z d8Z d9Z ej!d1e Z"d2d3 Z#ej$e#e"ej$e#e"d4Z%e e
d4Z&G d5d
d
eZ'G d6d de'Z(d7d Z)dS ): )absolute_importN )RecentlyUsedContainer)HTTPConnectionPoolHTTPSConnectionPool)port_by_scheme)LocationValueError
MaxRetryErrorProxySchemeUnknown InvalidProxyConfigurationWarning)six)urljoin)RequestMethods) parse_url)Retry PoolManager ProxyManagerproxy_from_urlkey_file cert_file cert_reqsca_certs ssl_version ca_cert_dir ssl_context key_password
key_schemekey_hostkey_port key_timeout key_retries
key_strict key_blockkey_source_address key_key_filekey_key_password
key_cert_file
key_cert_reqs key_ca_certskey_ssl_versionkey_ca_cert_dirkey_ssl_context key_maxsize key_headers
key__proxykey__proxy_headerskey_socket_optionskey__socks_optionskey_assert_hostnamekey_assert_fingerprintkey_server_hostnamePoolKeyc C s |j }|d j |d< |d j |d< x4d D ],}||kr.|| dk r.t|| j ||< q.W |jd}|dk r|t||d< x&t|j D ]}|j||d| < qW x | j D ]}||krd||< qW | f |S )
a
Create a pool key out of a request context dictionary.
According to RFC 3986, both the scheme and host are case-insensitive.
Therefore, this function normalizes both before constructing the pool
key for an HTTPS request. If you wish to change this behaviour, provide
alternate callables to ``key_fn_by_scheme``.
:param key_class:
The class to use when constructing the key. This should be a namedtuple
with the ``scheme`` and ``host`` keys at a minimum.
:type key_class: namedtuple
:param request_context:
A dictionary-like object that contain the context for a request.
:type request_context: dict
:return: A namedtuple that can be used as a connection pool key.
:rtype: PoolKey
schemehostheaders_proxy_headers_socks_optionsNsocket_optionskey_)r8 r9 r: )
copylower frozensetitemsgettuplelistkeyspop_fields) key_classrequest_contextcontextkey socket_optsfield rM /builddir/build/BUILDROOT/alt-python36-pip-20.2.4-5.el8.x86_64/opt/alt/python36/lib/python3.6/site-packages/pip/_vendor/urllib3/poolmanager.py_default_key_normalizerJ s
rO )httphttpsc @ sx e Zd ZdZdZd ddZdd Zdd Zd d
d Zd d
Z d ddZ
dd Z d ddZ d ddZ
dd Zd!ddZdS )"r a$
Allows for arbitrary requests while transparently keeping track of
necessary connection pools for you.
:param num_pools:
Number of connection pools to cache before discarding the least
recently used pool.
:param headers:
Headers to include with all requests, unless other headers are given
explicitly.
:param \**connection_pool_kw:
Additional parameters are used to create fresh
:class:`urllib3.connectionpool.ConnectionPool` instances.
Example::
>>> manager = PoolManager(num_pools=2)
>>> r = manager.request('GET', 'http://google.com/')
>>> r = manager.request('GET', 'http://google.com/mail')
>>> r = manager.request('GET', 'http://yahoo.com/')
>>> len(manager.pools)
2
N
c K s8 t j| | || _t|dd d| _t| _tj | _d S )Nc S s | j S )N)close)prM rM rN s z&PoolManager.__init__..) dispose_func)r __init__connection_pool_kwr poolspool_classes_by_schemekey_fn_by_schemer= )self num_poolsr8 rX rM rM rN rW s
zPoolManager.__init__c C s | S )NrM )r\ rM rM rN __enter__ s zPoolManager.__enter__c C s | j dS )NF)clear)r\ exc_typeexc_valexc_tbrM rM rN __exit__ s zPoolManager.__exit__c C sf | j | }|dkr | jj }xdD ]}|j|d q"W |dkrXxtD ]}|j|d qDW |||f|S )a
Create a new :class:`ConnectionPool` based on host, port, scheme, and
any additional pool keyword arguments.
If ``request_context`` is provided, it is provided as keyword arguments
to the pool class used. This method is used to actually create the
connection pools handed out by :meth:`connection_from_url` and
companion methods. It is intended to be overridden for customization.
Nr6 r7 portrP )r6 r7 rd )rZ rX r= rE SSL_KEYWORDS)r\ r6 r7 rd rH pool_clsrJ kwrM rM rN _new_pool s
zPoolManager._new_poolc C s | j j dS )z
Empty our store of pools and direct them all to close.
This will not affect in-flight connections, but they will not be
re-used after completion.
N)rY r_ )r\ rM rM rN r_ s zPoolManager.clearrP c C sT |s t d| j|}|p d|d< |s:tj|d j d}||d< ||d< | j|S )a
Get a :class:`ConnectionPool` based on the host, port, and scheme.
If ``port`` isn't given, it will be derived from the ``scheme`` using
``urllib3.connectionpool.port_by_scheme``. If ``pool_kwargs`` is
provided, it is merged with the instance's ``connection_pool_kw``
variable and used to create the new connection pool, if one is
needed.
zNo host specified.rP r6 P rd r7 )r _merge_pool_kwargsr rA r> connection_from_context)r\ r7 rd r6 pool_kwargsrH rM rM rN connection_from_host s
z PoolManager.connection_from_hostc C s, |d j }| j| }||}| j||dS )z
Get a :class:`ConnectionPool` based on the request context.
``request_context`` must at least contain the ``scheme`` key and its
value must be a key in ``key_fn_by_scheme`` instance variable.
r6 )rH )r> r[ connection_from_pool_key)r\ rH r6 pool_key_constructorpool_keyrM rM rN rk s
z#PoolManager.connection_from_contextc
C s` | j jN | j j|}|r |S |d }|d }|d }| j||||d}|| j |< W dQ R X |S )z
Get a :class:`ConnectionPool` based on the provided pool key.
``pool_key`` should be a namedtuple that only contains immutable
objects. At a minimum it must have the ``scheme``, ``host``, and
``port`` fields.
r6 r7 rd )rH N)rY lockrA rh )r\ rp rH poolr6 r7 rd rM rM rN rn s
z$PoolManager.connection_from_pool_keyc C s t |}| j|j|j|j|dS )a
Similar to :func:`urllib3.connectionpool.connection_from_url`.
If ``pool_kwargs`` is not provided and a new pool needs to be
constructed, ``self.connection_pool_kw`` is used to initialize
the :class:`urllib3.connectionpool.ConnectionPool`. If ``pool_kwargs``
is provided, it is used instead. Note that if a new pool does not
need to be created for the request, the provided ``pool_kwargs`` are
not used.
)rd r6 rl )r rm r7 rd r6 )r\ urlrl urM rM rN connection_from_url s z PoolManager.connection_from_urlc C sZ | j j }|rVxF|j D ]:\}}|dkrJy
||= W qR tk
rF Y qRX q|||< qW |S )a
Merge a dictionary of override values for self.connection_pool_kw.
This does not modify self.connection_pool_kw and returns a new dict.
Any keys in the override dictionary with a value of ``None`` are
removed from the merged dictionary.
N)rX r= r@ KeyError)r\ overridebase_pool_kwargsrJ valuerM rM rN rj ' s
z PoolManager._merge_pool_kwargsTc K s t |}| j|j|j|jd}d|d< d|d< d|krD| jj |d< | jdk rj|jdkrj|j||f|}n|j||j f|}|o|j
}|s|S t ||}|j dkrd }|j
d
} t| tstj| |d } | jo|j| r ttj|d }
x*|
D ]"} | j | jkr|d j| d qW y| j||||d } W n( tk
rZ | jrV|j |S X | |d
< ||d< t j d
|| |j | j||f|S )a]
Same as :meth:`urllib3.connectionpool.HTTPConnectionPool.urlopen`
with custom cross-host redirect logic and only sends the request-uri
portion of the ``url``.
The given ``url`` parameter must be absolute, such that an appropriate
:class:`urllib3.connectionpool.ConnectionPool` can be chosen for it.
)rd r6 Fassert_same_hostredirectr8 NrP i/ GETretries)r{ )response_poolzRedirecting %s -> %s) r rm r7 rd r6 r8 r= proxyurlopen request_uriget_redirect_locationr
statusrA
isinstancer from_intremove_headers_on_redirect is_same_hostrC r iterkeysr> rE incrementr raise_on_redirect
drain_connloginfo) r\ methodrs r{ rg rt connr~ redirect_locationr} r8 headerrM rM rN r ; sH
zPoolManager.urlopen)rR N)N)NrP N)N)N)T)__name__
__module__ __qualname____doc__r rW r^ rc rh r_ rm rk rn ru rj r rM rM rM rN r s
c sP e Zd ZdZd fdd Zd fdd Zdd d
Zd d Zd fdd Z Z S )r ax
Behaves just like :class:`PoolManager`, but sends all requests through
the defined proxy, using the CONNECT method for HTTPS URLs.
:param proxy_url:
The URL of the proxy to be used.
:param proxy_headers:
A dictionary containing headers that will be sent to the proxy. In case
of HTTP they are being sent with each request, while in the
HTTPS/CONNECT case they are sent only once. Could be used for proxy
authentication.
Example:
>>> proxy = urllib3.ProxyManager('http://localhost:3128/')
>>> r1 = proxy.request('GET', 'http://google.com/')
>>> r2 = proxy.request('GET', 'http://httpbin.org/')
>>> len(proxy.pools)
1
>>> r3 = proxy.request('GET', 'https://httpbin.org/')
>>> r4 = proxy.request('GET', 'https://twitter.com/')
>>> len(proxy.pools)
3
rR Nc s t |tr d|j|j|jf }t|}|jsFtj|jd}|j|d}|jdkrZt |j|| _
|pfi | _ | j
|d< | j |d< t t
| j||f| d S ) Nz
%s://%s:%iri )rd rP rQ _proxyr9 )rP rQ )r r r6 r7 rd r r rA _replacer
r
proxy_headerssuperr rW )r\ proxy_urlr] r8 r rX r rd ) __class__rM rN rW s
zProxyManager.__init__rP c sD |dkr t t| j||||dS t t| j| jj| jj| jj|dS )NrQ )rl )r r rm r r7 rd r6 )r\ r7 rd r6 rl )r rM rN rm s
z!ProxyManager.connection_from_hostc C s0 ddi}t |j}|r ||d< |r,|j| |S )z
Sets headers needed by proxies: specifically, the Accept and Host
headers. Only sets headers not provided by the user.
Acceptz*/*Host)r netlocupdate)r\ rs r8 headers_r rM rM rN _set_proxy_headers s
z ProxyManager._set_proxy_headersc C s( |dkr$| j jdkr$tjdtdd d S )NrQ a Your proxy configuration specified an HTTPS scheme for the proxy. Are you sure you want to use HTTPS to contact the proxy? This most likely indicates an error in your configuration. Read this issue for more info: https://github.com/urllib3/urllib3/issues/1850 )
stacklevel)r r6 warningswarnr )r\
url_schemerM rM rN $_validate_proxy_scheme_url_selection s
z1ProxyManager._validate_proxy_scheme_url_selectionTc sZ t |}| j|j |jdkr<|jd| j}| j|||d< tt| j||fd|i|S )z@Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.rP r8 r{ ) r r r6 rA r8 r r r r )r\ r rs r{ rg rt r8 )r rM rN r s
zProxyManager.urlopen)rR NN)NrP N)N)T)
r r r r rW rm r r r
__classcell__rM rM )r rN r } s
c K s t f d| i|S )Nr )r )rs rg rM rM rN r s )r r r r r r r r )r r r r r r! r" r# r$ r% r& r' r( r) r* r+ r, r- r. r/ r0 r1 r2 r3 r4 )*
__future__r collections functoolsloggingr _collectionsr connectionpoolr r r
exceptionsr r r
r packagesr Z packages.six.moves.urllib.parser
requestr Zutil.urlr Z
util.retryr __all__ getLoggerr r re _key_fields
namedtupler5 rO partialr[ rZ r r r rM rM rM rN sr
6
wn