3
Re @ sD d dl Z d dlmZ d dlZd dlZd dlZd dlZd dlZy d dlZW n e k
rd d dl
ZY nX d dl Z ddl m
Z
ddlmZmZmZmZmZmZmZmZmZmZmZmZm Z m Z m Z ddl m Z m!Z!m"Z" ddl#m$Z$m%Z% ddl&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/ dd l0m1Z1m2Z2 dd
l3m4Z4m5Z5 ej6e7Z8ej9d Z:ej9d ej;Zd-ddZ?G dd deZ@G dd deAZBG dd deBZCG dd deBZDG dd deAZEG dd d eBZFG d d d eBZGG d d d eBZHG d!d" d"eBZIG d#d$ d$eBZJeJeH eFd%d&d'd(d)ZKeKjLZLej9d*ZMG d+d, d,eAZNdS ). N)BytesIO )DistlibException)urljoinurlparse
urlunparse url2pathname pathname2urlqueuequoteunescape string_types build_openerHTTPRedirectHandler text_typeRequest HTTPErrorURLError) DistributionDistributionPath make_dist)MetadataMetadataInvalidError) cached_propertyparse_credentials ensure_slashsplit_filenameget_project_dataparse_requirementparse_name_and_version ServerProxynormalize_name)
get_schemeUnsupportedVersionError)Wheel
is_compatiblez^(\w+)=([a-f0-9]+)z;\s*charset\s*=\s*(.*)\s*$z text/html|application/x(ht)?mlzhttps://pypi.org/pypic C s2 | dkr t } t| dd}z|j S |d X dS )z
Return all distribution names known by an index.
:param url: The URL of the index.
:return: A list of all known distribution names.
Ng @)timeoutclose)
DEFAULT_INDEXr
list_packages)urlclient r, /builddir/build/BUILDROOT/alt-python36-pip-20.2.4-5.el8.x86_64/opt/alt/python36/lib/python3.6/site-packages/pip/_vendor/distlib/locators.pyget_all_distribution_names) s r. c @ s$ e Zd ZdZdd Ze Z ZZdS )RedirectHandlerzE
A class to work around a bug in some Python 3.2.x releases.
c C s d }x dD ]}||kr
|| }P q
W |d kr0d S t |}|jdkrpt|j |}t|drh|j|| n|||< tj| |||||S )Nlocationuri replace_header)r0 r1 )r schemer get_full_urlhasattrr3 BaseRedirectHandlerhttp_error_302) selfreqfpcodemsgheadersnewurlkeyurlpartsr, r, r- r8 @ s
z RedirectHandler.http_error_302N)__name__
__module__ __qualname____doc__r8 http_error_301http_error_303http_error_307r, r, r, r- r/ 7 s r/ c @ s e Zd ZdZd/Zd0Zd1Zd Zed2 Zd3ddZ dd Z
dd Z dd Z dd Z
dd Zee
eZdd Zd d Zd d Zd d! Zd"d# Zd$d% Zd&d' Zd(d) Zd*d+ Zd4d-d.Zd S )5LocatorzG
A base class for locators - things that locate distributions.
.tar.gz.tar.bz2.tar.zip.tgz.tbz.egg.exe.whl.pdfNdefaultc C s, i | _ || _tt | _d| _tj | _dS )a^
Initialise an instance.
:param scheme: Because locators look for most recent versions, they
need to know the version scheme to use. This specifies
the current PEP-recommended scheme - use ``'legacy'``
if you need to support existing distributions on PyPI.
N) _cacher4 r r/ openermatcherr
Queueerrors)r9 r4 r, r, r- __init__f s
zLocator.__init__c C sX g }xN| j j sRy| j jd}|j| W n | j jk
rD wY nX | j j qW |S )z8
Return any errors which have occurred.
F)rY emptygetappendEmpty task_done)r9 resulter, r, r-
get_errorsy s zLocator.get_errorsc C s | j dS )z>
Clear any errors which may have been logged.
N)rb )r9 r, r, r- clear_errors s zLocator.clear_errorsc C s | j j d S )N)rU clear)r9 r, r, r- clear_cache s zLocator.clear_cachec C s | j S )N)_scheme)r9 r, r, r- _get_scheme s zLocator._get_schemec C s
|| _ d S )N)rf )r9 valuer, r, r- _set_scheme s zLocator._set_schemec C s t ddS )a=
For a given project, get a dictionary mapping available versions to Distribution
instances.
This should be implemented in subclasses.
If called from a locate() request, self.matcher will be set to a
matcher for the requirement to satisfy, otherwise it will be None.
z Please implement in the subclassN)NotImplementedError)r9 namer, r, r- _get_project s
zLocator._get_projectc C s t ddS )zJ
Return all the distribution names known to this locator.
z Please implement in the subclassN)rj )r9 r, r, r- get_distribution_names s z Locator.get_distribution_namesc C sL | j dkr| j|}n2|| j kr,| j | }n | j | j|}|| j |< |S )z
For a given project, get a dictionary mapping available versions to Distribution
instances.
This calls _get_project to do all the work, and just implements a caching layer on top.
N)rU rl rc )r9 rk r` r, r, r- get_project s
zLocator.get_projectc C s^ t |}tj|j}d}|jd}|j| j}|rBtt|| j}|j dkd|j
k||||fS )zu
Give an url a score which can be used to choose preferred URLs
for a given project release.
Tz.whlhttpszpypi.org) r posixpathbasenamepathendswithdownloadable_extensionsr% r$
wheel_tagsr4 netloc)r9 r* trq
compatibleis_wheelZis_downloadabler, r, r- score_url s
zLocator.score_urlc C sR |}|rN| j |}| j |}||kr(|}||kr@tjd|| ntjd|| |S )a{
Choose one of two URLs where both are candidates for distribution
archives for the same version of a distribution (for example,
.tar.gz vs. zip).
The current implementation favours https:// URLs over http://, archives
from PyPI over those from other locations, wheel compatibility (if a
wheel) and then the archive name.
zNot replacing %r with %rzReplacing %r with %r)rz loggerdebug)r9 url1url2r` s1s2r, r, r-
prefer_url s
zLocator.prefer_urlc C s
t ||S )zZ
Attempt to split a filename in project name, version and Python version.
)r )r9 filename project_namer, r, r- r s zLocator.split_filenamec C s dd }d}t |\}}}}} }
|
j jdry~t |}t
|| j stjd | nX|dkrd
}n ||j |}|r|j |j
|jt||||| d fd jd
d |jD d}W n0 tk
r: } ztjd| W Y dd}~X nX n|j| jsZtjd| ntj| }}x| jD ]}|j|rp|dt| }| j||}|stjd| nJ|\}}}| s|||r|||t||||| d fd}|r||d< P qpW |r | r |
|d| < |S )a
See if a URL is a candidate for a download URL for a project (the URL
has typically been scraped from an HTML page).
If it is, a dictionary is returned with keys "name", "version",
"filename" and "url"; otherwise, None is returned.
c S s t | t |kS )N)r! )Zname1Zname2r, r, r- same_project s z:Locator.convert_url_to_download_info..same_projectNzegg=z %s: version hint in fragment: %rr /z.whlzWheel not compatible: %sTr2 z, c S s" g | ]}d j t|dd qS ). N)joinlist).0vr, r, r-
s z8Locator.convert_url_to_download_info..)rk versionr r* zpython-versionzinvalid path for wheel: %szNot downloadable: %sz No match for project/version: %s)rk r r r* zpython-versionz %s_digest)NNr )r lower
startswithr{ r| HASHER_HASHmatchgroupsrs r$ r% ru rk r r r r pyver Exceptionwarningrt rp rq lenr )r9 r* r r r` r4 rv rr paramsqueryfragmalgodigestZorigpathwheelincludera r extrw rk r r r, r, r- convert_url_to_download_info sj
z$Locator.convert_url_to_download_infoc C sl d}d|kr8|d }x"dD ]}||kr||| f}P qW |shx*dD ]"}d| }||krB||| f}P qBW |S )z
Get a digest from a dictionary by looking at a "digests" dictionary
or keys of the form 'algo_digest'.
Returns a 2-tuple (algo, digest) if found, else None. Currently
looks only for SHA256, then MD5.
Ndigestssha256md5z %s_digest)r r )r r r, )r9 infor` r r r@ r, r, r- _get_digest1 s
zLocator._get_digestc C s |j d}|j d}||kr,|| }|j}nt||| jd}|j}| j| |_}|d }||d |< |j|d kr| j|j||_|d j|t j
| | |_ |||< dS )z
Update a result dictionary (the final result from _get_project) with a
dictionary for a specific version, which typically holds information
gleaned from a filename or URL for an archive for the distribution.
rk r )r4 r* r urlsN) popmetadatar r4 r r
source_urlr
setdefaultsetaddlocator) r9 r` r rk r distmdr r* r, r, r- _update_version_dataH s
z Locator._update_version_dataFc C s d}t |}|dkr td| t| j}|j|j | _}tjd|t|j | j
|j }t |dkr8g }|j
} x|D ]|}
|
d
krqzyJ|j|
stjd||
n,|s| |
j r|j|
ntjd|
|j W qz tk
r tjd ||
Y qzX qzW t |d
krt||jd }|r8tjd | |d } || }|r|jrN|j|_|jdi j| t |_i } |jdi }
x&|jD ] }||
kr~|
| | |< q~W | |_d| _|S )a
Find the most recent distribution which matches the given
requirement.
:param requirement: A requirement of the form 'foo (1.0)' or perhaps
'foo (>= 1.0, < 2.0, != 1.3)'
:param prereleases: If ``True``, allow pre-release versions
to be located. Otherwise, pre-release versions
are not returned.
:return: A :class:`Distribution` instance, or ``None`` if no such
distribution could be located.
NzNot a valid requirement: %rzmatcher: %s (%s)r r r z%s did not match %rz%skipping pre-release version %s of %szerror matching %s with %rr )r@ zsorted list: %s)r r r )r r r" r4 rW requirementr{ r| typerB rn rk r Z
version_classr
is_prereleaser] r r sortedr@ extrasr\ r
download_urlsr )r9 r prereleasesr` rr4 rW versionsslistZvclskr dsdr* r, r, r- locate_ sT
zLocator.locate)rJ rK rL rM rN rO )rP rQ rR )rS )rR )rT )F)rB rC rD rE source_extensionsbinary_extensionsexcluded_extensionsru rt rZ rb rc re rg ri propertyr4 rl rm rn rz r r r r r r r, r, r, r- rI V s.
JrI c s0 e Zd ZdZ fddZdd Zdd Z ZS )PyPIRPCLocatorz
This locator uses XML-RPC to locate distributions. It therefore
cannot be used with simple mirrors (that only mirror file content).
c s* t t| jf | || _t|dd| _dS )z
Initialise an instance.
:param url: The URL to use for XML-RPC.
:param kwargs: Passed to the superclass constructor.
g @)r& N)superr rZ base_urlr r+ )r9 r* kwargs) __class__r, r- rZ s zPyPIRPCLocator.__init__c C s t | jj S )zJ
Return all the distribution names known to this locator.
)r r+ r) )r9 r, r, r- rm s z%PyPIRPCLocator.get_distribution_namesc C s i i d}| j j|d}x|D ]}| j j||}| j j||}t| jd}|d |_|d |_|jd|_ |jdg |_
|jd|_ t |}|r |d } | d
|_
| j| |_| |_|||< xB|D ]:} | d
}
| j| } |d j|t j|
| |d |
< qW q W |S )
N)r r T)r4 rk r licensekeywordssummaryr r* r r )r+ Zpackage_releasesZ release_urlsZ release_datar r4 rk r r\ r r r r r r r r r r r ) r9 rk r` r r r datar r r r* r r, r, r- rl s0
zPyPIRPCLocator._get_project)rB rC rD rE rZ rm rl
__classcell__r, r, )r r- r s r c s0 e Zd ZdZ fddZdd Zdd Z ZS )PyPIJSONLocatorzw
This locator uses PyPI's JSON interface. It's very limited in functionality
and probably not worth using.
c s t t| jf | t|| _d S )N)r r rZ r r )r9 r* r )r r, r- rZ s zPyPIJSONLocator.__init__c C s t ddS )zJ
Return all the distribution names known to this locator.
z Not available from this locatorN)rj )r9 r, r, r- rm s z&PyPIJSONLocator.get_distribution_namesc C s i i d}t | jdt| }y| jj|}|j j }tj|}t | j
d}|d }|d |_ |d |_ |j
d|_|j
dg |_|j
d |_t|}| |_|d
} |||j < x`|d
D ]T}
|
d }|jj| | j|
|j|< |d
j|j t j| | j|
|d |< qW x|d
j D ]\} } | |j kr:q"t | j
d}
|j |
_ | |
_ t|
}| |_||| < x\| D ]T}
|
d }|jj| | j|
|j|< |d
j| t j| | j|
|d |< qpW q"W W n@ tk
r } z"| jj t | t j d| W Y d d }~X nX |S )N)r r z%s/json)r4 r rk r r r r r r* r ZreleaseszJSON fetch failed: %s) r r r rV openreaddecodejsonloadsr r4 rk r r\ r r r r r r r r r r r itemsr rY putr r{ exception)r9 rk r` r* respr r r r r r r infosZomdodistra r, r, r- rl sT
" z PyPIJSONLocator._get_project)rB rC rD rE rZ rm rl r r, r, )r r- r s r c @ s` e Zd ZdZejdejejB ejB Z ejdejejB Z
dd Z ejdejZ e
dd Zd S )
Pagez4
This class represents a scraped HTML page.
z
(rel\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s
]*))\s+)?
href\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s
]*))
(\s+rel\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s
]*)))?
z!]+)c C s4 || _ | | _| _| jj| j }|r0|jd| _dS )zk
Initialise an instance with the Unicode page contents and the URL they
came from.
r N)r r r* _basesearchgroup)r9 r r* r r, r, r- rZ s
z
Page.__init__z[^a-z0-9$&+,/:;=?@.#%_\\|-]c C s dd }t }x| jj| jD ]}|jd}|d pZ|d pZ|d pZ|d pZ|d pZ|d }|d
pr|d pr|d }t| j|}t|}| jj d
d |}|j
||f q W t |dd dd}|S )z
Return the URLs of all the links on a page together with information
about their "rel" attribute, for determining which ones to treat as
downloads and which ones to queue for further scraping.
c S s, t | \}}}}}}t||t||||fS )zTidy up an URL.)r r r )r* r4 rv rr r r r r, r, r- clean4 s zPage.links..cleanr2 Zrel1Zrel2Zrel3Zrel4Zrel5Zrel6r} r~ Zurl3c S s dt | jd S )Nz%%%2xr )ordr )r r, r, r- B s z Page.links..c S s | d S )Nr r, )rw r, r, r- r F s T)r@ reverse) r _hreffinditerr groupdictr r r _clean_resubr r )r9 r r` r r relr* r, r, r- links- s
z
Page.linksN)rB rC rD rE recompileISXr r rZ r r r r, r, r, r- r s r c s e Zd ZdZejdd dd dZd fdd Zd
d Zd d
Z dd Z
e j de j
Zdd Zdd Zdd Zdd Zdd Ze j dZd d Z ZS ) SimpleScrapingLocatorz
A locator which scrapes HTML pages to locate downloads for a distribution.
This runs multiple threads to do the I/O; performance is at least as good
as pip's PackageFinder, which works in an analogous fashion.
c C s t jttdj S )N)fileobj)gzipGzipFiler r r )br, r, r- r T s z SimpleScrapingLocator.c C s | S )Nr, )r r, r, r- r U s )deflater noneN
c sl t t| jf | t|| _|| _i | _t | _t j
| _ t | _ d| _
|| _tj | _tj | _d| _dS )a
Initialise an instance.
:param url: The root URL to use for scraping.
:param timeout: The timeout, in seconds, to be applied to requests.
This defaults to ``None`` (no timeout specified).
:param num_workers: The number of worker threads you want to do I/O,
This defaults to 10.
:param kwargs: Passed to the superclass.
FN)r r rZ r r r& _page_cacher _seenr
rX _to_fetch
_bad_hostsskip_externals num_workers threadingRLock_lock_gplockplatform_check)r9 r* r& r r )r r, r- rZ X s
z SimpleScrapingLocator.__init__c C sJ g | _ x>t| jD ]0}tj| jd}|jd |j | j j| qW dS )z
Threads are created only when get_project is called, and terminate
before it returns. They are there primarily to parallelise I/O (i.e.
fetching web pages).
)targetTN) _threadsranger r Thread_fetch setDaemonstartr] )r9 irw r, r, r- _prepare_threadss s
z&SimpleScrapingLocator._prepare_threadsc C s> x| j D ]}| jjd qW x| j D ] }|j q$W g | _ dS )zu
Tell all the threads to terminate (by sending a sentinel value) and
wait for them to do so.
N)r r r r )r9 rw r, r, r-
_wait_threads s
z#SimpleScrapingLocator._wait_threadsc C s i i d}| j x || _|| _t| jdt| }| jj | jj | j z&t
j d| | j j
| | j j W d | j X | `W d Q R X |S )N)r r z%s/z Queueing %s)r r` r r r r r rd r r r{ r| r r r r
)r9 rk r` r* r, r, r- rl s
z"SimpleScrapingLocator._get_projectz<\b(linux_(i\d86|x86_64|arm\w+)|win(32|_amd64)|macosx_?\d+)\bc C s | j j|S )zD
Does an URL refer to a platform-specific download?
)platform_dependentr )r9 r* r, r, r- _is_platform_dependent s z,SimpleScrapingLocator._is_platform_dependentc
C sZ | j r| j|rd}n| j|| j}tjd|| |rV| j | j| j| W dQ R X |S )a%
See if an URL is a suitable download for a project.
If it is, register information in the result dictionary (for
_get_project) about the specific version it's for.
Note that the return value isn't actually used other than as a boolean
value.
Nzprocess_download: %s -> %s) r r r r r{ r| r r r` )r9 r* r r, r, r- _process_download s
z'SimpleScrapingLocator._process_downloadc
C s t |\}}}}}}|j| j| j | j r2d}n~| jrL|j| j rLd}nd|j| js^d}nR|d
krld}nD|dkrzd}n6| j|rd}n&|j ddd } | j
d
krd}nd }t j d |||| |S )z
Determine whether a link URL from a referring page and with a
particular "rel" attribute should be queued for scraping.
Fhomepagedownloadhttpro ftp:r r localhostTz#should_queue: %s (%s) from %s -> %s)r r )r ro r )
r rs r r r r r r r splitr r{ r| )
r9 linkZreferrerr r4 rv rr _r` hostr, r, r-
_should_queue s*
z#SimpleScrapingLocator._should_queuec C s x| j j }zy|r| j|}|dkr(wxv|jD ]l\}}|| jkr0yD| jj| | j| r| j|||rtj d|| | j j
| W q0 t k
r Y q0X q0W W n2 t k
r } z| j
j
t| W Y dd}~X nX W d| j j X |sP qW dS )z
Get a URL to fetch from the work queue, get the HTML page, examine its
links for download candidates and candidates for further scraping.
This is a handy method to run in a thread.
NzQueueing %s from %s)r r\ get_pager r r r
r r{ r| r r r rY r r_ )r9 r* pager r ra r, r, r- r s,
& z SimpleScrapingLocator._fetchc C sX t |\}}}}}}|dkr:tjjt|r:tt|d}|| jkr`| j| }tj d|| n|j
ddd }d}|| j krtj d|| nt |d d
id }zytj d | | j
j|| jd
} tj d| | j }
|
jdd} tj| r| j } | j }
|
jd}|r"| j| }||
}
d}tj| }|r@|jd}y|
j|}
W n tk
rn |
jd}
Y nX t |
| }|| j| < W n t k
r } z |j dkrtj d|| W Y dd}~X n t k
r } z2tj d|| | j! | j j"| W dQ R X W Y dd}~X n2 t#k
rB } ztj d|| W Y dd}~X nX W d|| j|< X |S )a
Get the HTML for an URL, possibly from an in-memory cache.
XXX TODO Note: this cache is never actually cleared. It's assumed that
the data won't get stale over the lifetime of a locator instance (not
necessarily true for the default_locator).
filez
index.htmlzReturning %s from cache: %sr r r Nz Skipping %s due to bad host %szAccept-encodingidentity)r> z Fetching %s)r& z
Fetched %sz Content-Typer2 zContent-Encodingzutf-8zlatin-1i zFetch failed: %s: %s)$r osrr isdirr r r r r{ r| r r r rV r r& r r\ HTML_CONTENT_TYPEr geturlr decodersCHARSETr r r UnicodeErrorr r r< r r r r r )r9 r* r4 rv rr r r` r r: r r> content_typeZ final_urlr encodingdecoderr ra r, r, r- r sZ
&$ z SimpleScrapingLocator.get_pagez]*>([^<]+) r )r r, r- rZ s zDistPathLocator.__init__c C sP | j j|}|d kr i i d}n,|j|d|jt|jgid|jtd gii}|S )N)r r r r )r> get_distributionr r r )r9 rk r r` r, r, r- rl s z DistPathLocator._get_project)rB rC rD rE rZ rl r r, r, )r r- r; s
r; c sR e Zd ZdZ fddZ fddZdd Zeej j
eZ dd Z d
d Z Z
S ) AggregatingLocatorzI
This class allows you to chain and/or merge a list of locators.
c s* |j dd| _|| _tt| jf | dS )a
Initialise an instance.
:param locators: The list of locators to search.
:param kwargs: Passed to the superclass constructor,
except for:
* merge - if False (the default), the first successful
search from any of the locators is returned. If True,
the results from all locators are merged (this can be
slow).
mergeFN)r rA locatorsr r@ rZ )r9 rB r )r r, r- rZ s zAggregatingLocator.__init__c s* t t| j x| jD ] }|j qW d S )N)r r@ re rB )r9 r )r r, r- re s z AggregatingLocator.clear_cachec C s || _ x| jD ]
}||_qW d S )N)rf rB r4 )r9 rh r r, r, r- ri s z AggregatingLocator._set_schemec C s i }x| j D ]}|j|}|r | jr|jdi }|jdi }|j| |jd}|r|rx6|j D ]*\}} ||kr|| | O < qb| ||< qbW |jd}
|r|
r|
j| q | jd krd} n$d} x |D ]}| jj|rd} P qW | r |}P q W |S )Nr r TF)rB rn rA r\ updater rW r ) r9 rk r` r r r3 r Zdfr r ddfoundr, r, r- rl s8
z AggregatingLocator._get_projectc C s@ t }x4| jD ]*}y||j O }W q tk
r6 Y qX qW |S )zJ
Return all the distribution names known to this locator.
)r rB rm rj )r9 r` r r, r, r- rm s
z)AggregatingLocator.get_distribution_names)rB rC rD rE rZ re ri r rI r4 fgetrl rm r r, r, )r r- r@ s ,r@ zhttps://pypi.org/simple/g @)r& legacy)r4 z1(?P[\w-]+)\s*\(\s*(==\s*)?(?P[^)]+)\)$c @ sL e Zd ZdZdddZdd Zdd Zd d
Zd d Zd
d Z dddZ
dS )DependencyFinderz0
Locate dependencies for distributions.
Nc C s |pt | _t| jj| _dS )zf
Initialise an instance, using the specified locator
to locate distributions.
N)default_locatorr r" r4 )r9 r r, r, r- rZ 1 s
zDependencyFinder.__init__c C sv t jd| |j}|| j|< || j||jf< xD|jD ]:}t|\}}t jd||| | jj |t
j ||f q4W dS )z
Add a distribution to the finder. This will update internal information
about who provides what.
:param dist: The distribution to add.
zadding distribution %szAdd to provided: %s, %s, %sN) r{ r| r@
dists_by_namedistsr providesr providedr r r )r9 r rk pr r, r, r- add_distribution9 s
z!DependencyFinder.add_distributionc C s| t jd| |j}| j|= | j||jf= xN|jD ]D}t|\}}t jd||| | j| }|j ||f |s0| j|= q0W dS )z
Remove a distribution from the finder. This will update internal
information about who provides what.
:param dist: The distribution to remove.
zremoving distribution %sz Remove from provided: %s, %s, %sN)
r{ r| r@ rJ rK r rL r rM remove)r9 r rk rN r sr, r, r- remove_distributionH s
z$DependencyFinder.remove_distributionc C sB y| j j|}W n, tk
r< |j d }| j j|}Y nX |S )z
Get a version matcher for a requirement.
:param reqt: The requirement
:type reqt: str
:return: A version matcher (an instance of
:class:`distlib.version.Matcher`).
r )r4 rW r# r )r9 reqtrW rk r, r, r- get_matcherZ s z DependencyFinder.get_matcherc C sv | j |}|j}t }| j}||krrxL|| D ]@\}}y|j|}W n tk
r\ d}Y nX |r.|j| P q.W |S )z
Find the distributions which can fulfill a requirement.
:param reqt: The requirement.
:type reqt: str
:return: A set of distribution which can fulfill the requirement.
F)rT r@ r rM r r# r ) r9 rS rW rk r` rM r providerr r, r, r- find_providersj s
z DependencyFinder.find_providersc C s | j | }t }x,|D ]$}| j|}|j|js|j| qW |r^|jd||t|f d}nD| j| | j |= x"|D ]}| j j|t j| qvW | j | d}|S )a
Attempt to replace one provider with another. This is typically used
when resolving dependencies from multiple sources, e.g. A requires
(B >= 1.0) while C requires (B >= 1.1).
For successful replacement, ``provider`` must meet all the requirements
which ``other`` fulfills.
:param provider: The provider we are trying to replace with.
:param other: The provider we're trying to replace.
:param problems: If False is returned, this will contain what
problems prevented replacement. This is currently
a tuple of the literal string 'cantreplace',
``provider``, ``other`` and the set of requirements
that ``provider`` couldn't fulfill.
:return: True if we can replace ``other`` with ``provider``, else
False.
Z cantreplaceFT)
reqtsr rT r r r frozensetrR r rO ) r9 rU otherproblemsZrlist unmatchedrQ rW r` r, r, r- try_to_replace s"
z DependencyFinder.try_to_replaceFc C s i | _ i | _i | _i | _t|p g }d|krH|jd |tdddgO }t|trh| }}tj d| n4| j
j ||d }}|dkrt d| tj d | d
|_
t }t|g}t|g}x|r|j }|j} | | jkr| j| n"| j| }
|
|kr | j||
| |j|jB } |j} t }
|rh||krhx2dD ]*}d| }||kr:|
t|d| O }
q:W | | B |
B }x>|D ]4}| j|}|sTtj d| | j
j ||d}|dkr| r| j
j |d
d}|dkrtj d| |jd|f n^|j|j }}||f| jkr |j| |j| || krT||krT|j| tj d|j xZ|D ]R}|j} | | jkr| jj|t j| n"| j| }
|
|krZ| j||
| qZW q|W qW t| jj }x.|D ]&}||k|_ |j rtj d|j qW tj d| ||fS )a
Find a distribution and all distributions it depends on.
:param requirement: The requirement specifying the distribution to
find, or a Distribution instance.
:param meta_extras: A list of meta extras such as :test:, :build: and
so on.
:param prereleases: If ``True``, allow pre-release versions to be
returned - otherwise, don't return prereleases
unless they're all that's available.
Return a set of :class:`Distribution` instances and a set of
problems.
The distributions returned should be such that they have the
:attr:`required` attribute set to ``True`` if they were
from the ``requirement`` passed to ``find()``, and they have the
:attr:`build_time_dependency` attribute set to ``True`` unless they
are post-installation dependencies of the ``requirement``.
The problems should be a tuple consisting of the string
``'unsatisfied'`` and the requirement which couldn't be satisfied
by any distribution known to the locator.
z:*:z:test:z:build:z:dev:zpassed %s as requirement)r NzUnable to locate %rz
located %sTtestbuilddevz:%s:z %s_requireszNo providers found for %rzCannot satisfy %rZ unsatisfiedzAdding %s to install_distsz#%s is a build-time dependency only.zfind done for %s)r] r^ r_ ) rM rK rJ rW r rP r< r r{ r| r r r requestedr r@ rO r\ Z run_requiresZ
meta_requiresZbuild_requiresgetattrrV r r Zname_and_versionr valuesZbuild_time_dependency)r9 r Z meta_extrasr r r rZ todoZ
install_distsrk rY ZireqtsZsreqtsZereqtsr@ ra Z all_reqtsr Z providersrU nr rN rK r, r, r- find s
zDependencyFinder.find)N)NF) rB rC rD rE rZ rO rR rT rV r\ re r, r, r, r- rH , s
(rH )N)Or ior r loggingr rp r r ImportErrordummy_threadingr( r2 r compatr r r r r r
r r r
r r r7 r r r r Zdatabaser r r r r r utilr r r r r r r r r! r r" r# r r$ r% getLoggerrB r{ r r r r" r r( r. r/ objectrI r r r r r* r5 r; r@ rI r NAME_VERSION_RErH r, r, r, r- sZ D,
G0E: zA& [