1kd @ s d Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l
m Z m Z m
Z
m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z m! Z! m" Z" m# Z# m$ Z$ m% Z% m& Z& m' Z' m( Z( m) Z) m* Z* m+ Z+ m, Z, m- Z- d d l m. Z. d d
l/ m0 Z0 d d l1 m2 Z2 d d l3 m4 Z4 e j5 d
Z6 e j5 d e j7 Z8 e j5 d Z9 e j5 d e j7 j: Z; d j< Z= d d d d g Z> d Z? d d Z@ d d ZA d d d ZB d d d ZC d d d ZD d e d d d ZE d d d! ZF d" d# ZG e j5 d$ e j7 ZH eG d% d& ZI d' e jJ d d( e d) d jJ f ZK Gd* d+ d+ eL ZM Gd, d- d- eM ZN Gd. d d e ZO e j5 d/ jP ZQ d0 d1 ZR d2 d3 ZS d4 d5 ZT d d6 d7 ZU d8 d9 ZV Gd: d; d; eL ZW Gd< d= d= e- j- ZX e jY d> d? ZZ eU e? eZ ZZ d@ dA Z[ dB dC Z\ d S)Dz#PyPI and direct package downloading N)wraps)
CHECKOUT_DIST Distribution BINARY_DISTnormalize_path SOURCE_DISTrequire Environmentfind_distributions safe_name safe_version to_filename Requirement DEVELOP_DIST) ssl_support)log)DistutilsError)urllib2httplibStringIO HTTPErrorurlparse
urlunparseunquote splituser url2pathnamename2codepointunichrurljoinurlsplit
urlunsplit ConfigParser) filterfalse) translate)strip_fragment)get_all_headersz^egg=([-A-Za-z0-9_.]+)$zhref\s*=\s*['"]?([^'"> ]+)z([^<]+)
\s+\(md5\)z([-+.a-z0-9]{2,}):z .tar.gz .tar.bz2 .tar .zip .tgz PackageIndexdistros_for_urlparse_bdist_wininstinterpret_distro_name c C s | j } d \ } } } | j d r | j d rR | d d } d } q | j d d r | d d } | d d } d } q | j d
r | d d } d } q | j d
d r | d d } | d d } d } q n | | | f S)z=Return (base,pyversion) or (None,None) for possible .exe nameNz.exez
.win32.exe
win32z .win32-py z.win-amd64.exe z win-amd64z
.win-amd64-py )NNNiiiiiiir2 i)lowerendswith
startswith)namer3 basepy_verplat r: N/var/www/pythonscrapper/code/venv/build/setuptools/setuptools/package_index.pyr( . s$ c C s t | \ } } } } } } t | j d d } | d k rk | d k rk t | j d d } n d | k r | j d d \ } } n | | f S) N/ zsourceforge.netdownload #)r r split)urlschemeserverpath
parametersqueryfragmentr7 r: r: r; egg_info_for_urlF s rK c c s t | \ } } x t | | | D] } | Vq% W| r t j | } | r x1 t | | j d | d t D] } | Vqq Wq n d S)zEYield egg or source distribution objects that might be found at a URLr=
precedenceN)rK distros_for_location EGG_FRAGMENTmatchr) groupr )rD metadatar7 rJ distrO r: r: r; r' N s "c C s | j d r" | d d } n | j d rS d | k rS t j | | | g S| j d r t | \ } } } | d k r t | | | | t | Sn xD t D]< } | j | r | d t | } t | | | Sq Wg S)z:Yield egg or source distribution objects based on basenamez.egg.zipNr/ z.egg-z.exer2 )r4 r
from_locationr( r) r
EXTENSIONSlen)locationbasenamerQ Zwin_baser8 platformextr: r: r; rM Z s
rM c C s" t t | t j j | | S)zEYield possible egg or source distribution objects based on a filename)rM r osrG rX )filenamerQ r: r: r; distros_for_filenameo s r] c c s | j d } | sd xL t | d d D]1 \ } } t | d k r, | j d r, d Sq, Wn xm t d t | d D]R } t | | d j | d | d j | | d d | d | d | Vq~ Wd S)
zGenerate alternative interpretations of a source distro name
Note: if `location` is a filesystem filename, you should call
``pkg_resources.normalize_path()`` on it before passing it to this
routine!
rS r? N zpy2.r=
py_versionrL rY )rC enumeraterV r5 ranger join) rW rX rQ r_ rL rY partsipr: r: r; r) v s #! 5 c c s t } | j } | d k rM xg t | j | D] } | | | Vq1 Wn; x8 | D]0 } | | } | | k rT | | | VqT qT Wd S)zHList unique elements, preserving order. Remember all elements ever seen.N)setaddr" __contains__)iterablekeyseenZseen_addelementkr: r: r; unique_everseen s
rn c s" t f d d } | S)zs
Wrap a function returning an iterable such that the resulting iterable
only ever yields unique items.
c s t | | S)N)rn )argskwargs)funcr: r; wrapper s z unique_values..wrapper)r )rq rr r: )rq r;
unique_values s rs z(<([^>]*\srel\s*=\s*['"]?([^'">]+)[^>]*)>c c s x t j | D] } | j \ } } t t t j | j j d } d | k sg d | k r x7 t j | D]# } t
| t | j d Vqw Wq q Wxd d D]\ } | j
| } | d k r t j | | } | rt
| t | j d Vqq q Wd S)
zEFind rel="homepage" and rel="download" links in `page`, yielding URLs,homepager> r=
| Home Page | Download URLN)rv rw rA )RELfinditergroupsrf mapstrstripr3 rC HREFr
htmldecoderP findsearch)rD pagerO tagrelrelsposr: r: r; find_external_links s '(
r z Python-urllib/%s setuptools/%s
setuptoolsc @ s: e Z d Z d Z d d Z d d Z d d Z d S) ContentCheckerzP
A null content checker that defines the interface for checking content
c C s d S)z3
Feed a block of data to the hash.
Nr: )selfblockr: r: r; feed s zContentChecker.feedc C s d S)zC
Check the hash. Return False if validation fails.
Tr: )r r: r: r; is_valid s zContentChecker.is_validc C s d S)zu
Call reporter with information about the checker (hash name)
substituted into the template.
Nr: )r reportertemplater: r: r; report s zContentChecker.reportN)__name__
__module__ __qualname____doc__r r r r: r: r: r; r s r c @ sa e Z d Z e j d Z d d Z e d d Z d d Z d d Z
d
d Z d S)
HashCheckerzK(?Psha1|sha224|sha384|sha256|sha512|md5)=(?P[a-f0-9]+)c C s( | | _ t j | | _ | | _ d S)N) hash_namehashlibnewhashexpected)r r r r: r: r; __init__ s zHashChecker.__init__c C sL t | d } | s t S| j j | } | s< t S| | j S)z5Construct a (possibly null) ContentChecker from a URLr= rA )r r patternr groupdict)clsrD rJ rO r: r: r; from_url s zHashChecker.from_urlc C s | j j | d S)N)r update)r r r: r: r; r s zHashChecker.feedc C s | j j | j k S)N)r hexdigestr )r r: r: r; r s zHashChecker.is_validc C s | | j } | | S)N)r )r r r msgr: r: r; r s
zHashChecker.reportN) r r r recompiler r classmethodr r r r r: r: r: r; r s r c s e Z d Z d Z d dJ d d d d Z d d d
Z d d d Z d d
d Z d d Z d d Z d d Z
d d Z d d d Z d d Z
d f d d Z d d Z d d Z d! d" Z d# d$ Z d% d& Z d d d d d' d( Z d d d) d* Z d+ d, Z d- Z d. d/ Z d0 d1 Z d d2 d3 Z d4 d5 Z d6 d7 Z d8 d9 Z d: d; Z d< d= Z e d d> d? Z! d@ dA Z" dB dC Z# dD dE Z$ dF dG Z% dH dI Z& S)Kr& z;A distribution index that scans web pages for download URLsz https://pypi.python.org/simple*NTc O s t j | | | | d d | j d | _ i | _ i | _ i | _ t j d j t
t | j | _
g | _ | r t j r | s t j r t j | | _ n t j | _ d S)Nr< |)r r r4 index_url scanned_urls fetched_urls
package_pagesr r rb r{ r# rO allowsto_scanr Z is_availableZfind_ca_bundleZ
opener_foropenerr urlopen)r r ZhostsZ ca_bundleZ
verify_sslro kwr: r: r; r s ! ' !zPackageIndex.__init__Fc
C sU | | j k r | r d Sd | j | k s z.PackageIndex.scan_egg_link..r? r )
r{ r| r} openr[ rG rb rV r
rW r rL rg )r rG r linesrR r: r: r; r j s "& zPackageIndex.scan_egg_linkc
s f d d } xR t j | D]A } y& | t | t | j d Wq" t k
rb Yq" Xq" W| | \ } } | rxy t | | D]h } t | \ } } | j d r | r | r | d | | f 7} q j | n j
| q Wt j d d | Sd Sd S)
z#Process the contents of a PyPI pagec s | j j r t t t | t j d j d } t | d k r d | d k r t | d } t | d } d j j
| j i | .scanr= z.pyz
#egg=%s-%sc S s d | j d d d S)Nz%sr= r r? )rP )mr: r: r; s z,PackageIndex.process_index..r N)
r~ ry r r rP
ValueErrorr rK r4 need_version_infoscan_urlPYPI_MD5sub)
r rD r r rO r r new_urlr7 fragr: )r r; r s s$ &
zPackageIndex.process_indexc C s | j d | d S)NzPPage at %s links to .py file(s) without version info; an index scan is required.)scan_all)r rD r: r: r; r s z PackageIndex.need_version_infoc G sO | j | j k r; | r+ | j | | n | j d n | j | j d S)Nz6Scanning index of all packages (this may take a while))r r r r r )r r ro r: r: r; r s
zPackageIndex.scan_allc C s | j | j | j d | j j | j sN | j | j | j d n | j j | j ss | j | n x3 t | j j | j f D] } | j | q Wd S)Nr< ) r r unsafe_namer r rj project_namenot_found_in_indexr )r requirementrD r: r: r;
find_packages s %zPackageIndex.find_packagesc sk | j | j | x8 | | j D]) } | | k r; | S| j d | | q% Wt t | j | | S)Nz%s does not match %s)prescanr rj r superr& obtain)r r installerrR ) __class__r: r; r s
zPackageIndex.obtainc C si | j | j d | | j se | j t j | t d | j j t j j
| f n d S)z-
checker is a ContentChecker
z Validating %%s checksum for %sz7%s validation failed for %s; possible download problem?N) r r r r r[ unlinkr r r6 rG rX )r checkerr\ tfpr: r: r;
check_hash s
zPackageIndex.check_hashc C sr xk | D]c } | j d k sJ t | sJ | j d sJ t t | rZ | j | q | j j | q Wd S)z;Add `urls` to the list that will be prescanned for searchesNzfile:)r r r5 r r' r append)r urlsrD r: r: r; add_find_links s
zPackageIndex.add_find_linksc C s2 | j r% t t | j | j n d | _ d S)z7Scan urls scheduled for prescanning (e.g. --find-links)N)r r r{ r )r r: r: r; r s zPackageIndex.prescanc C sN | | j r | j d } } n | j d } } | | | j | j d S)Nz#Couldn't retrieve index page for %rz3Couldn't find index page for %r (maybe misspelled?))rj r r r r )r r methr r: r: r; r s
z PackageIndex.not_found_in_indexc C s t | t s t | } | r| | j | j d | | } t | \ } } | j d rx | j | | | } n | St j j
| r | Sy t j | } Wq t k
r t
d | f Yq Xn t | j | | d d S)a Locate and/or download `spec` to `tmpdir`, returning a local path
`spec` may be a ``Requirement`` object, or a string containing a URL,
an existing local filename, or a project/version requirement spec
(i.e. the string form of a ``Requirement`` object). If it is the URL
of a .py file with an unambiguous ``#egg=name-version`` tag (i.e., one
that escapes ``-`` as ``_`` throughout), a trivial ``setup.py`` is
automatically created alongside the downloaded file.
If `spec` is a ``Requirement`` object or a string containing a
project/version requirement spec, this method returns the location of
a matching distribution (possibly after downloading it to `tmpdir`).
If `spec` is a locally existing file or directory name, it is simply
returned unchanged. If `spec` is a URL, it is downloaded to a subpath
of `tmpdir`, and the local filename is returned. Various errors may be
raised if a problem occurs during downloading.
r= z.pyz1Not a URL, existing file, or requirement spec: %rrW N)r r r
_download_urlrP rK r4 gen_setupr[ rG r parser r r fetch_distribution)r spectmpdirrE foundr7 rJ r: r: r; r> s"
zPackageIndex.downloadc sQ j d | i d } d f d d } | rf j j | | | } n | d k r | p | | | } n | d k r j d k r j n | | } n | d k r | r j | | | } n | d k r j d rd pd | n/ j d | | j d j | j | Sd S)
a| Obtain a distribution suitable for fulfilling `requirement`
`requirement` must be a ``pkg_resources.Requirement`` instance.
If necessary, or if the `force_scan` flag is set, the requirement is
searched for in the (online) package index as well as the locally
installed packages. If a distribution matching `requirement` is found,
the returned distribution's ``location`` is the value you would have
gotten from calling the ``download()`` method with the matching
distribution's URL or filename. If no matching distribution is found,
``None`` is returned.
If the `source` flag is set, only source distributions and source
checkout links will be considered. Unless the `develop_ok` flag is
set, development and system eggs (i.e., those using the ``.egg-info``
format) will be ignored.
zSearching for %sNc s | d k r } n x | | j D]q } | j t k rn rn | k r# j d | d | .findz2No local packages or download links found for %s%sza source distribution of r zBest match: %srW )r r r r r cloner> rW ) r r r
force_scanr
r Z local_indexrR r r: )r r r r
r; r s0
z PackageIndex.fetch_distributionc C s/ | j | | | | } | d k r+ | j Sd S)a3 Obtain a file suitable for fulfilling `requirement`
DEPRECATED; use the ``fetch_distribution()`` method now instead. For
backward compatibility, this routine is identical but returns the
``location`` of the downloaded distribution instead of a distribution
object.
N)r rW )r r r r r
rR r: r: r; fetch\ s zPackageIndex.fetchc
C sb t j | } | r= d d t | | j d d D p@ g } t | d k r3t j j | } t j j | | k r t j j | | } d d l
m } | | | s t j
| | | } q n t t j j | d d } | j d | d j | d j t j j | d f | j | S| rRt d | | f n t d
d S) Nc S s g | ] } | j r | q Sr: )version)r dr: r: r; r l s z*PackageIndex.gen_setup..r= r )samefilezsetup.pywzIfrom setuptools import setup
setup(name=%r, version=%r, py_modules=[%r])
zCan't unambiguously interpret project/version identifier %r; any dashes in the name or version should be escaped using underscores. %rzpCan't process plain .py files without an '#egg=name-version' suffix to enable automatic setup script generation.)rN rO r) rP rV r[ rG rX dirnamerb Z setuptools.command.easy_installr shutilcopy2r writer r splitextr r )
r r\ rJ r rO r rX dstr r r: r: r; r i s4
zPackageIndex.gen_setupi c
C s | j d | d \ } } } zIt j | } | j t | } t | t rw t d | | j | j f n | j } d } | j
} d }
d | k r t | d } t t
t | }
| j | | | | |
n t | d } xZ | j | } | rK| j | | j | | d 7} | j | | | | |
q Pq W| j | | | | SWd | r~| j n | r| j n Xd S)
NzDownloading %szCan't download %s: %s %sr r= zcontent-lengthzContent-Lengthwb)NNNrA )r r r r r$ r r r r r dl_blocksizer% maxr{ int
reporthookr r r r r r )
r rD r\ fpr r r r blocknumbssizeZsizesr r: r: r; _download_to s>
zPackageIndex._download_toc C s d S)Nr: )r rD r\ r Zblksizer r: r: r; r s zPackageIndex.reporthookc C s | j d r t | Sy t | | j SWnt t j f k
r t j d } d j d d | j
D } | r | j | | n t d | | f Yn.t
j k
r t j d } | SYnt
j k
r)t j d } | r | j | | j n t d | | j f Yn t j k
rt j d } | re| j | | j n t d | | j f YnT t j k
rt j d } | r| j | | n t d | | f Yn Xd S) Nzfile:r= c S s g | ] } t | q Sr: )r| )r argr: r: r; r s z)PackageIndex.open_url..z%s %szDownload error for %s: %sz;%s returned a bad status line. The server might be down, %s)r5
local_openopen_with_authr r r
InvalidURLsysexc_inforb ro r r r r URLErrorreason
BadStatusLineline
HTTPException)r rD warningvr r: r: r; r s@
zPackageIndex.open_urlc C sB t | \ } } | rL x7 d | k rH | j d d j d d } q Wn d } | j d rt | d d } n t j j | | } | d k s | j d r | j | | S| d
k s | j d r | j | | S| j d r | j | | S| d
k r t
t | d S| j | d | j
| | Sd S)Nz...\_Z__downloaded__z.egg.zipr/ svnzsvn+gitzgit+zhg+r r? Tr2 )rK replacer4 r[ rG rb r5
_download_svn
_download_git _download_hgr r r _attempt_download)r rE rD r r6 rJ r\ r: r: r; r s$ % zPackageIndex._download_urlc C s | j | d d S)NT)r )r rD r: r: r; r s zPackageIndex.scan_urlc C sK | j | | } d | j d d j k rC | j | | | S| Sd S)Nr z content-typer )r! r r3 _download_html)r rD r\ r r: r: r; r9 s z PackageIndex._attempt_downloadc C s t | } xW | D]O } | j r t j d | r^ | j t j | | j | | SPq q W| j t j | t d | d S)Nz ([^- ]+ - )?Revision \d+:z Unexpected HTML page found at ) r r} r r r r[ r r6 r )r rD r r\ r r, r: r: r; r:
s
zPackageIndex._download_htmlc C s` | j d d d } d } | j j d r/d | k r/t | \ } } } } } } | r/| j d r/d | d d k r/| d d j d d \ } } t | \ }
} |
r,d
|
k r |
j d
d \ } }
d | |
f } n
d |
} | } t | | | | | | f } q,q/n | j d
| | t j d | | | f | S)Nr@ r= r r zsvn:@z//r< r? :z --username=%s --password=%sz --username=z'Doing subversion checkout from %s to %szsvn checkout%s -q %s %s) rC r3 r5 r r r r r[ system)r rD r\ credsrE netlocrG re qr authhostuserpwr: r: r; r6 s" ! ,"
'zPackageIndex._download_svnc C s t | \ } } } } } | j d d d } | j d d d } d } d | k rt | j d d \ } } n t | | | | d f } | | f S)N+r= r@ r r; r rA )r rC rsplitr )rD
pop_prefixrE r? rG rI r revr: r: r; _vcs_split_rev_from_url- s z$PackageIndex._vcs_split_rev_from_urlc C s | j d d d } | j | d d \ } } | j d | | t j d | | f | d k r | j d | t j d | | f n | S)
Nr@ r= r rG Tz Doing git clone from %s to %szgit clone --quiet %s %szChecking out %sz"(cd %s && git checkout --quiet %s))rC rI r r[ r= )r rD r\ rH r: r: r; r7 ? s zPackageIndex._download_gitc C s | j d d d } | j | d d \ } } | j d | | t j d | | f | d k r | j d | t j d | | f n | S)
Nr@ r= r rG Tz Doing hg clone from %s to %szhg clone --quiet %s %szUpdating to %sz (cd %s && hg up -C -r %s >&-))rC rI r r[ r= )r rD r\ rH r: r: r; r8 O s zPackageIndex._download_hgc G s t j | | d S)N)r r )r r ro r: r: r; r _ s zPackageIndex.debugc G s t j | | d S)N)r r )r r ro r: r: r; r b s zPackageIndex.infoc G s t j | | d S)N)r r )r r ro r: r: r; r e s zPackageIndex.warn)r )'r r r r r r r r r r r r r r r r r r r r> r r
r r r! r r r r r9 r: r6 staticmethodrI r7 r8 r r r r: r: )r r; r& sL
0 * )B
* $ ( z!&(#(\d+|x[\da-fA-F]+)|[\w.:-]+);?c C s3 t | t s | S| d k r) t | St | S)N )r r r chr)cr: r: r; uchrl s
rN c C s | j d } | j d r: t | d d d } nC | j d rb t | d d } n t j | | j d } t | S)Nr= z#xr? r- r@ r )rP r5 r r r rN )rO whatr: r: r;
decode_entityr s rP c C s
t t | S)z'Decode HTML entities in the given text.)
entity_subrP )textr: r: r; r | s r c s f d d } | S)Nc s f d d } | S)Nc s? t j } t j z | | SWd t j | Xd S)N)socketgetdefaulttimeoutsetdefaulttimeout)ro rp Z old_timeout)rq timeoutr: r; _socket_timeout s
z@socket_timeout.<locals>._socket_timeout.<locals>._socket_timeoutr: )rq rW )rV )rq r; rW s z'socket_timeout.<locals>._socket_timeoutr: )rV rW r: )rV r; socket_timeout s rX c C sC t | } | j } t j | } | j } | j d d S)aq
A function compatible with Python 2.3-3.3 that will encode
auth from a URL suitable for an HTTP header.
>>> str(_encode_auth('username%3Apassword'))
'dXNlcm5hbWU6cGFzc3dvcmQ='
Long auth strings should not cause a newline to be inserted.
>>> long_auth = 'username:' + 'password'*10
>>> chr(10) in str(_encode_auth(long_auth))
False
r )r encodebase64 encodestringr r5 )rA Zauth_sZ
auth_bytesZ
encoded_bytesencodedr: r: r; _encode_auth s
r^ c @ s: e Z d Z d Z d d Z d d Z d d Z d S)
Credentialz:
A username/password pair. Use like a namedtuple.
c C s | | _ | | _ d S)N)usernamepassword)r r` ra r: r: r; r s zCredential.__init__c c s | j V| j Vd S)N)r` ra )r r: r: r; __iter__ s zCredential.__iter__c C s d t | S)Nz%(username)s:%(password)s)vars)r r: r: r; __str__ s zCredential.__str__N)r r r r r rb rd r: r: r: r; r_ s r_ c @ sF e Z d Z d d Z e d d Z d d Z d d Z d S)
PyPIConfigc C su t j d d d g d } t j j | | t j j t j j d d } t j j | rq | j | n d S)z%
Load from ~/.pypirc
r` ra
repositoryr ~z.pypircN)
dictfromkeysr! r r[ rG rb
expanduserr r )r defaultsrcr: r: r; r s
!zPyPIConfig.__init__c s5 f d d j D } t t j | S)Nc s. g | ]$ } j | d j r | q S)rf )r r} )r section)r r: r; r s z2PyPIConfig.creds_by_repository.<locals>.<listcomp>)sectionsrh r{ _get_repo_cred)r Zsections_with_repositoriesr: )r r; creds_by_repository s z PyPIConfig.creds_by_repositoryc C sO | j | d j } | t | j | d j | j | d j f S)Nrf r` ra )r r} r_ )r rm repor: r: r; ro s zPyPIConfig._get_repo_credc C s7 x0 | j j D] \ } } | j | r | Sq Wd S)z
If the URL indicated appears to be a repository defined in this
config, return the credential for that repository.
N)rp itemsr5 )r rD rf credr: r: r; find_credential s zPyPIConfig.find_credentialN)r r r r propertyrp ro rt r: r: r: r; re s re c C s t | \ } } } } } } | j d r? t j d n | d
k r` t | \ } } n d } | s t j | }
|
r t |
} |
j | f } t j
d | q n | r d t | } t | | | | | | f } t
j | }
|
j d | n t
j | }
|
j d t | |
} | rt | j \ } } } } } } | | k r| | k rt | | | | | | f | _ qn | S) z4Open a urllib2 request, handling HTTP authenticationr< znonnumeric port: ''httphttpsNz*Authenticating as %s for %s (from .pypirc)zBasic
Authorizationz
User-Agent)zhttpzhttps)r r4 r r& r re rt r| r` r r r^ r r Request
add_header
user_agentrD )rD r rE r? rG paramsrI r rA rB rs r r requestr s2h2Zpath2Zparam2Zquery2Zfrag2r: r: r; r% s2 !'r% c C s | S)Nr: )rD r: r: r;
fix_sf_url s r c C su t | \ } } } } } } t | } t j j | rI t j | S| j d r=t j j | r=g } x t j | D] } | d k r t
t j j | | d }
|
j } |
j
Pn. t j j t j j | | r | d 7} n | j d | | f q Wd | d d j | } d \ } }
n d \ } }
} i d
d 6} t | | |
| t | S)z7Read a local path, with special support for directoriesr< z
index.htmlrz<a href=%r>%s</a>z <html><head><title>%sz %s |