3
Re
@ s d Z ddlmZ ddlZddlZejd dkZerDeefZ dd Z
neZ e Z e
Zdd Z
ejd+k rpeZd
d Znd d Zeed
rddlmZ yddlmZ W n ek
r ddlmZ Y nX dZG dd deZndZddl m Z dd Zddl m Z m Z m!Z!m"Z"m#Z# ddl$m%Z%m&Z& dZ'dZ(dZ)dZ*dZ+dZ,dZ-dZ.dZ/d Z0d Z1e2e3fd d Z4d d Z5d!d" Z6ejd,k r|d-d%d&Z7nej8Z7G d'd( d(eZ9G d)d* d*eZ:dS ).z.Fallback pure Python implementation of msgpack )datetimeN c C s | j S )N) iteritems)d r /builddir/build/BUILDROOT/alt-python36-pip-20.2.4-5.el8.x86_64/opt/alt/python36/lib/python3.6/site-packages/pip/_vendor/msgpack/fallback.pydict_iteritems s r c C s | j S )N)items)r r r r r s c C s. t | jdko,t| jd to,| jd jdS )N r z maximum recursion depth exceeded)lenargs
isinstancestr
startswith)er r r _is_recursionerror s r c C s dS )NTr )r r r r r ' s pypy_version_info) newlist_hint) BytesBuilder)
StringBuilderTc @ s& e Zd Zd ddZdd Zdd ZdS )
StringIO c C s, |r t t|| _| jj| nt | _d S )N)r r
builderappend)selfsr r r __init__7 s zStringIO.__init__c C s6 t |tr|j }nt |tr&t|}| jj| d S )N)r
memoryviewtobytes bytearraybytesr r )r r r r r write> s
zStringIO.writec C s
| j j S )N)r build)r r r r getvalueE s zStringIO.getvalueN)r )__name__
__module__ __qualname__r r# r% r r r r r 6 s
r F)BytesIOc C s g S )Nr )sizer r r M s r+ r )
BufferFull OutOfData ExtraData FormatError
StackError)ExtType Timestamp i c C s( |||kr|| |kS || |kS d S )Nr )objttypetupler r r _check_type_strictd s r8 c C s t | }|jdkrtd|S )Nr z$cannot unpack from multi-byte object)r itemsize
ValueError)r4 viewr r r _get_data_from_bufferk s
r< c K s t ddt| i|}|j| y |j }W nJ tk
rH tdY n0 tk
rv } zt|rdt W Y dd}~X nX |j rt
||j |S )aw
Unpack an object from `packed`.
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``ValueError`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
See :class:`Unpacker` for options.
Nmax_buffer_sizez Unpack failed: incomplete input)N) Unpackerr
feed_unpackr- r: RecursionErrorr r0 _got_extradatar. _get_extradata)packedkwargsunpackerretr r r r unpackbr s
rH c C s t j| t||S )z0Explicit type cast for legacy struct.unpack_from)struct unpack_fromr" )fbor r r _unpack_from s rP c @ s e Zd ZdZddddddddddd,ed-d.d/d0d1fd d
Zd d Zd
d Zdd Zdd Z dd Z
dd Z dd Z e
fddZe
fdd Zd d Zd d ZeZd!d" Zd#d$ Zd%d& Zd'd( Zd)d* ZdS )2r> a Streaming unpacker.
Arguments:
:param file_like:
File-like object having `.read(n)` method.
If specified, unpacker reads serialized data from it and :meth:`feed()` is not usable.
:param int read_size:
Used as `file_like.read(read_size)`. (default: `min(16*1024, max_buffer_size)`)
:param bool use_list:
If true, unpack msgpack array to Python list.
Otherwise, unpack to Python tuple. (default: True)
:param bool raw:
If true, unpack msgpack raw to Python bytes.
Otherwise, unpack to Python str by decoding with UTF-8 encoding (default).
:param int timestamp:
Control how timestamp type is unpacked:
0 - Timestamp
1 - float (Seconds from the EPOCH)
2 - int (Nanoseconds from the EPOCH)
3 - datetime.datetime (UTC). Python 2 is not supported.
:param bool strict_map_key:
If true (default), only str or bytes are accepted for map (dict) keys.
:param callable object_hook:
When specified, it should be callable.
Unpacker calls it with a dict argument after unpacking msgpack map.
(See also simplejson)
:param callable object_pairs_hook:
When specified, it should be callable.
Unpacker calls it with a list of key-value pairs after unpacking msgpack map.
(See also simplejson)
:param str unicode_errors:
The error handler for decoding unicode. (default: 'strict')
This option should be used only when you have msgpack data which
contains invalid UTF-8 string.
:param int max_buffer_size:
Limits size of data waiting unpacked. 0 means 2**32-1.
The default value is 100*1024*1024 (100MiB).
Raises `BufferFull` exception when it is insufficient.
You should set this parameter when unpacking data from untrusted source.
:param int max_str_len:
Deprecated, use *max_buffer_size* instead.
Limits max length of str. (default: max_buffer_size)
:param int max_bin_len:
Deprecated, use *max_buffer_size* instead.
Limits max length of bin. (default: max_buffer_size)
:param int max_array_len:
Limits max length of array.
(default: max_buffer_size)
:param int max_map_len:
Limits max length of map.
(default: max_buffer_size//2)
:param int max_ext_len:
Deprecated, use *max_buffer_size* instead.
Limits max size of ext type. (default: max_buffer_size)
Example of streaming deserialize from file-like object::
unpacker = Unpacker(file_like)
for o in unpacker:
process(o)
Example of streaming deserialize from socket::
unpacker = Unpacker(max_buffer_size)
while True:
buf = sock.recv(1024**2)
if not buf:
break
unpacker.feed(buf)
for o in unpacker:
process(o)
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``OutOfData`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
Nr TFd i r c C s |
d kr d}
|d kr d| _ n t|js.td|| _d| _ t | _d| _d| _| sVd} |
dkrb| }
|dkrn| }|dkrz| }|dkr| d }|dkr| }| | _ || j krt
d |pt | j d| _ t
|| _t
|| _|
| _|| _d| k od kn st
d
|| _| | _|| _|| _| | _|
| _|| _|| _|| _|| _d| _ | d k rdt| rdtd|d k rt| rtd|d k rt| rtd|d k r|d k rtdt| stdd S )NstrictTz!`file_like.read` must be callableFr r r z.read_size must be smaller than max_buffer_size i r
ztimestamp must be 0..3z`list_hook` is not callablez `object_hook` is not callablez#`object_pairs_hook` is not callablez8object_pairs_hook and object_hook are mutually exclusivez`ext_hook` is not callablel irU rU rU rU i @ ) _feedingcallableread TypeError file_liker! _buffer_buff_i_buf_checkpoint_max_buffer_sizer: min
_read_sizebool_raw_strict_map_key_unicode_errors _use_list
_timestamp
_list_hook _object_hook_object_pairs_hook _ext_hook _max_str_len _max_bin_len_max_array_len _max_map_len _max_ext_len_stream_offset)r rZ read_sizeuse_listraw timestampstrict_map_key object_hookobject_pairs_hook list_hookunicode_errorsr= ext_hook max_str_len max_bin_len
max_array_len max_map_len max_ext_lenr r r r sn
zUnpacker.__init__c C sr | j s
tt|}t| j| j t| | jkr4t| jdkrb| jd | j= | j| j8 _d| _| jj | d S )Nr )
rV AssertionErrorr< r
r[ r\ r^ r, r] extend)r
next_bytesr; r r r r? U s
z
Unpacker.feedc C s" | j | j| j 7 _ | j| _dS )z+ Gets rid of the used parts of the buffer. N)rp r\ r] )r r r r _consumed s zUnpacker._consumec C s | j t| jk S )N)r\ r
r[ )r r r r rB i s zUnpacker._got_extradatac C s | j | jd S )N)r[ r\ )r r r r rC l s zUnpacker._get_extradatac C s | j |}| j |S )N)_readr )r nrG r r r
read_byteso s
zUnpacker.read_bytesc C s, | j | | j}|| | _| j||| S )N)_reserver\ r[ )r r ir r r r t s
zUnpacker._readc C s t | j| j | }|dkr d S | jr2| j| _t| jdkr`| jd | j= | j| j8 _d| _| }xR|dkrt| j|}| jj |}|sP t
|t st | j|7 _|t |8 }qhW t | j|| j k rd| _td S )Nr )
r
r[ r\ rV r] r- maxr` rZ rX r r" r )r r remain_bytes
to_read_bytes read_datar r r r { s,
zUnpacker._reservec C s&
t }d}d }| jd | j| j }| jd7 _|d@ dkrD|} n|d@ dkr`dK|dA } n|d@ dkr|d@ }t}|| jkrtd|| j| j|} n~|d @ d
kr|d @ }t}|| j krtd || j nJ|d @ dkr
|d @ }t
}|| j k
r td
|| j n|dkr d } n |dkr.d}n|dkr@d}n|dkrt }| jd | j| j }| jd7 _|| j
krtd|| j
f | j|}n~|dkrt }| jd td| j| jd }| jd7 _|| j
krtd|| j
f | j|}n|dkrjt }| jd td| j| jd }| jd7 _|| j
kr\td|| j
f | j|}n|dkrt}| jd td | j| j\}}| jd7 _|| jkrtd || jf | j|}nL|d kr6t}| jd td | j| j\}}| jd 7 _|| jkr(td || jf | j|}n|d!krt}| jd" td#| j| j\}}| jd"7 _|| jkrtd || jf | j|}n|d$kr| jd td%| j| jd }| jd7 _nF|d&kr| jd' td(| j| jd }| jd'7 _n |d)krB| jd | j| j }| jd7 _n|d*kr|| jd td| j| jd }| jd7 _n|d+kr| jd td| j| jd }| jd7 _nf|d,kr| jd' td-| j| jd }| jd'7 _n,|d.kr*| jd td/| j| jd }| jd7 _n|d0krd| jd td1| j| jd }| jd7 _n|d2kr| jd td3| j| jd }| jd7 _n~|d4kr| jd' td5| j| jd }| jd'7 _nD|d6kr4t}| jdk rtd d| jf | jd td7| j| j\}}| jd7 _n|d8krt}| jdk r`td d| jf | jd td9| j| j\}}| jd 7 _n|d:krt}| jdk rtd d| jf | jd" td;| j| j\}}| jd"7 _n0|d| j| j\}}| jd=7 _n|d?krt}| jd@k rttd d@| jf | jdA tdB| j| j\}}| jdA7 _nx|dCkrt}| jd | j| j }| jd7 _|| jkrtd|| j| j|}n |dDkr^t}| jd td| j| j\}| jd7 _|| jkrPtd|| j| j|}n|dEkrt}| jd td| j| j\}| jd7 _|| jkrtd|| j| j|}n^|dFk rt}| jd td| j| j\}| jd7 _|| j k
r td || j n|dGk rht}| jd td| j| j\}| jd7 _|| j k
r td || j n|dHk r| jd td| j| j\}| jd7 _|| j k rtd
|| j t
}n`|dIk
r| jd td| j| j\}| jd7 _|| j k
r
td
|| j t
}n tdJ| |||fS )LNr r rS z%s exceeds max_str_len(%s) z %s exceeds max_array_len(%s)z%s exceeds max_map_len(%s) F T z%s exceeds max_bin_len(%s) r z>H r3 z>I Bbz%s exceeds max_ext_len(%s) r
z>Hb r z>Ib z>f z>d z>Q rN z>h z>i z>q b1s b2s b4s b8s rT b16s zUnknown header: 0x%xrU )TYPE_IMMEDIATEr r[ r\ TYPE_RAWrk r: r
TYPE_ARRAYrm TYPE_MAPrn TYPE_BINrl rP TYPE_EXTro r/ )r executetypr r4 rN Lr r r _read_header s
zUnpacker._read_headerc
s j |\}}}|tkr,|tkr(td|S |tkrH|tkrDtd|S |tkr|tkrxxt|D ]} jt qbW d S t |}x t|D ]}|j
jt qW j d k r j |} j
r|S t|S |tkr|tkrx$t|D ]} jt jt qW d S jd k r0 j fddt|D }ni }xxt|D ]l} jt } jrzt|ttfkrztdtt| t rt|tkrtj|} jt ||< q>W jd k rĈ j|}|S |tkrd S |tkr jrt|}n|jd j }|S |t krt|S |t kr|d
krzt j t|} j!dkrL| j" S j!dkr`| j# S j!d krt| j$ S | S n j%|t|S |t&kst'|S ) NzExpected arrayz Expected mapc 3 s" | ]} j t j tfV qd S )N)r@ EX_CONSTRUCT).0_)r r r s z#Unpacker._unpack..z %s is not allowed for map keyutf_8r r r
rU )(r EX_READ_ARRAY_HEADERr r: EX_READ_MAP_HEADERr EX_SKIPxranger@ r r r rg re r7 ri rc r6 unicoder" r PY2sysinternrh r rb decoderd r r r2
from_bytesrf to_unix to_unix_nano to_datetimerj r r )
r r r r r4 r rG r keytsr )r r r@ o s
zUnpacker._unpackc C s | S )Nr )r r r r __iter__ s zUnpacker.__iter__c C sR y| j t}| j |S tk
r6 | j tY n tk
rL tY nX d S )N)r@ r r r-
StopIterationrA r0 )r rG r r r __next__ s
zUnpacker.__next__c C s | j t | j d S )N)r@ r r )r r r r skip s
z
Unpacker.skipc C s4 y| j t}W n tk
r& tY nX | j |S )N)r@ r rA r0 r )r rG r r r unpack s
zUnpacker.unpackc C s | j t}| j |S )N)r@ r r )r rG r r r read_array_header s
zUnpacker.read_array_headerc C s | j t}| j |S )N)r@ r r )r rG r r r read_map_header s
zUnpacker.read_map_headerc C s | j S )N)rp )r r r r tell s z
Unpacker.telli i @rU rU rU rU rU )r& r' r( __doc__r1 r r? r rB rC r r r r r r@ r r nextr r r r r r r r r r> sH ^ K U M r> c @ s e Zd ZdZd#ddZeeefddZd d
Z d d Z
d
d Z dd Z dd Z
dd Zdd ZefddZdd Zdd Zd d Zd d Zd!d" ZdS )$Packerag
MessagePack Packer
Usage:
packer = Packer()
astream.write(packer.pack(a))
astream.write(packer.pack(b))
Packer's constructor has some keyword arguments:
:param callable default:
Convert user type to builtin type that Packer supports.
See also simplejson's document.
:param bool use_single_float:
Use single precision float type for float. (default: False)
:param bool autoreset:
Reset buffer after each pack and return its content as `bytes`. (default: True).
If set this to false, use `bytes()` to get content and `.reset()` to clear buffer.
:param bool use_bin_type:
Use bin type introduced in msgpack spec 2.0 for bytes.
It also enables str8 type for unicode. (default: True)
:param bool strict_types:
If set to true, types will be checked to be exact. Derived classes
from serializable types will not be serialized and will be
treated as unsupported type and forwarded to default.
Additionally tuples will not be serialized as lists.
This is useful when trying to implement accurate serialization
for python types.
:param bool datetime:
If set to true, datetime with tzinfo is packed into Timestamp type.
Note that the tzinfo is stripped in the timestamp.
You can get UTC datetime with `timestamp=3` option of the Unpacker.
(Python 2 is not supported).
:param str unicode_errors:
The error handler for encoding unicode. (default: 'strict')
DO NOT USE THIS!! This option is kept for very specific usage.
NFTc C sf || _ || _|| _|| _t | _tr0|r0tdt|| _ |p@d| _
|d k r\t |s\t d|| _
d S )Nz%datetime is not supported in Python 2rR zdefault must be callable)
_strict_types
_use_float
_autoreset
_use_bin_typer r[ r r: ra _datetimerd rW rY _default)r defaultuse_single_float autoreset use_bin_type strict_typesr ry r r r r s
zPacker.__init__c C s d}| j r|}t}nttf}x|dk r0td|d krD| jjdS ||trj|r^| jjdS | jjdS ||trd| kodk n r| jjtj d|S d;| kodk n r| jjtj d
|S d| kod kn r| jjtj d d
|S d<| kodk n r.| jjtj dd|S d | k oBdkn r`| jjtj dd|S d=| kotd>k n r| jjtj dd|S d| k odkn r| jjtj dd|S d?| kod@k n r| jjtj dd|S d| k o
d kn r(| jjtj d d |S dA| koBbr i z>BHr i z>Bhr l z>BIr l z>Bir l z>BQr l z>Bqr TzInteger value out of ranger z%s is too largezutf-8zString is too largezMemoryview is too largez>Bfr z>Bdr r r3 r rT z>BBr r r zCannot serialize %riii ii i l i l l l rU ),r listr7 r: r[ r# ra int_typesrK packr
OverflowErrorr" r! r
r6 r& _pack_bin_headerr encoderd _pack_raw_headerr r9 floatr r1 r2 to_bytescodedatar intr _pack_array_headerr _packdict_pack_map_pairsr r _DateTime
from_datetimerY ) r r4
nest_limitcheckcheck_type_strict default_used
list_typesr r r r r r r r r , s
z Packer._packc C sF y| j | W n t | _ Y nX | jrB| jj }t | _|S d S )N)r r r[ r r% )r r4 rG r r r r s
z Packer.packc C s0 | j t|| | jr,| jj }t | _|S d S )N)r
r
r r[ r% r )r pairsrG r r r pack_map_pairs s
zPacker.pack_map_pairsc C s6 |dkr t | j| | jr2| jj }t | _|S d S )Nr r l )r: r r r[ r% r )r r rG r r r pack_array_header s
zPacker.pack_array_headerc C s6 |dkr t | j| | jr2| jj }t | _|S d S )Nr r l )r: _pack_map_headerr r[ r% r )r r rG r r r pack_map_header s
zPacker.pack_map_headerc C sL t |tstdd| ko$dkn s2tdt |tsDtdt|}|dkr\td|dkrr| jjd n|d
kr| jjd n|d kr| jjd
n|dkr| jjd nt|dkr| jjd n^|dkr| jjdtj d| n<|dkr| jjdtj d| n| jjdtj d| | jjtj d| | jj| d S )Nz typecode must have int type.r ztypecode should be 0-127zdata must have bytes typel zToo large datar r r r r3 r r r rT r r r i z>H z>I)
r r rY r: r" r
r[ r# rK r )r typecoder r r r r
pack_ext_type s4
zPacker.pack_ext_typec C sh |dkr | j jtjdd| S |dkr>| j jtjdd|S |dkr\| j jtjdd |S td
d S ) Nr r r i z>BHr l z>BIr zArray is too large)r[ r# rK r r: )r r r r r r s zPacker._pack_array_headerc C sh |dkr | j jtjdd| S |dkr>| j jtjdd|S |dkr\| j jtjdd |S td
d S ) Nr r r i z>BHr l z>BIr zDict is too large)r[ r# rK r r: )r r r r r r s zPacker._pack_map_headerc C s@ | j | x0|D ](\}}| j||d | j||d qW d S )Nr )r r )r r r r
kvr r r r
s
zPacker._pack_map_pairsc C s |dkr"| j jtjdd| nn| jrH|dkrH| j jtjdd| nH|dkrh| j jtjdd | n(|d
kr| j jtjd d | ntd
d S )NrS r r r z>BBr i z>BHr l z>BIr zRaw is too large)r[ r# rK r r r: )r r r r r r s zPacker._pack_raw_headerc C sv | j s| j|S |dkr.| jjtjdd|S |dkrL| jjtjdd|S |dkrj| jjtjdd |S td
d S ) Nr z>BBr i z>BHr l z>BIr zBin is too large)r r r[ r# rK r r: )r r r r r r s
zPacker._pack_bin_headerc C s
| j j S )z/Return internal buffer contents as bytes object)r[ r% )r r r r r" s z Packer.bytesc C s t | _dS )zYReset internal buffer.
This method is useful only when autoreset=False.
N)r r[ )r r r r reset s z Packer.resetc C s" t strt| j S | jj S dS )z Return view of internal buffer.N)USING_STRINGBUILDERr r r" r[ getbuffer)r r r r r! " s zPacker.getbuffer)NFTTFFN)r& r' r( r r DEFAULT_RECURSE_LIMITr r8 r r r r r r r r r
r r r" r r! r r r r r s0 ,
u r )r
r )r rI rJ )r );r r r r rK version_infor r longr r r r ranger RuntimeErrorrA r hasattrZ__pypy__r Z__pypy__.buildersr r ImportErrorr objectr ior)
exceptionsr, r- r. r/ r0 extr1 r2 r r r r r r r r r r r" r6 r7 r8 r< rH rP rL r> r r r r r sf
R