U 8T_a@s4dZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z m Z mZddlmZmZmZddlmZddlmZd ZGd d d eZGd d d eZdZdZdZGdddZGdddZGdddZ GdddZ!GdddZ"ddZ#ddZ$Gdd d Z%d!d"Z&d#d$Z'dS)%z Multi-part parsing for file uploads. Exposes one class, ``MultiPartParser``, which feeds chunks of uploaded data to file upload handlers for processing. N)unquote)settings)RequestDataTooBigSuspiciousMultipartFormTooManyFieldsSent)SkipFileStopFutureHandlers StopUpload)MultiValueDict) force_str)MultiPartParserMultiPartParserErrorInputStreamExhaustedc@s eZdZdS)r N)__name__ __module__ __qualname__rr?/tmp/pip-unpacked-wheel-dv63caxw/django/http/multipartparser.pyr sr c@seZdZdZdS)rz5 No more reads are allowed from this device. N)rrr__doc__rrrrr srrawfilefieldc@s:eZdZdZd ddZddZddZd d Zd d ZdS)r z A rfc2388 multipart/form-data parser. ``MultiValueDict.parse()`` reads the input stream in ``chunk_size`` chunks and returns a tuple of ``(MultiValueDict(POST), MultiValueDict(FILES))``. Nc Cs.|dd}|ds"td|zt|d\}}Wn$tk r\tdt|YnX|d}|rvt|stdt|zt |d d } Wnt t fk rd } YnX| d krtd | t |t r|d}||_||_d d |D} tdg| |_||_|ptj|_| |_||_dS)a Initialize the MultiPartParser object. :META: The standard ``META`` dictionary in Django request objects. :input_data: The raw post data, as a file-like object. :upload_handlers: A list of UploadHandler instances that perform operations on the uploaded data. :encoding: The encoding with which to treat the incoming data. CONTENT_TYPEz multipart/zInvalid Content-Type: %sasciiz/Invalid non-ASCII Content-Type in multipart: %sboundaryz!Invalid boundary in multipart: %sCONTENT_LENGTHrzInvalid content length: %rcSsg|]}|jr|jqSr) chunk_size).0xrrr asz,MultiPartParser.__init__..iN)get startswithr parse_headerencodeUnicodeEncodeErrorr cgivalid_boundaryint ValueError TypeError isinstancestr _boundary _input_datamin _chunk_size_metarDEFAULT_CHARSET _encoding_content_length_upload_handlers) selfZMETAZ input_dataZupload_handlersencoding content_typectypesoptsrcontent_lengthZpossible_sizesrrr__init__3s4        zMultiPartParser.__init__c! Csddlm}|j}|j}|jdkr4||jdtfS|D]:}||j|j|j|j |}|dk r8|d|dfSq8|dd|_ t|_ t t |j|j}d}dgt|}d} d} d} zt||j D]\} } }|r|||d}z| dd}|d }Wn tttfk r$YqYnX| d }|dk rF|d}t||d d }| tkrN| d7} tjdk rtj| krtd tjdk rtj| } |dkr|j| d}| t|7} zt|}Wnt j!k r|}YnXn|j| d}| t|7} | t|d7} tjdk r4| tjkr4t"d|j #|t||d d q| t$krr|d}|rt%j&'|}t||d d }|(t)*|}|sq| ddif\}}|}|d}zt+| dd}Wn tt,t-fk rd}YnXdgt|}z<|D]>}z|.||||||Wnt/k rHYqNYnXq|D]}|dkrd0|1}t|d}|dkr|d|}|d0|17}t|d}qzzt|}Wn.t2k r}zt3d|W5d}~XYnXt4|D]B\}}t|}|5|||}|||7<|dkrqRqqRWn&t6k rj|7t8|YnX|}qt8|qWn>t9k r} z|7| j:st8|jW5d} ~ XYn Xt8|jt;dd|Dd|j _<|j |j fS)z Parse the POST data and break it into a FILES MultiValueDict and a POST MultiValueDict. Return a tuple containing the POST and FILES dictionary, respectively. r) QueryDictr7NT)Zmutablecontent-dispositionnamezcontent-transfer-encodingreplaceerrorszRThe number of GET/POST parameters exceeded settings.DATA_UPLOAD_MAX_NUMBER_FIELDS.base64)sizez;Request body exceeded settings.DATA_UPLOAD_MAX_MEMORY_SIZE.filenamez content-typercharsetzcontent-lengthzCould not decode base64 data.css|]}|VqdSN)Zupload_complete)rhandlerrrr sz(MultiPartParser.parse..F)=Z django.httpr=r3r5r4r Zhandle_raw_inputr.r1r-_post_files LazyStream ChunkIterr0lenParserhandle_file_completestripKeyError IndexErrorAttributeErrorr!r FIELDrZDATA_UPLOAD_MAX_NUMBER_FIELDSrZDATA_UPLOAD_MAX_MEMORY_SIZEreadrE b64decodebinasciiErrorr appendlistFILEospathbasename IE_sanitizehtmlunescaper(r*r)Znew_filerjoinsplit Exceptionr enumerateZreceive_data_chunkr _close_filesexhaustr Zconnection_resetanyZ_mutable)!r6r=r7handlersrMresultstreamold_field_namecountersZnum_bytes_readZ num_post_keys read_sizeZ item_typeZ meta_dataZ field_stream disposition field_nameZtransfer_encodingraw_datadata file_namer8Zcontent_type_extrarIr;chunkZstripped_chunk remainingZ over_chunkexciZ chunk_lengtherrrparseis                              zMultiPartParser.parsecCsHt|jD]8\}}|||}|r |jt||jdd|qDq dS)zT Handle all the signaling that takes place when a file is complete. rBrCN)rjr5Z file_completerPr_r r3)r6rqrrr|rMZfile_objrrrrU#s z$MultiPartParser.handle_file_completecCs|o||dddS)z3Cleanup filename from Internet Explorer full paths.\r?N)rfindrV)r6rHrrrrd.szMultiPartParser.IE_sanitizecCs$|jD]}t|dr|jqdS)Nr)r5hasattrrclose)r6rMrrrrk2s  zMultiPartParser._close_files)N) rrrrr<r~rUrdrkrrrrr ,s 6; r c@sTeZdZdZdddZddZdddZd d Zd d Zd dZ ddZ ddZ dS)rQa! The LazyStream wrapper allows one to get and "unget" bytes from a stream. Given a producer object (an iterator that yields bytestrings), the LazyStream object will support iteration, reading, and keeping a "look-back" variable in case you need to "unget" some bytes. NcCs.||_d|_d|_||_d|_||_g|_dS)z Every LazyStream must have a producer when instantiated. A producer is an iterable that returns a string each time it is called. FrJrN) _producer_empty _leftoverlengthposition _remaining_unget_history)r6Zproducerrrrrr<CszLazyStream.__init__cCs|jSrL)rr6rrrtellRszLazyStream.tellcsfdd}d|S)Nc3sdkrjn}|dkr*dVdS|dkr|dksBtdz t}Wntk rdYdSX|d|}||d|t|8}|Vq*dS)NrJrz0remaining bytes to read should never go negative)rrgAssertionErrornext StopIterationungetrS)rzryZemittingr6rFrrpartsVs    zLazyStream.read..partsrJ)rg)r6rFrrrrr[UszLazyStream.readcCs:|jr|j}d|_nt|j}g|_|jt|7_|S)z Used when the exact number of bytes to read is unimportant. Return whatever chunk is conveniently returned from the iterator. Useful to avoid unnecessary bookkeeping if performance is an issue. rJ)rrrrrrS)r6outputrrr__next__os zLazyStream.__next__cCs g|_dS)z Used to invalidate/disable this lazy stream. Replace the producer with an empty list. Any leftover bytes that have already been read will still be reported upon read() and/or next(). N)rrrrrrszLazyStream.closecCs|SrLrrrrr__iter__szLazyStream.__iter__cCs8|sdS|t||jt|8_||j|_dS)z Place bytes back onto the front of the lazy stream. Future calls to read() will return those bytes first. The stream position and thus tell() will be rewound. N)_update_unget_historyrSrr)r6bytesrrrrs zLazyStream.ungetcsBg|jdd|_tfdd|jD}|dkr>tddS)aZ Update the unget history as a sanity check to see if we've pushed back the same number of bytes in one chunk. If we keep ungetting the same number of bytes many times (here, 50), we're mostly likely in an infinite loop of some sort. This is usually caused by a maliciously-malformed MIME request. N1csg|]}|kr|qSrr)rZcurrent_number num_bytesrrr sz4LazyStream._update_unget_history..(zThe multipart parser got stuck, which shouldn't happen with normal uploaded files. Check for malicious upload activity; if there is none, report this to the Django developers.)rrSr)r6rZ number_equalrrrrs z LazyStream._update_unget_history)N)N) rrrrr<rr[rrrrrrrrrrQ;s    rQc@s*eZdZdZd ddZddZddZd S) rRz An iterable that will yield chunks of data. Given a file-like object as the constructor, yield chunks of read operations from that object. cCs||_||_dSrL)flor)r6rrrrrr<szChunkIter.__init__cCs@z|j|j}Wntk r,tYnX|r6|StdSrL)rr[rrr)r6rwrrrrs zChunkIter.__next__cCs|SrLrrrrrrszChunkIter.__iter__N)r)rrrrr<rrrrrrrRs  rRc@s(eZdZdZddZddZddZdS) InterBoundaryIterz7 A Producer that will iterate over boundaries. cCs||_||_dSrL)_streamr-r6rprrrrr<szInterBoundaryIter.__init__cCs|SrLrrrrrrszInterBoundaryIter.__iter__cCs4ztt|j|jWStk r.tYnXdSrL)rQ BoundaryIterrr-rrrrrrrszInterBoundaryIter.__next__N)rrrrr<rrrrrrrsrc@s0eZdZdZddZddZddZdd Zd S) rae A Producer that is sensitive to boundaries. Will happily yield bytes until a boundary is found. Will yield the bytes before the boundary, throw away the boundary bytes themselves, and push the post-boundary bytes back on the stream. The future calls to next() after locating the boundary will raise a StopIteration exception. cCsF||_||_d|_t|d|_|jd}|s6t|j|dS)NFr?)rr-_donerS _rollbackr[rr)r6rprZ unused_charrrrr<s zBoundaryIter.__init__cCs|SrLrrrrrrszBoundaryIter.__iter__c Cs|jr t|j}|j}d}g}|D].}|t|7}||||krJqZ|s$qZq$d|_|sdtd|}||}|r|\}} ||| dd|_|d|S|d| sd|_|S||| d|d| SdS)NrTrJ) rrrrrSappendrg_find_boundaryr) r6rprollback bytes_readchunksrryrendrrrrrs8     zBoundaryIter.__next__cCs||j}|dkrdS|}|t|j}td|d}|||ddkrT|d8}td|d}|||ddkr~|d8}||fSdS)a Find a multipart boundary in data. Should no boundary exist in the data, return None. Otherwise, return a tuple containing the indices of the following: * the end of current encapsulation * the start of the next encapsulation rNr?  )findr-rSmax)r6rwindexrrlastrrrrs zBoundaryIter._find_boundaryN)rrrrr<rrrrrrrrs  )rcCs>z t|}Wntk r*t|d}YnXtj|dddS)zExhaust an iterator or stream.i@r)maxlenN)iterr*rR collectionsdeque)Zstream_or_iterableiteratorrrrrl7s  rlc Cs||}|d}dd}|dkr8||ti|fS|d|}|||ddt}i}|dD]X}z||\} \} } Wntk rYqlYnX| dkrt}| d rt}| | f|| <ql|tkr|||||fS) zH Parse one and exactly one stream that encapsulates a boundary. s cSsNt|\}}z|dd\}}Wn tk r@td|YnX|||ffS)N:r?zInvalid header: %r)r#rhr))lineZmain_value_pairparamsrAvaluerrr _parse_headerNs  z,parse_boundary_stream.._parse_headerNrKs r@rH) r[rrRAWrhr)rZr!r`) rpZmax_header_sizeryZ header_endrheaderZTYPEZoutdictrrArrrrrparse_boundary_stream@s.        rc@seZdZddZddZdS)rTcCs||_d||_dS)Ns--)r _separatorrrrrr<|szParser.__init__ccs(t|j|j}|D]}t|dVqdS)Ni)rrrr)r6ZboundarystreamZ sub_streamrrrrszParser.__iter__N)rrrr<rrrrrrT{srTc Cs(td|}|dd}i}|D]}|d}|dkr(d}|d|d}|dr|dd}|d d krd }||d d}t|d kr|dd |ddkrd krnn |d d}| dd dd }|r| d \} } }t || d}|||<q(||fS)z Parse the header into a key-value. Input (line): bytes, output: str for key/name, bytes for values which will be decoded later. ;rr=FN*r'rGTr?"s\\\s\"r>) _parse_header_paramspoplowerdecoderrVendswithcountrSrBrhr) rplistkeypdictpr|Z has_encodingrArr7langrrrr#s*    4  r#cCsg}|dddkr|dd}|d}|dkrV|dd|drV|d|d}q*|dkrft|}|d|}||||d}q|S)Nr?rrrrG)rrrSrrV)srrfrrrrs   r)(rrEr]r&rrera urllib.parserZ django.confrZdjango.core.exceptionsrrrZdjango.core.files.uploadhandlerrrr Zdjango.utils.datastructuresr Zdjango.utils.encodingr __all__rir rrr`rZr rQrRrrrlrrTr#rrrrrs<    s` ;