iF6ddlmZddlmZmZddlZddlmZddl m Z ddl m Z ddl mZddlmZdd lmZddlZdd lmZmZdd lmZdd lmZmZdd lmZmZmZm Z ddl!m"Z"m#Z#m$Z$erddlm%Z%e jLe jNe jPe jRe jTe jVe jVdZ,e jPejZdfe jVej\e fe jLej^dfe jNej^dfe jRej^dfe j`ej\dfe jTejbdfiZ2ej^dejZdej\diZ3GddeZ4y)) annotations) TYPE_CHECKINGAnyN)using_python_scalars) infer_dtype)iNaT)NoBufferPresent)cache_readonly)BaseMaskedDtype) ArrowDtypeDatetimeTZDtype)is_string_dtype) PandasBufferPandasBufferPyarrow)Column ColumnBuffersColumnNullType DtypeKind) ArrowCTypes Endiannessdtype_to_arrow_c_fmt)Buffer)iufbUMmzThis column is non-nullablezThis column uses NaN as nullz!This column uses a sentinel valueceZdZdZdddZddZeddZeddZ ddZ edZ edZ edd Z edd Zdd Zddd ZddZ ddZddZddZy ) PandasColumna A column object, with only the methods and properties required by the interchange protocol defined. A column can contain one or more chunks. Each chunk can contain up to three buffers - a data buffer, a mask buffer (depending on null representation), and an offsets buffer (if variable-size binary; e.g., variable-length strings). Note: this Column object can only be produced by ``__dataframe__``, so doesn't need its own version or ``__column__`` protocol. ct|tjrtd|jdt|tj st dt|d||_||_ y)zu Note: doesn't deal with extension arrays yet, just assume a regular Series/ndarray for now. zExpected a Series, got a DataFrame. This likely happened because you called __dataframe__ on a DataFrame which, after converting column names to string, resulted in duplicated names: zD. Please rename these columns before using the interchange protocol.zColumns of type  not handled yetN) isinstancepd DataFrame TypeErrorcolumnsSeriesNotImplementedErrortype_col _allow_copy)selfcolumn allow_copys [/app/cer_product_mecsu/.venv/lib/python3.12/site-packages/pandas/core/interchange/column.py__init__zPandasColumn.__init__Vsu fbll +!..)*22 &")),%(8fFV&WX X %c.|jjS)z2 Size of the column, in elements. )r-sizer/s r2r6zPandasColumn.sizejsyy~~r4cy)z7 Offset of first element. Always zero. rr7s r2offsetzPandasColumn.offsetps r4c|jj}t|tjrb|jj j }|j|j\}}}}tj||tjfSt|rMt|jdvr+tjdt|tjfSt!d|j|S)N)stringemptyz.Non-string object dtypes are not supported yet)r-dtyper%r&CategoricalDtypevaluescodes_dtype_from_pandasdtyper CATEGORICALrNATIVErrSTRINGrr+)r/r?rB_bitwidthc_arrow_dtype_f_strs r2r?zPandasColumn.dtypexs  eR00 1II$$**E ,,U[[9  #%%#!!   U #499%)<<$$(/%%  &&VW W//6 6r4ctj|jd}|td|dt |t r|j j}nZt |tr|jj}n3t |tr|j j}n |j}|dk(r||jtj|fS||jdzt||fS)z/ See `self.dtype` for details. N Data type z& not supported by interchange protocolz bool[pyarrow]r>) _NP_KINDSgetkind ValueErrorr%r numpy_dtype byteorderr baser itemsizerBOOLr)r/r?rNrQs r2rCz$PandasColumn._dtype_from_pandasdtypes}}UZZ. <z%0VWX X eZ ())33I  / ,,I  /))33II O #    U^^a')=e)DiOOr4c|jdtjk(s td|jj j dttj|jj jdS)a: If the dtype is categorical, there are two options: - There are only values in the data buffer. - There is a separate non-categorical Column encoding for categorical values. Raises TypeError if the dtype is not categorical Content of returned dict: - "is_ordered" : bool, whether the ordering of dictionary indices is semantically meaningful. - "is_dictionary" : bool, whether a dictionary-style mapping of categorical values to other objects exists - "categories" : Column representing the (implicit) mapping of indices to category values (e.g. an array of cat1, cat2, ...). None if not a dictionary-style categorical. rzCdescribe_categorical only works on a column with categorical dtype!T) is_ordered is_dictionary categories) r?rrDr(r-catorderedr"r&r*rXr7s r2describe_categoricalz!PandasColumn.describe_categoricalsi$zz!} 5 55U  ))--//!&ryy1I1I'JK  r4ct|jjtrtj }d}||fSt|jjt rb|jjjjdjdtjdfStjdfS|jd} t|\}}||fS#t$r}td|d|d}~wwxYw)NrrKz not yet supported)r%r-r?r r USE_BYTEMASKr array _pa_arraychunksbuffers NON_NULLABLE USE_BITMASK_NULL_DESCRIPTIONKeyErrorr+)r/column_null_dtype null_valuerNnullvalueerrs r2 describe_nullzPandasColumn.describe_nulls diioo 7 . ; ; J$j0 0 diiooz 2yy((//2::D8#Dh!# q$/48 "IINN554<8$:J:J  JsAc|jddd} |j|d< |j|d<|S#t$rY!wxYw#t$rY|SwxYw)a` Return a dictionary containing the underlying buffers. The returned dictionary has the following contents: - "data": a two-element tuple whose first element is a buffer containing the data and whose second element is the data buffer's associated dtype. - "validity": a two-element tuple whose first element is a buffer containing mask values indicating missing data and whose second element is the mask value buffer's associated dtype. None if the null representation is not a bit or byte mask. - "offsets": a two-element tuple whose first element is a buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and whose second element is the offsets buffer's associated dtype. None if the data buffer does not have an associated offsets buffer. N)datavalidityoffsetsrr)_get_data_buffer_get_validity_bufferr _get_offsets_buffer)r/rbs r2 get_bufferszPandasColumn.get_bufferss())+"   "&";";"=GJ  !%!9!9!;GI        s ?A A  A  AAc|jdtjk(rt|jddkDr4|jj j dj}n|jj}t||j}tjdtjtjf}||fS|jdtjtjtj tj"fvr|j}|jj$}t'|jjt(rD|j*j,d}t/|j1dt|}||fSt'|jjt2r |j4}n |j6}t||j}||fS|jdtj8k(rV|jj:j<}t||j}|j?|j}||fS|jdtj@k(r|jj}tC}|D]4}t'|tDs|jG|jId 6ttKjL|d }tjd tjNtjf}||fStQd|jjd)zZ Return the buffer containing the data and the buffer's associated dtype. rN)r1@r]lengthutf-8encodinguint8)r?r>rKr$))r?rDATETIMEryr-dt tz_convertto_numpyrr.INTrINT64rrEUINTFLOATrTr_r%r r`rarrbr _data_ndarrayrDrA_codesrCrF bytearraystrextendencodenp frombufferUINT8r+) r/np_arrbufferr?arrrBbufrobjs r2rzPandasColumn._get_data_buffer5s ::a=I.. .4::a=!A%006??A++-!&T5E5EFF !!!! Etu}iZZ] MM NN OO NN   JJE))//C$))//:6mm**1-,KKM!$s8u}$$))//?;!&T5E5EFF>u}=ZZ]i33 3II$$++E!%D4D4DEF00=E6u}5ZZ]i.. .))$$&C A ;c3'HHSZZZ9: ; ""--"ABF !!!! Eu}& 499??2CCS&TU Ur4c|j\}}t|jjtr|jj j jd}tjdtjtjf}|jdyt|jdt|}||fSt|jjt r_|jj j"}t%|}tjdtjtjf}||fS|jdtj&k(r|jj)}|dk(}| }t+j,t|ft*j.}t1|D]\} } t| t2r|n||| <t%|}tjdtjtjf}||fS t4|d} t;| #t6$r} t9d| d} ~ wwxYw) z Return the buffer containing the mask values indicating missing data and the buffer's associated dtype. Raises NoBufferPresent if null representation is not a bit or byte mask. rr]Nrr>shaper?z! so does not have a separate maskzSee self.describe_null)rlr%r-r?r r_r`rarrTrrrErbrryr _maskrrFrrzerosbool_ enumerater_NO_VALIDITY_BUFFERrfr+r ) r/riinvalidrr?rmaskrvalidrrmsgrks r2rz!PandasColumn._get_validity_buffers ** g diiooz 2))//++2215C^^Q (8(8*:K:KLE{{}Q'( a 3xF5= diioo 799??((D!$'F^^Q (8(8*:K:KLE5= ::a=I,, ,))$$&CqLEiG883s8+RXX>D#C. E3#-c3#7%WQ E "$'F^^Q (8(8*:K:KLE5=  I(.//PQC c""  I%&>?S H Is. I I IIc|jdtjk(r|jj }d}t j t|dzft j}t|D]=\}}t|tr |jd}|t|z }|||dz<?t|}tjdtj t"j$f}||fSt'd)a Return the buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and the buffer's associated dtype. Raises NoBufferPresent if the data buffer does not have an associated offsets buffer. rr]rrrrzJThis column has a fixed-length dtype so it does not have an offsets buffer)r?rrFr-rrrryint64rr%rrrrrrrrEr ) r/rAptrrrvrrr?s r2rz PandasColumn._get_offsets_buffers ::a=I,, ,YY'')FChhc&kAo%7rxxHG!&) %1a%'2A3q6MC!$A %"'*F !!!! Eu} "5 r4)T)r0z pd.Seriesr1boolreturnNone)rint)rztuple[DtypeKind, int, str, str])rzdict[str, pd.Index])N)r|z int | None)rr)rz.tuple[Buffer, tuple[DtypeKind, int, str, str]])rztuple[Buffer, Any] | None)rztuple[PandasBuffer, Any])__name__ __module__ __qualname____doc__r3r6propertyr:r r?rCr[rlrrrurwrrrrrr9r4r2r"r"Js &( 77:PB  8&11  "#JI 7IV7#r&r4r")5 __future__rtypingrrnumpyrpandas._configrpandas._libs.librpandas._libs.tslibsr pandas.errorsr pandas.util._decoratorsr pandas.core.dtypes.dtypesr pandasr&r r pandas.api.typesrpandas.core.interchange.bufferrr*pandas.core.interchange.dataframe_protocolrrrrpandas.core.interchange.utilsrrrrrrrrTrFrrLUSE_NAN USE_SENTINELrcrDr^rerr"r9r4r2rsl" /($)25-  A               OOn,,d3 44d; MMN//6 NN^00$7 NN^00$7N77< ~22A6 !>:!DU6Ur4