o _~#g$ @s<dZddlmZddlmZddlZddlZddlmZddl m Z m Z ddl m ZejdZejdZeejd eed d gd d Zed dZeddZejddd dgie gdgdggddfdddgde gdggddfddddgde d d!ggd"d#gdfged$d%Zed&d'Zejd(d)gd*gd+gfd,gd-gd.gfd/gd0gd1gfged2d3Zeejd4gd5d6d7Zed8d9Zeejd:ie d;dde d=dd;0z'test_deep_skip_rows.. c Sr+r,r.r1r'r'r(r4>r5)rrrrr  r r8r)r/rangerrr r!)r"r#datacondensed_datar%condensed_resultr'r'r(test_deep_skip_rows6s r?cCsz|}d}|jt|ddddd}ttdddtdddtddd gdd }ttd d d gd|d}t ||dS)Nz^#foo,a,b,c #foo,a,b,c #foo,a,b,c #foo,a,b,c 1/1/2000,1.,2.,3. 1/2/2000,4,5,6 1/3/2000,7,8,9 r rTr rrrrrrrrrrr)r"r#r$r<rr&r'r'r(test_skip_rows_blankFs "r@zdata,kwargs,expectedzKid,text,num_lines 1,"line 11 line 12",2 2,"line 21 line 22",2 3,"line 31",1r)rzline 21 line 22r)rzline 31ridr$ num_linesrz+a,b,c ~a b~,~e d~,~f f~ 1,2,~12 13 14~~r) quotecharr)za bze dzf f)abczdText,url ~example sentence one~,url1 ~example sentence two~,url2 ~example sentence three~,url3rzexample sentence twourl2TexturlcCs*|}|jt|fi|}t||dS)Nrrr r!)r"r<kwargsr&r#r%r'r'r(test_skip_row_with_newlineas$rOcCsL|}d}gdgdg}t|gdd}|jt|dgd}t||dS)NzYid,text,num_lines 1,"line '11' line 12",2 2,"line '21' line 22",2 3,"line '31' line 32",1)rzline '21' line 22r)rzline '31' line 32rrArDrr:rrrr r!)r"r#r<exp_datar&r%r'r'r(test_skip_row_with_quotes rRz data,exp_dataz\id,text,num_lines 1,"line '11' line 12",2 2,"line '21' line 22",2 3,"line '31' line 32",1)rzline '21' line 22r)rzline '31' line 32rz\id,text,num_lines 1,"line '11 ' line 12",2 2,"line '21 ' line 22",2 3,"line '31 ' line 32",1)rzline '21 ' line 22r)rzline '31 ' line 32rzbid,text,num_lines 1,"line '11 ' line 12",2 2,"line '21 ' line 22",2 3,"line '31 ' line 32",1)rzline '21 ' line 22r)rzline '31 ' line 32rcCs8|}|jt|dgd}t|gdd}t||dS)Nrr:rArDrrrr r!)r"r<rQr#r%r&r'r'r($test_skip_row_with_newline_and_quotesrTlineterminator)r*z  c Cs|}dgd}tgdgdgdggdd}|jdkr/|d kr/tjjd d }|||d|}d }tj t |d d|j t |ddgdd}Wdn1sWwYt ||dS)Nr*)zSMOSMANIA ThetaProbe-ML2X z2007/01/01 01:00 0.2140 U M z2007/01/01 02:00 0.2141 M O z2007/01/01 04:00 0.2142 D M ) 2007/01/01z01:00g1Zd?UM)rWz02:00gk g?rYO)rWz04:00gBfj?DrY)datetimevarflagoflagrDpythonrVz+'CR' not respect with the Python parser yet)reasonz;The 'delim_whitespace' keyword in pd.read_csv is deprecatedF)matchcheck_stacklevelrT)rdelim_whitespacenames)r/renginepytestmarkxfail applymarkerreplacer assert_produces_warning FutureWarningrrr!) r"rUrequestr#r<r&ridepr_msgr%r'r'r(test_skiprows_lineterminators6    rqcCs8|}d}tddgi}|jt|dd}t||dS)Nz a" b" a 1rGrrr:rPr"r#r<r&r%r'r'r(test_skiprows_infield_quotes rszkwargs,expected1foo)r rfcCs6|}d}|jt|fdddi|}t||dS)N a 1 2 3 4 5rcSs |ddkS)Nrrr'xr'r'r(s z)test_skip_rows_callable..rM)r"rNr&r#r<r%r'r'r(test_skip_rows_callables r{cCsD|}d}tddgddgg}|jt|dddd}t||dS) Nz0,a 1,b 2,c 3,d 4,errHrdcSs|dvS)N)rrr'rxr'r'r(rz z0test_skip_rows_callable_not_in..)r rrPrrr'r'r(test_skip_rows_callable_not_insr~cCsV|}d}d}tjt|d|jt|dddWddS1s$wYdS)NrwzNo columns to parse from filerccSsdS)NTr'rxr'r'r(rzsz)test_skip_rows_skip_all..r:)rhraisesrrr)r"r#r<msgr'r'r(test_skip_rows_skip_all "rcCsVd}|}d}tjt|d|jt|dddWddS1s$wYdS)Nzby zerorwrcSsddS)Nrrr'rxr'r'r(rz!r}z-test_skip_rows_bad_callable..r:)rhrZeroDivisionErrorrr)r"rr#r<r'r'r(test_skip_rows_bad_callablerrcCsFd}|}|jt|dgdd}tgdgdd}t||dS)Nz$a,b 1,a 2,b 3,c 4,d 5,e 6,f 7,g 8,h ru)rr7r )nrowsr)rrrur8)rGrIegh)rGrHrS)r"r<r#r%r&r'r'r(test_skip_rows_and_n_rows$s  rcCsnd}|}|jt||dddd}t|}t|}t|tdgdit|tdgdigd d dS) Nz%col_a 10 20 30 40 50 60 70 80 90 100 cSs|dvS)N)rr7rur'rxr'r'r(rzHr}z,test_skip_rows_with_chunks..r7)rgr chunksizecol_a)<F)PZd)r7rur )r)rrnextr r!r)r"r<r#readerdf1df2r'r'r(test_skip_rows_with_chunks7s $r)%__doc__riornumpyrrh pandas.errorsrpandasrrpandas._testing_testingr ri usefixtures xfail_pyarrowfilterwarnings pytestmark parametrizelistr;r)r?r@rOrRrTrqrsr{r~rrrrr'r'r'r(s          !     '