o d<@sBddlZddlZddlZddlZddlZddlmZmZmZm Z ddl m m Z ddlmZddlmZejddZejddZejdd Zejd d Zejd d ZejddddZejddZddddddddddejde dd ejd!e dd g Zejed"dd#d$d%Zejed#d&d'ZdS)(N)is_ci_environmentis_platform_armis_platform_macis_platform_windowsread_csvcC|ddddS)zPath to the tips datasetiodatacsvtips.csvdatapathr r L/app/.heroku/python/lib/python3.10/site-packages/pandas/tests/io/conftest.py tips_filercCr)zPath to a JSONL datasetr parserr items.jsonlr rr r r jsonl_filerrcCst|ddddddS)z#DataFrame with the salaries datasetr rr z salaries.csv )seprrr r rsalaries_table!srcCr)Nr r Zfeatherzfeather-0_3_1.featherr rr r r feather_file'srcCs:trd}n|dkr dn|d}d|d}dd|iiS) Nzhttp://localhost:5000/master5gwzhttp://127.0.0.1:555/ client_kwargs endpoint_url)rlstrip) worker_idurlr r rs3so,s   r#session)scopec cstdtdttjddtjddtr4ts*t s*t r0t dndVntd }tjd d d td |dkrKdn| d}d|}d|d}t jtd|t jt jd8}d}|dkrz ||}|jr}WnWn tyYnw|d8}td|dksr|V|Wdn 1swYWddSWddSWddSWddS1swYdS)z Fixture for mocking S3 interaction. Sets up moto server in separate process locally Return url for motoserver/moto CI service s3fsboto3ZAWS_ACCESS_KEY_IDZ foobar_keyZAWS_SECRET_ACCESS_KEYZ foobar_secretzOS3 tests do not have a corresponding service in Windows, macOS or ARM platformszhttp://localhost:5000requestsZmotoz1.3.14)Z minversionZflaskrrrZ555zhttp://127.0.0.1:rzmoto_server s3 -p )stdoutstderrr皙?N)pytestZ importorskiptmZ!ensure_safe_environment_variablesosenviron setdefaultrrrrskipr subprocessPopenshlexsplitDEVNULLgetok Exceptiontimesleep terminate)r!r(Z endpoint_portZ endpoint_uriproctimeoutrr r rs3_base6s^            "rAc #sddl}ddl}d|fd|fd|dfd|dfd |fd |fgfd d }d }|jd|d}|jd|dzj|dWn tyIYnwz jdddWn ty\Ynwd} ds|| dkr|td| d8} ds|| dksi|||d|j |V|j d|id} z | j |ddWn tyYnwz | j dddWn tyYnwd} dr| dkrtd| d8} dr| dksdSdSdSdS)a0 Sets up S3 bucket with contents The primary bucket name is "pandas-test". The following datasets are loaded. - tips.csv - tips.csv.gz - tips.csv.bz2 - items.jsonl A private bucket "cant_get_it" is also created. The boto3 s3 resource is yielded by the fixture. rNz tips#1.csvr z tips.csv.gz.gzz tips.csv.bz2.bz2rzsimple_dataset.featherc sLD]!\}}t|d}j|||dWdn1swYqdS)Nrb)BucketKeyZBody)openZ put_object)Z bucket_nameZs3_key file_namefcliZ test_s3_filesr radd_tips_filess  z#s3_resource..add_tips_filesz pandas-tests3)r)rEZ cant_get_itprivate)rEZACLZBucketsr,r)rT) recursive) r'r&resourceclientZ create_bucketr:Z list_bucketsr;r<Z S3FileSystemZclear_instance_cacheZrm) rArrrr'r&rLZbucketconnr?rMr rJr s3_resourceusb          $rT)z .no_compressN)N)rBgzip)z.GZrV)rCbz2)z.BZ2rW)z.zipzip)z.ZIPrX)z.xzxz)z.XZrY)z.zstzstdZ zstandard)Zmarks)z.ZSTrZ)paramscCs|jS)Nparamrequestr r rcompression_formatsracCs |jdS)Nrr]r_r r rcompression_exts rb) r/r5r3r;r-Z pandas.compatrrrrZpandas.util._test_decoratorsutilZ_test_decoratorstdZpandas._testingZ_testingr.Zpandas.io.parsersrZfixturerrrrr#rArTr^Z skip_if_noZ_compression_formats_paramsrarbr r r rsP        > I