pandas read s3 object in jupyter notebook

Vinoo Palayoor answered on June 10, 2022 Popularity 1/10 Helpfulness 1/10

answer pandas read s3 object in jupyter notebook

related pandas read s3 object in jupyter notebook

pandas read s3 object in jupyter notebook

Comment

import s3fs

# csv file
df = pd.read_csv('s3://{bucket_name}/{path_to_file}')

# parquet file
df = pd.read_parquet('s3://{bucket_name}/{path_to_file}')

Popularity 1/10 Helpfulness 1/10 Language python

Source: stackoverflow.com

Tags: jupyter-notebook object pandas python

Link to this answer
Share Copy Link

Contributed on Jun 10 2022

Vinoo Palayoor

0 Answers Avg Quality 2/10

Closely Related Answers

pandas read s3 object in jupyter notebook

Comment

import boto3
s3_resource = boto3.resource('s3')
bucket = s3_resource.Bucket(name='{bucket_name}')
for file in bucket.objects.all():
    # do what you want with the files
    # for example:
    if 'filter' in file.key:
        print(file.key)
        new_df = pd.read_csv('s3:://{bucket_name}/{}'.format(file.key))

Popularity 1/10 Helpfulness 1/10 Language python

Source: stackoverflow.com

Tags: jupyter-notebook object pandas python

Link to this answer
Share Copy Link

Contributed on Jun 10 2022

Vinoo Palayoor

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

pandas read s3 object in jupyter notebook

Contents

More Related Answers

pandas read s3 object in jupyter notebook

Closely Related Answers

pandas read s3 object in jupyter notebook

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.