argopy.stores.implementations.http.httpstore

class httpstore(*args, **kwargs)

Argo http file system

Relies on fsspec.implementations.http.HTTPFileSystem

This store intends to make argopy safer to failures from http requests and to provide higher levels methods to work with our datasets. Key methods are:

• httpstore.download_url

• httpstore.open_dataset

• httpstore.open_json

• httpstore.open_mfdataset

• httpstore.open_mfjson

• httpstore.read_csv

__init__(*args, **kwargs)

Create a file storage system for Argo data

Parameters:

• cache (bool (False))

• cachedir (str (from OPTIONS))

• **kwargs ((optional)) – Other arguments are passed to fsspec.filesystem()

Methods

__init__(*args, **kwargs)	Create a file storage system for Argo data
cachepath(uri[, errors])	Return path to cached file for a given URI
clear_cache()	Remove cache files and entry from uri open with this store instance
curateurl(url)	Register and possibly manipulate an url before it's accessed
download_url(url[, max_attempt, cat_opts, ...])	Resilient URL data downloader
exists(path, *args, **kwargs)
expand_path(path, **kwargs)	Turn one or more globs or directories into a list of all matching paths to files or directories.
first(path[, N])	Read first N bytes of a path
full_path(path[, protocol])	Return fully developed path
glob(path, **kwargs)
info(path, *args, **kwargs)
ls(path, **kwargs)
open(path, *args, **kwargs)
open_dataset(url[, errors, lazy, dwn_opts, ...])	Create a xarray.Dataset from an url pointing to a netcdf file
open_json(url[, errors])	Download and process a json document from an url
open_mfdataset(urls[, max_workers, method, ...])	Download and process multiple urls as a single or a collection of xarray.Dataset
open_mfjson(urls[, max_workers, method, ...])	Download and process a collection of JSON documents from urls
read_csv(url, **kwargs)	Read a comma-separated values (csv) url into Pandas DataFrame.
register(uri)	Keep track of files open with this instance
store_path(uri)
unstrip_protocol(path, **kwargs)

Attributes

async_impl
asynchronous
cached_files
protocol	File system name, one in fsspec.registry.known_implementations
sep
target_protocol