filestore.open_mfdataset(urls, concat_dim='row', max_workers: int = 6, method: str = 'thread', progress: bool = False, concat: bool = True, preprocess=None, preprocess_opts={}, open_dataset_opts={}, errors: str = 'ignore', *args, **kwargs)[source]#

Open multiple urls as a single xarray dataset.

This is a version of the open_dataset method that is able to handle a list of urls/paths sequentially or in parallel.

Use a Threads Pool by default for parallelization.

  • urls (list(str)) – List of url/path to open

  • concat_dim (str) – Name of the dimension to use to concatenate all datasets (passed to xarray.concat)

  • max_workers (int) – Maximum number of threads or processes

  • method (str) –

    The parallelization method to execute calls asynchronously:

    Use ‘seq’ to simply open data sequentially

  • progress (bool) – Display a progress bar (True by default)

  • preprocess (callable (optional)) – If provided, call this function on each dataset prior to concatenation

  • errors (str) – Should it ‘raise’ or ‘ignore’ errors. Default: ‘ignore’

Return type: