tsdat.io.storage
¶
Classes¶
Handles data storage and retrieval for file-based data formats. |
- class tsdat.io.storage.FileSystem[source]¶
Bases:
tsdat.io.base.Storage
Handles data storage and retrieval for file-based data formats.
Formats that write to directories (such as zarr) are not supported by the FileSystem storage class.
- Parameters
parameters (Parameters) – File-system specific parameters, such as the root path to where files should be saved, or additional keyword arguments to specific functions used by the storage API. See the FileSystemStorage.Parameters class for more details.
handler (FileHandler) – The FileHandler class that should be used to handle data I/O within the storage API.
- class Parameters[source]¶
Bases:
pydantic.BaseSettings
- storage_root :pathlib.Path[source]¶
The path on disk where data and ancillary files will be saved to. Defaults to the storage/root folder in the active working directory. The directory is created as this parameter is set, if the directory does not already exist.
Class Methods
Fetches data for a given datastream between a specified time range.
Saves an ancillary filepath to the datastream's ancillary storage area.
Saves a dataset to the storage area.
Method Descriptions
- fetch_data(self, start: datetime.datetime, end: datetime.datetime, datastream: str) xarray.Dataset [source]¶
Fetches data for a given datastream between a specified time range.
Note: this method is not smart; it searches for the appropriate data files using their filenames and does not filter within each data file.
- Parameters
start (datetime) – The minimum datetime to fetch.
end (datetime) – The maximum datetime to fetch.
datastream (str) – The datastream id to search for.
- Returns
xr.Dataset – A dataset containing all the data in the storage area that spans the specified datetimes.