BaseDataSource

The BaseDataSource class provides the core functionality required for handling data sources, including configurations, caching, and applying filters to data.

Description

BaseDataSource is an abstract base class for managing data source configurations and paths. It also offers utilities for caching and data transformations, ensuring consistency across different data loaders.

Parameters and Attributes

• config_path (str): Path to the paths.yaml configuration file containing source definitions.

• sources (dict): Parsed contents of the configuration file, mapping source names to their configurations.

• cache_root (str): Root directory for caching data locally.

---