Skip to content

Glossary

Definitions of core forecasting, orchestration, and Google Cloud terms used across scale-forecasting code, configurations, and documentation.


Term Definition
Backtest fold (Rolling-origin window) A historical evaluation split (backtest.n_windows, backtest.step_size) where the model trains on data up to a cutoff timestamp and predicts the next horizon steps against held-out actuals.
BigLake Iceberg table A BigQuery table (source_series_iceberg) backed by open Apache Iceberg metadata and Parquet files in Cloud Storage (gs://<project>-warehouse/warehouse), accessed via a BigQuery Cloud Resource connection.
Calibration (Conformal prediction) Post-processing step (calibration.py) that adjusts prediction intervals (lower_80, upper_80, lower_95, upper_95) using empirical out-of-fold residual quantiles so empirical coverage matches the nominal level.
Cell ((ts_id, model_type)) The atomic unit of execution and persistence in forecast_metadata: one time series (ts_id) evaluated and forecast by one model (model_type) within a run_id.
Ensemble stacker Post-processing model (ensembler.py) that blends base model forecasts using out-of-fold backtest accuracy (mean, median, trimmed_mean, inverse_metric, nnls, ridge, or xgb).
Family (model_family) One of the five execution groups (statistical, ml, deep_learning, automl, native) that the DAG router dispatches as an independent parallel compute job.
FPP3 Forecasting: Principles and Practice (3rd ed.) by Hyndman & Athanasopoulos — the canonical textbook reference for several statistical baselines (naive, snaive, drift, tslm, stl_ets, harmonic_arima) and evaluation metrics (mase, rmsse, winkler).
Horizon (data.horizon) Number of future time steps ($H$) predicted beyond the end of each series (or beyond each backtest fold cutoff).
HPO (Hyperparameter optimization) Automated Optuna search (hpo.py) over model hyperparameters (hpo.enabled, hpo.n_trials) minimizing backtest validation error prior to final refit.
Local vs. global (panel) training mode Local (training_mode = "local"): fits an independent parameter set per ts_id. Global / panel (training_mode = "global"): trains a single cross-series model (lightgbm_global, PyTorch deep_learning, or vertex_automl) across all series in the panel simultaneously.
LPT scheduling (order_chunks_lpt) Longest Processing Time first chunk ordering in vertex_engine.py, which schedules the largest series chunks first across worker threads/processes to minimize tail stragglers.
Out-of-fold (OOF) predictions Historical predictions produced on held-out backtest folds and stored in backtest_oof, used to compute leakage-free leaderboard metrics, conformal intervals, and learned ensemble weights.
Reconciliation (Hierarchical forecasting) Post-processing step (reconciliation.py) that adjusts forecasts across a hierarchy (such as total -> category -> store_item) using bottom_up, top_down, or mint_shrink (Minimum Trace shrinkage) so child forecasts sum exactly to parent totals.
Registry The five native BigQuery output tables (run_registry, run_jobs, forecast_metadata, forecast_predictions, backtest_oof) and five analytical SQL views (v_model_leaderboard, v_model_leaderboard_comparable, v_backtest_coverage, v_run_summary, v_run_jobs) defined in registry/ddl.py and registry/views.py.
run_id Deterministic identifier (<slug>-<12hex>) computed by registry/ids.py from the semantic RunConfig specification, excluding operational plumbing (project_id, region, "auto" machine sizing).
Smoke configuration One of the 42 fast, end-to-end cloud verification configs in configs/smokes/ (01–42) that exercises a specific runtime, model family, hardware accelerator, or post-processing feature on 50–100 series.
Tier 1 & Tier 2 feature attributions Tier 1 (fit_diagnostics["feature_attributions"] in forecast_metadata): series-level global feature importance. Tier 2 (explanations JSON in forecast_predictions): per-horizon-step local feature contributions produced by BaseModel.explain().
Validation ledger docs/validation.md — the audited record linking every smoke config (01–42), root demo config (20), and notebook (11) to its live run_id, execution date, and verified architecture axes, enforced by tests/unit/test_validation_ledger.py.
Warehouse The Cloud Storage bucket (gs://<project>-warehouse/warehouse) and BigQuery dataset (scale_forecasting) storing the source time-series panels and serialized run artifacts.
Worker barrier Synchronization step in multi-worker Vertex AI / GKE runs (_should_use_worker_barrier and _wait_for_worker_pool_barrier in vertex_engine.py) that ensures replica workers finish writing before the primary worker finalizes the run header.