Skanda Energy
Data Tracker — InternalCatalog as of Nov 14, 4:23 AM ET

Everything we hold

Files

7,564,524

+59576%

+7,551,848 in last 30 days

Storage

12.7 TB

+12.5 TB in last 30 days

Documents

5,865,039

PDF, Word, text, HTML, email

Geospatial layers

3,029

incl. 4 PostGIS tables

Database records

2,024,595

32 tables in skanda-pg

States covered

51

23 datasets · federal to local

Every file in gs://skanda-etl-data, Firebase storage and the interconnection bucket, plus every table in Cloud SQL, re-counted nightly. Not counted above: 44,970 files (77.5 GB) of code, model weights, run logs and the 31 Oct Mac-import copy (see Explorer).

Structured records extracted

Pages extracted

126,268

+74%

27,245 source docs

Fee line items

208,898

+169%

From tariff docs

Utilities tracked

1,098

Electric, gas, water

Contacts

3,089

+0%

Utility & govt contacts

Historical projects

94

+1%

Permitted & operating

Incentive programs

1,101

+0%

Federal, state, local

Records parsed out of documents into Postgres. % change is this calendar month vs. everything before it.

By domain

Regulatory4,617,627 files · 9.4 TB
Opposition2,814,781 files · 2.9 TB
Grid90,299 files · 30.2 GB
Tariffs & fees25,970 files · 3.4 GB
FOIA & projects8,134 files · 30.9 GB
Incentives6,525 files · 1.6 GB
Siting & environment772 files · 141 GB
Markets360 files · 125 GB
Local jurisdictions51 files · 155 KB
Contacts5 files · 17.4 MB

By jurisdiction level

State3,402,408 files · 8.4 TB
Local2,814,824 files · 2.9 TB
Federal1,257,049 files · 1.4 TB
National90,243 files · 36.5 GB

By file type

Documents5,865,039 files · 11.2 TB
Archives (zip etc.)1,364,725 files · 472 GB
Tables & data files206,841 files · 261 GB
Other100,099 files · 351 GB
Geospatial10,482 files · 104 GB
Code & logs6,993 files · 196 MB
Images5,466 files · 10.5 GB
Model weights4,879 files · 218 GB

Files landed per month

Every bucket, by GCS upload date (Mac-import copy excluded).

Refresh pipelines

43on Cloud Scheduler

2 paused: skanda-ferc-embed-st-hourly, skanda-intervenor-embed-staging-hourly

23Cloud Run jobs run by hand

Full list on the Datasets tab.