update: DE-Common-Metrics — 19/31 metrics, ZEW + retail + import prices now live

ZEW Expectations -0.5 (2026-03), ZEW Current Situation -62.9 (2026-03), DE_RETAIL 130.1 (2026-02), DE_IMPORT_PRICE 112.8 (2026-02) now fetching. source.md: corrected table codes (45212-0004 retail, 61411-0002 import prices), BA adapter documented as OAuth-blocked, PPI/wage/demographics noted as deferred. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-18 08:41:41 +02:00
parent ec8b877a1d
commit 1eae1063ce
4 changed files with 39 additions and 11 deletions
--- a/Data/DE-Common-Metrics/DE-Common-Metrics.md
+++ b/Data/DE-Common-Metrics/DE-Common-Metrics.md
@@ -2,7 +2,7 @@

 **Last Updated:** 2026-04-18
 **Data Sources:** Destatis GENESIS, Bundesbank, BA fuer Arbeit, ZEW
-**Coverage:** 15/31 metrics fetched
+**Coverage:** 19/31 metrics fetched

 ---

@@ -14,7 +14,7 @@
 | Inflation | CPI All Items | 124.5 | 2026-03-01 | → |
 | Employment | Unemployment Rate | -- | -- | → |
 | Housing | 10-Year Mortgage Rate | 13.00% | 2003-06-01 | → |
-| Consumer | ZEW Economic Expectations | -- | -- | → |
+| Consumer | ZEW Economic Expectations | -0.5 | 2026-03-01 | → |
 | Financial | ECB Key Rate | 2.40% | 2026-03-01 | → |
 | Demographics | Total Population | 83577140.0M | 2024-12-01 | → |
 | Health | Mortality Rate | 1005632.0 | 2025-01-01 | → |
@@ -30,7 +30,7 @@
 | Nominal GDP (Bruttoinlandsprodukt nominal) | 1152.7B | 2025-10-01 | 2026-04-18 | Bundesbank | DE_GDP_NOM |
 | Industrial Production Index (Industrieproduktion) | 127.3 | 2026-02-01 | 2026-04-18 | Destatis | DE_INDPRO |
 | Factory Orders (Auftragseingang Industrie) | 14334832000.0 | 2025-01-01 | 2026-04-18 | Destatis | DE_ORDERS |
-| Retail Sales (Einzelhandelsumsatz) | -- | -- | -- | Destatis | DE_RETAIL |
+| Retail Sales (Einzelhandelsumsatz) | 130.1 | 2026-02-01 | 2026-04-18 | Destatis | DE_RETAIL |

 ---

@@ -40,7 +40,7 @@
 |--------|-------|--------|---------|--------|----|
 | CPI All Items (VPI Gesamt) | 124.5 | 2026-03-01 | 2026-04-18 | Destatis | DE_CPI |
 | Producer Price Index (Erzeugerpreisindex) | -- | -- | -- | Destatis | DE_PPI |
-| Import Price Index (Importpreisindex) | -- | -- | -- | Destatis | DE_IMPORT_PRICE |
+| Import Price Index (Importpreisindex) | 112.8 | 2026-02-01 | 2026-04-18 | Destatis | DE_IMPORT_PRICE |

 ---

@@ -73,8 +73,8 @@

 | Metric | Value | Period | Updated | Source | ID |
 |--------|-------|--------|---------|--------|----|
-| ZEW Economic Expectations (ZEW Konjunkturerwartungen) | -- | -- | -- | ZEW | DE_ZEW_EXPECT |
-| ZEW Current Situation (ZEW Aktuelle Lage) | -- | -- | -- | ZEW | DE_ZEW_CURRENT |
+| ZEW Economic Expectations (ZEW Konjunkturerwartungen) | -0.5 | 2026-03-01 | 2026-04-18 | ZEW | DE_ZEW_EXPECT |
+| ZEW Current Situation (ZEW Aktuelle Lage) | -62.9 | 2026-03-01 | 2026-04-18 | ZEW | DE_ZEW_CURRENT |

 ---

--- a/Data/DE-Common-Metrics/de-metrics-current.csv
+++ b/Data/DE-Common-Metrics/de-metrics-current.csv
@@ -2,12 +2,16 @@ metric_id,metric_name,value,formatted_value,period,updated,source
 DE_GDP_NOM,"Nominal GDP (Bruttoinlandsprodukt nominal)",1152.73,"1152.7B",2025-10-01,2026-04-18,"Bundesbank"
 DE_INDPRO,"Industrial Production Index (Industrieproduktion)",127.3,"127.3",2026-02-01,2026-04-18,"Destatis"
 DE_ORDERS,"Factory Orders (Auftragseingang Industrie)",14334832000,"14334832000.0",2025-01-01,2026-04-18,"Destatis"
+DE_RETAIL,"Retail Sales (Einzelhandelsumsatz)",130.1,"130.1",2026-02-01,2026-04-18,"Destatis"
 DE_CPI,"CPI All Items (VPI Gesamt)",124.5,"124.5",2026-03-01,2026-04-18,"Destatis"
+DE_IMPORT_PRICE,"Import Price Index (Importpreisindex)",112.8,"112.8",2026-02-01,2026-04-18,"Destatis"
 DE_LABFORCE,"Labor Force (Erwerbspersonenpotenzial)",678071,"678071.0M",2025-01-01,2026-04-18,"Destatis"
 DE_HOUSE_IDX,"House Price Index (Immobilienpreisindex Haeuser)",150.2,"150.2",2025-12-01,2026-04-18,"Bundesbank"
 DE_COMPLETIONS,"Housing Completions (Baufertigstellungen)",87,"87K",2024-01-01,2026-04-18,"Destatis"
 DE_PERMITS,"Building Permits (Baugenehmigungen)",172,"172K",2025-01-01,2026-04-18,"Destatis"
 DE_MORTGAGE,"10-Year Mortgage Rate (Hypothekenzinsen 10J)",13,"13.00%",2003-06-01,2026-04-18,"Bundesbank"
+DE_ZEW_EXPECT,"ZEW Economic Expectations (ZEW Konjunkturerwartungen)",-0.5,"-0.5",2026-03-01,2026-04-18,"ZEW"
+DE_ZEW_CURRENT,"ZEW Current Situation (ZEW Aktuelle Lage)",-62.9,"-62.9",2026-03-01,2026-04-18,"ZEW"
 DE_ECB_RATE,"ECB Key Rate (EZB-Leitzins)",2.4,"2.40%",2026-03-01,2026-04-18,"Bundesbank"
 DE_BUND10,"10-Year Bund Yield (10J-Bundrendite)",3.33,"3.33%",2026-03-01,2026-04-18,"Bundesbank"
 DE_EURUSD,"EUR/USD Exchange Rate (EUR/USD Wechselkurs)",1.1498,"1.1498",2026-03-01,2026-04-18,"Bundesbank"
--- a/Data/DE-Common-Metrics/de-metrics-historical.csv
+++ b/Data/DE-Common-Metrics/de-metrics-historical.csv
@@ -14,3 +14,22 @@ fetch_timestamp,metric_id,value,period
 2026-04-18T06:16:04.546Z,DE_POP,83577140,2024-12-01
 2026-04-18T06:16:04.546Z,DE_BIRTH_RATE,347717,2024-01-01
 2026-04-18T06:16:04.546Z,DE_MORTALITY,1005632,2025-01-01
+2026-04-18T06:41:11.310Z,DE_GDP_NOM,1152.73,2025-10-01
+2026-04-18T06:41:11.310Z,DE_INDPRO,127.3,2026-02-01
+2026-04-18T06:41:11.310Z,DE_ORDERS,14334832000,2025-01-01
+2026-04-18T06:41:11.310Z,DE_RETAIL,130.1,2026-02-01
+2026-04-18T06:41:11.310Z,DE_CPI,124.5,2026-03-01
+2026-04-18T06:41:11.310Z,DE_IMPORT_PRICE,112.8,2026-02-01
+2026-04-18T06:41:11.310Z,DE_LABFORCE,678071,2025-01-01
+2026-04-18T06:41:11.310Z,DE_HOUSE_IDX,150.2,2025-12-01
+2026-04-18T06:41:11.310Z,DE_COMPLETIONS,87,2024-01-01
+2026-04-18T06:41:11.310Z,DE_PERMITS,172,2025-01-01
+2026-04-18T06:41:11.310Z,DE_MORTGAGE,13,2003-06-01
+2026-04-18T06:41:11.310Z,DE_ZEW_EXPECT,-0.5,2026-03-01
+2026-04-18T06:41:11.310Z,DE_ZEW_CURRENT,-62.9,2026-03-01
+2026-04-18T06:41:11.310Z,DE_ECB_RATE,2.4,2026-03-01
+2026-04-18T06:41:11.310Z,DE_BUND10,3.33,2026-03-01
+2026-04-18T06:41:11.310Z,DE_EURUSD,1.1498,2026-03-01
+2026-04-18T06:41:11.310Z,DE_POP,83577140,2024-12-01
+2026-04-18T06:41:11.310Z,DE_BIRTH_RATE,347717,2024-01-01
+2026-04-18T06:41:11.310Z,DE_MORTALITY,1005632,2025-01-01
--- a/Data/DE-Common-Metrics/source.md
+++ b/Data/DE-Common-Metrics/source.md
@@ -21,11 +21,11 @@

 ### BA fuer Arbeit REST
 - **URL:** https://rest.arbeitsagentur.de/infosysbub/
- **Auth:** None (public API)
+- **Auth:** OAuth2 client credentials (as of 2026-04-18)
 - **Format:** JSON with `_embedded.statistiken` structure
 - **Rate limit:** 1 req/s documented; skill uses 1100ms delay
 - **Metrics:** Unemployment rate, employment rate, job openings, BA-X index, short-time workers
- **Status:** Adapter currently returning null for all series — needs investigation
+- **Status:** **BLOCKED — API now returns HTTP 403.** Requires OAuth2 client credentials token. No public alternative found yet. All 5 employment metrics currently failing (DE_UNRATE, DE_EMPRATE, DE_JOLTS, DE_BAX, DE_KURZARBEIT).

 ### ZEW Economic Sentiment
 - **URL:** https://www.zew.de/en/publications/zew-indicator-of-economic-sentiment
@@ -65,10 +65,10 @@ bun ~/.claude/skills/Metrics/Tools/UpdateMetrics.ts --country de
 |-----------|-----------|-------------|
 | DE_INDPRO | 42153-0001 | Industrial Production Index |
 | DE_ORDERS | 42131-0001 | Factory Orders |
-| DE_RETAIL | 45213-0001 | Retail Sales (currently failing) |
+| DE_RETAIL | 45212-0004 | Retail Sales (Umsatz im Einzelhandel, Monate) |
 | DE_CPI | 61111-0002 | Consumer Price Index |
-| DE_PPI | 61241-0001 | Producer Price Index (currently failing) |
-| DE_IMPORT_PRICE | 61211-0001 | Import Price Index (currently failing) |
+| DE_PPI | 61241-0001 | Producer Price Index (failing: needs classifying var PRE001) |
+| DE_IMPORT_PRICE | 61411-0002 | Import Price Index (Index der Einfuhrpreise, Monate) |
 | DE_LABFORCE | 13211-0001 | Labor Force |
 | DE_AVG_WAGE | 62321-0002 | Average Wage (currently failing) |
 | DE_COMPLETIONS | 31121-0001 | Housing Completions |
@@ -86,3 +86,8 @@ bun ~/.claude/skills/Metrics/Tools/UpdateMetrics.ts --country de

 - **Trade tables (51000-series):** Require classifying variables — cannot be fetched as plain tables. Dropped from config until alternative codes found.
 - **Dropped Bundesbank series:** 2Y Bund, Bund spread, DAX, VDAX, EUR exchange index, Core CPI, WTI Oil, capacity utilization, disposable income, savings rate, consumer spending, household debt, government fiscal aggregates — not found in new Bundesbank SDMX API.
+- **DE_PPI (61241-xxx):** All tables in this series require classifying variable PRE001. No plain "total" table available. Metric fetches will fail until a workaround is found.
+- **DE_AVG_WAGE (62321-0001/0002):** Code 98 (table too large for dialog API). No alternative table identified. Metric deferred.
+- **DE_GINI / DE_MEDIAN_INC / DE_POVERTY (63081-xxx):** All return code 104 (no objects found). Tables may have been reorganized or replaced in GENESIS. Metrics deferred.
+- **BA fuer Arbeit (infosysbub):** API now returns HTTP 403. Requires OAuth2 client credentials. All 5 employment metrics (DE_UNRATE, DE_EMPRATE, DE_JOLTS, DE_BAX, DE_KURZARBEIT) blocked until credentials obtained.
+- **ZEW adapter (as of 2026-04-18):** Migrated from old `sentix.csv` URL (404) to `highchart-data.csv` with row-oriented format. "Survey ID" row = YYYYMM periods; "Werte Graph 1" = ZEW Expectations; "Werte Graph 2" = Current Situation.