feat(data): parse 3-agency PDF transition matrices to CSV #task-290

- New: data/parse_pdf_matrices.py (KR/NICE/SCI PDF parser)
  - KR: text-based parser (space-separated numbers + dashes)
  - NICE: text-based parser (clean numeric format)
  - SCI: pdfplumber table extraction (column-position-aware)
  - WR redistribution, B이하→B mapping, CCC extrapolation from PD patterns
- Modified: data/transition_matrices.py (added source='real' loader)
- Modified: config.yaml (data.transition_source: 'real')
- Modified: main.py (reads transition source from config)
- Output: 112 CSV files (KR/NICE/SCI/AVG × 28 years)
This commit is contained in:
Variet Agent
2026-03-11 01:07:27 +09:00
parent ebdc6b805b
commit 8af743e6f3
116 changed files with 1714 additions and 3 deletions

9
data/real/SCI_2003.csv Normal file
View File

@@ -0,0 +1,9 @@
,AAA,AA,A,BBB,BB,B,CCC,D
AAA,1.000000,0.000000,0.000000,0.000000,0.000000,0.000000,0.000000,0.000000
AA,0.033330,0.866681,0.099989,0.000000,0.000000,0.000000,0.000000,0.000000
A,0.000000,0.000000,0.926796,0.048768,0.000000,0.024436,0.000000,0.000000
BBB,0.000000,0.000000,0.086029,0.876515,0.034461,0.000000,0.002996,0.000000
BB,0.000000,0.000000,0.000000,0.057120,0.800000,0.102816,0.011424,0.028640
B,0.000000,0.000000,0.000000,0.000000,0.000000,0.765000,0.135000,0.100000
CCC,0.000000,0.000000,0.001000,0.002000,0.003000,0.020000,0.624838,0.349162
D,0.000000,0.000000,0.000000,0.000000,0.000000,0.000000,0.000000,1.000000
1 AAA AA A BBB BB B CCC D
2 AAA 1.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
3 AA 0.033330 0.866681 0.099989 0.000000 0.000000 0.000000 0.000000 0.000000
4 A 0.000000 0.000000 0.926796 0.048768 0.000000 0.024436 0.000000 0.000000
5 BBB 0.000000 0.000000 0.086029 0.876515 0.034461 0.000000 0.002996 0.000000
6 BB 0.000000 0.000000 0.000000 0.057120 0.800000 0.102816 0.011424 0.028640
7 B 0.000000 0.000000 0.000000 0.000000 0.000000 0.765000 0.135000 0.100000
8 CCC 0.000000 0.000000 0.001000 0.002000 0.003000 0.020000 0.624838 0.349162
9 D 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 1.000000