vcio-api-v3: Migrate EPSS importer for advisory V2 format handling #2042

Activity

1. TG1999

   added a parent issue on Nov 25, 2025

   • vcio-api-v3: Update pipelines with new Package x Advisory model v2 and API v3 #1881
2. github-project-automation

   added this to 00-AboutCodePlanneron Nov 25, 2025
3. TG1999

   changed the title [-]Migrate EPSS importer for advisory V2 format handling[/-] [+]VCIO-API-V2: Migrate EPSS importer for advisory V2 format handling[/+] on Nov 25, 2025
4. TG1999

   added

   Priority: high

   on Nov 25, 2025
5. TG1999

   assigned

   ziadhany

   on Dec 17, 2025
6. TG1999

   moved this to Todo ready in 00-AboutCodePlanneron Dec 17, 2025
7. ziadhany

   moved this from Todo ready to In progress in 00-AboutCodePlanneron Dec 19, 2025
8. TG1999

   moved this from In progress to Done in 00-AboutCodePlanneron Dec 29, 2025
9. TG1999

   closed this as completedby moving to Done in 00-AboutCodePlanneron Dec 29, 2025
10. TG1999 commented on Dec 29, 2025

    

    TG1999

    on Dec 29, 2025

    ContributorAuthor

    More actions

    This is done now

    Reference:

    • Migrate EPSS importer for advisory V2 #2067

    Here are the logs:

    Importing data using epss_importer_v2
    INFO 2025-12-24 13:26:19.085930 UTC Pipeline [EPSSImporterPipeline] starting
    INFO 2025-12-24 13:26:19.086081 UTC Step [fetch_db] starting
    INFO Fetching EPSS database from https://epss.cyentia.com/epss_scores-current.csv.gz
    INFO 2025-12-24 13:26:21.094138 UTC Step [fetch_db] completed in 2 seconds
    INFO 2025-12-24 13:26:21.094349 UTC Step [collect_and_store_advisories] starting
    INFO 2025-12-24 13:26:21.094429 UTC Collecting 307,389 advisories
    INFO 2025-12-24 13:30:09.905309 UTC Progress: 10% (30739/307389) ETA: 2059 seconds (34.3 minutes)
    INFO 2025-12-24 13:34:43.573540 UTC Progress: 20% (61478/307389) ETA: 2010 seconds (33.5 minutes)
    INFO 2025-12-24 13:39:36.892927 UTC Progress: 30% (92217/307389) ETA: 1857 seconds (30.9 minutes)
    INFO 2025-12-24 13:44:31.029478 UTC Progress: 40% (122956/307389) ETA: 1635 seconds (27.2 minutes)
    INFO 2025-12-24 13:49:17.964310 UTC Progress: 50% (153695/307389) ETA: 1377 seconds (22.9 minutes)
    INFO 2025-12-24 13:54:03.047150 UTC Progress: 60% (184434/307389) ETA: 1108 seconds (18.5 minutes)
    INFO 2025-12-24 13:58:50.244036 UTC Progress: 70% (215173/307389) ETA: 835 seconds (13.9 minutes)
    INFO 2025-12-24 14:03:40.148023 UTC Progress: 80% (245912/307389) ETA: 560 seconds (9.3 minutes)
    INFO 2025-12-24 14:08:29.004852 UTC Progress: 90% (276651/307389) ETA: 281 seconds (4.7 minutes)
    INFO 2025-12-24 14:13:17.860258 UTC Successfully collected 307,387 advisories
    INFO 2025-12-24 14:13:17.860431 UTC Step [collect_and_store_advisories] completed in 2817 seconds (46.9 minutes)
    INFO 2025-12-24 14:13:17.860510 UTC Pipeline completed in 2819 seconds (47.0 minutes)
    
11. pombredanne

    assigned

    pombredanne

    and unassigned

    ziadhany

    on Jan 2, 2026
12. pombredanne

    changed the title [-]VCIO-API-V2: Migrate EPSS importer for advisory V2 format handling[/-] [+]vcio-api-v3: Migrate EPSS importer for advisory V2 format handling[/+] on May 11, 2026
13. hesa

    moved this from Done to Reviewed in 00-AboutCodePlanneron Aug 14, 2026