Repository navigation
Commit 4b843c2
committed
fix(extract): YAML walkers grow their stacks instead of capping content
walk_yaml_mapping (dotted key paths, 256 frames) and
scan_yaml_for_infra_bindings (512 nodes) kept their pending nodes in
fixed-size stacks and stopped pushing once full. A mapping with more than
256 nested sibling mappings lost the full key_path of every leaf past the
cap: `k299.url` was only recorded as the shorter path that the walk of a
nested block emits on its own.
The infra Route pass decides on those paths. A `data:` payload block with
300 entries lost `data.svcN.webhook_url` for N >= 256, the payload deny
never saw those values, and 44 of them were minted as infra Route nodes.
Both walkers now start on the same-sized on-stack chunk and grow through
cbm_walk_stack_reserve / cbm_walk_stack_release (DeusData#2375). If the stack
cannot grow, the failure is logged as extract.walk_stack_alloc_failed and
the walk stops, instead of truncating silently.
Part of DeusData#2388.
Signed-off-by: Gaurav Dubey <gauravdubey0107@gmail.com>1 parent ff28841 commit 4b843c2
3 files changed
Lines changed: 153 additions & 13 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1663 | 1663 | | |
1664 | 1664 | | |
1665 | 1665 | | |
1666 | | - | |
1667 | | - | |
1668 | | - | |
1669 | | - | |
1670 | | - | |
| 1666 | + | |
| 1667 | + | |
| 1668 | + | |
| 1669 | + | |
| 1670 | + | |
| 1671 | + | |
| 1672 | + | |
| 1673 | + | |
| 1674 | + | |
1671 | 1675 | | |
1672 | | - | |
| 1676 | + | |
| 1677 | + | |
| 1678 | + | |
| 1679 | + | |
| 1680 | + | |
1673 | 1681 | | |
1674 | 1682 | | |
1675 | 1683 | | |
1676 | | - | |
| 1684 | + | |
1677 | 1685 | | |
1678 | 1686 | | |
| 1687 | + | |
1679 | 1688 | | |
1680 | 1689 | | |
1681 | 1690 | | |
1682 | | - | |
| 1691 | + | |
| 1692 | + | |
| 1693 | + | |
1683 | 1694 | | |
1684 | 1695 | | |
| 1696 | + | |
1685 | 1697 | | |
1686 | | - | |
| 1698 | + | |
1687 | 1699 | | |
1688 | 1700 | | |
1689 | 1701 | | |
| |||
1709 | 1721 | | |
1710 | 1722 | | |
1711 | 1723 | | |
1712 | | - | |
| 1724 | + | |
| 1725 | + | |
| 1726 | + | |
| 1727 | + | |
1713 | 1728 | | |
1714 | 1729 | | |
1715 | 1730 | | |
1716 | 1731 | | |
1717 | 1732 | | |
| 1733 | + | |
1718 | 1734 | | |
1719 | 1735 | | |
1720 | 1736 | | |
| |||
1873 | 1889 | | |
1874 | 1890 | | |
1875 | 1891 | | |
1876 | | - | |
| 1892 | + | |
| 1893 | + | |
| 1894 | + | |
1877 | 1895 | | |
1878 | | - | |
| 1896 | + | |
| 1897 | + | |
| 1898 | + | |
1879 | 1899 | | |
1880 | 1900 | | |
1881 | 1901 | | |
| |||
1884 | 1904 | | |
1885 | 1905 | | |
1886 | 1906 | | |
1887 | | - | |
| 1907 | + | |
| 1908 | + | |
| 1909 | + | |
| 1910 | + | |
| 1911 | + | |
1888 | 1912 | | |
1889 | 1913 | | |
1890 | 1914 | | |
| 1915 | + | |
1891 | 1916 | | |
1892 | 1917 | | |
1893 | 1918 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7229 | 7229 | | |
7230 | 7230 | | |
7231 | 7231 | | |
| 7232 | + | |
| 7233 | + | |
| 7234 | + | |
| 7235 | + | |
| 7236 | + | |
| 7237 | + | |
| 7238 | + | |
| 7239 | + | |
| 7240 | + | |
| 7241 | + | |
| 7242 | + | |
| 7243 | + | |
| 7244 | + | |
| 7245 | + | |
| 7246 | + | |
| 7247 | + | |
| 7248 | + | |
| 7249 | + | |
| 7250 | + | |
| 7251 | + | |
| 7252 | + | |
| 7253 | + | |
| 7254 | + | |
| 7255 | + | |
| 7256 | + | |
| 7257 | + | |
| 7258 | + | |
| 7259 | + | |
| 7260 | + | |
| 7261 | + | |
| 7262 | + | |
| 7263 | + | |
| 7264 | + | |
| 7265 | + | |
| 7266 | + | |
| 7267 | + | |
| 7268 | + | |
| 7269 | + | |
| 7270 | + | |
| 7271 | + | |
| 7272 | + | |
| 7273 | + | |
| 7274 | + | |
| 7275 | + | |
| 7276 | + | |
| 7277 | + | |
| 7278 | + | |
| 7279 | + | |
| 7280 | + | |
| 7281 | + | |
| 7282 | + | |
| 7283 | + | |
| 7284 | + | |
| 7285 | + | |
| 7286 | + | |
| 7287 | + | |
| 7288 | + | |
| 7289 | + | |
| 7290 | + | |
| 7291 | + | |
| 7292 | + | |
| 7293 | + | |
| 7294 | + | |
| 7295 | + | |
| 7296 | + | |
| 7297 | + | |
| 7298 | + | |
| 7299 | + | |
| 7300 | + | |
| 7301 | + | |
| 7302 | + | |
| 7303 | + | |
| 7304 | + | |
| 7305 | + | |
| 7306 | + | |
| 7307 | + | |
| 7308 | + | |
| 7309 | + | |
| 7310 | + | |
7232 | 7311 | | |
7233 | 7312 | | |
7234 | 7313 | | |
| |||
13483 | 13562 | | |
13484 | 13563 | | |
13485 | 13564 | | |
| 13565 | + | |
| 13566 | + | |
13486 | 13567 | | |
13487 | 13568 | | |
13488 | 13569 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1553 | 1553 | | |
1554 | 1554 | | |
1555 | 1555 | | |
| 1556 | + | |
| 1557 | + | |
| 1558 | + | |
| 1559 | + | |
| 1560 | + | |
| 1561 | + | |
| 1562 | + | |
| 1563 | + | |
| 1564 | + | |
| 1565 | + | |
| 1566 | + | |
| 1567 | + | |
| 1568 | + | |
| 1569 | + | |
| 1570 | + | |
| 1571 | + | |
| 1572 | + | |
| 1573 | + | |
| 1574 | + | |
| 1575 | + | |
| 1576 | + | |
| 1577 | + | |
| 1578 | + | |
| 1579 | + | |
| 1580 | + | |
| 1581 | + | |
| 1582 | + | |
| 1583 | + | |
| 1584 | + | |
| 1585 | + | |
| 1586 | + | |
| 1587 | + | |
| 1588 | + | |
1556 | 1589 | | |
1557 | 1590 | | |
1558 | 1591 | | |
| |||
1945 | 1978 | | |
1946 | 1979 | | |
1947 | 1980 | | |
| 1981 | + | |
1948 | 1982 | | |
1949 | 1983 | | |
1950 | 1984 | | |
| |||
0 commit comments