Feature verification
Beyond the automated suite, the repo ships a set of short, self-contained manual
verification procedures (FEATURE-TESTS.md) — each states its expectation and runs in well
under a minute. They’re grouped by area; this page summarizes how to drive the common ones.
Generator
Section titled “Generator”- Determinism — generate twice with the same
--seedinto different directories anddiff -rthem; expect no differences. See Determinism & seeds. - Distribution — generate with a known
--distributionand confirm thesize_bucketcolumn counts in the manifest match the weights.
Server & dispatch
Section titled “Server & dispatch”- Greeting & prompt — connect and confirm the
<hostname> line 0 is now availablegreeting and the>prompt. - Prefix matching —
sh verresolves toshow version;enreturns% Ambiguous command;endexits. See the Cisco IOS driver. - Enable mode —
enable+ correct password moves the prompt to#; a wrong password prints% Access denied. - TL1 login gate — against a Ciena device, a
RTRV-*beforeACT-USERreturnsDENY; after a validACT-USERit returnsCOMPLD. See the Ciena TL1 driver.
Metrics
Section titled “Metrics”- Endpoint —
curl /metricsshows the fullrcfgsim_*series at zero on a fresh start. - Counters move — run a few sessions and confirm
rcfgsim_sessions_totalandrcfgsim_bytes_sent_totalincrease. - Cardinality — type garbage commands and confirm they all roll up under
CmdUnknownrather than creating new label values. See Metrics overview.
Faults
Section titled “Faults”- Each type fires — enable one fault at
--fault-rate 1.0and confirm the matchingrcfgsim_faults_injected_total{type=...}increments and the behaviour matches the fault-types reference. - Zero-rate guard — with
--fault-rate 0.0, no faults fire regardless of--fault-types.
Graceful shutdown
Section titled “Graceful shutdown”Start a long show running-config against a large device, then systemctl restart (or send
SIGTERM); the in-flight session should complete within the drain window before the instance
restarts. See graceful drain.
Running the automated suite
Section titled “Running the automated suite”make test # unit, incl. determinism + cardinalitymake integration # real SSH over loopbackmake bench # hot-path benchmarks