Skip to main content

KPIs and Metrics - Security Requirements

Scope and purpose​

The indicators of this domain assess the effective application, traceability and validation of the security requirements defined in the SbD-ToE catalogue. The requirements catalogue is the link between the risk classification (Ch. 01) and the technical controls implemented in the domain chapters (Ch. 04–12). Without this link, the technical domains operate without a normative reference, and governance has no basis on which to assess compliance.

The specific risk of this domain is declarative compliance: an application may list the requirements applied without these being effectively implemented or validated. The RQS indicators measure not only the declaration but the evidence of validation.

The RQS indicators feed the cross-cutting dimensions T-01 (Control coverage) and T-06 (SbD-ToE maturity).


Denominator and portfolio foundation​

The RQS indicators use as their denominator F-02 - applications with a formal risk classification, defined in Ch. 01 (addon/12-kpis-metricas.md, CLA-K01). RQS-K01 establishes F-03 - applications with mapped requirements - which in turn is the denominator of the next layer of the SbD-ToE adoptability funnel.

The interpretation of any RQS percentage assumes that F-02 is complete for the risk level in question. See kpis-governanca.md - section "Portfolio foundation".


Conventions​

SymbolMeaning
✔Mandatory threshold for this level
-Not applicable or not mandatory at this level
↓Inverse indicator - a lower value indicates better performance

Thresholds are cumulative: L3 includes all the obligations of L1 and L2.

Indicator types:

CodeMeaning
Q%Quantitative, percentage
Q#Quantitative, count

Indicator catalogue​

IDIndicatorTypeL1L2L3Dim. TPeriod
RQS-K01% of applications with security requirements formally mapped to the classified risk levelQ%≥ 80%≥ 95%100%T-01Half-yearly
RQS-K02% of mandatory requirements per level with evidence of implementation or a documented formal exceptionQ%≥ 70%≥ 90%≥ 98%T-01Per release
RQS-K03% of applied requirements with complete traceability (requirement → control implemented → test evidence)Q%-≥ 75%≥ 95%T-01Half-yearly
RQS-K04% of L2/L3 applications with formal requirements validation carried out in the last release cycleQ%-≥ 85%100%T-01Per release
RQS-K05% of requirements with the acceptance criterion verified (tested or audited) vs only declared as appliedQ%-≥ 70%≥ 90%T-01Half-yearly
RQS-K06# of requirements mandatory for the risk level with no implementation and no formal exception (ungoverned gaps)Q# ↓= 0= 0= 0T-01Per release

Complementary definitions​

RQS-K01 - Formal mapping: a mapping is considered formal when it identifies, per application: (a) the classified risk level; (b) the mandatory requirements for that level in each relevant domain; (c) the status of each requirement (applied, excepted, not applicable with justification). Requirements tables without an up-to-date status do not satisfy this criterion.

RQS-K02 - Evidence of implementation: the evidence may be technical (scanner result, validation log, pipeline output) or procedural (review record, release checklist, audit result). The evidence must be traceable to the specific requirement, not generic to the application.

RQS-K03 - Complete traceability: the requirement → control → evidence chain is complete when it is possible to start from a canonical requirement (e.g. AUT-003) and reach concrete evidence that it is implemented in the application in question. Partial traceability (requirement declared but no control identified) does not satisfy this criterion.

RQS-K04 - Cycle validation: formal requirements validation must be an explicit event in the release process, with documented output. It may be integrated into a release checklist, an AppSec review, or an automated pipeline with a report. Implicit validation ("CI runs, therefore it is validated") does not satisfy this criterion without explicit traceability to the requirement.

RQS-K05 - Verified vs declared criterion: a requirement is "verified" when the acceptance criterion defined in the catalogue has been assessed with evidence (test, scan, audit). It is "declared" when the owner states that it is applied without traceable evidence. RQS-K05 measures the proportion of requirements in the verified state vs the total of requirements declared as applied.

RQS-K06 - Ungoverned gap: a requirement is an ungoverned gap when it is mandatory for the application's risk level, is not implemented, and has no active formal exception. This situation amounts to an active non-compliance and must be handled with the same SLA as a critical finding.


Collection and instrumentation​

IndicatorPrimary sourceInstrumentation supportAutomation
RQS-K01Requirements register per application (GRC, wiki, ALM)Requirements matrix per applicationPartial
RQS-K02Requirements register + evidence + exception registerGRC integrated with pipeline and findings managementPartial
RQS-K03Traceability system (ALM, structured wiki)Chain completeness auditNo
RQS-K04Release register + validation checklistsRelease log + validation outputPartial
RQS-K05Requirements register with an evidence fieldAudit of the "evidence" vs "declared" fieldNo
RQS-K06Requirements register + register of active exceptionsAutomatic cross-check between the catalogue and the status per applicationPartial

Cross-references​

DocumentRelation
addon/02-lista-requisitos-base.mdCanonical catalogue and mapping of prefixes by domain
addon/03-taxonomia-rastreabilidade.mdTraceability model underpinning RQS-K03
addon/07-validacao-requisitos.mdRequirements validation process (RQS-K04/K05)
addon/08-gestao-excecoes.mdExcepted requirements (RQS-K02, RQS-K06)
Ch. 14 kpis-governanca.mdCross-cutting dimensions T-01, T-06