Skip to main content

Applying Training and Upskilling Throughout the Lifecycle

🧭 When to apply​

PhaseActionEvidence
OnboardingInitial training in SbD and secure practicesLMS certification
Continuous developmentCourses, labs and quarterly reviewsTraining reports
Release/OperationsPractical exercises and simulationsExercise logs
AuditVerification of upskilling KPIsGRC reports

👥 Who carries out each action​

RoleResponsibility
DeveloperTake part in practical training, apply it in code
Quality Assurance (QA)Training in validation and regressions
AppSec EngineerProduce content, deliver training, facilitate sessions
DevOps / SREUpskilling in CI/CD and monitoring
Security ChampionMentor teams, facilitate peer learning
Executive ManagementSupport adoption, validate regulatory compliance
GRC / ComplianceManage traceability, audits, KPIs
HR / People OperationsOperate the LMS, manage onboarding, integrate into the individual development plan
Software ArchitectsContribute to threat modelling and secure patterns
Operations (Ops)Take part in simulations, communication during incidents
Suppliers / Third PartiesReceive mandatory minimum training

📖 Normalised User Stories​

US-01 - Mandatory secure onboarding​

Context. New members without training introduce basic risks.

User Story

Story.
As HR / People Operations, I want to ensure mandatory onboarding training in SbD, so that everyone starts out aligned with the practices.

Acceptance criteria (BDD).

  • Given a new staff member
    When they take up their duties
    Then they only have full access after completing training

Checklist.

  • Course completed in the LMS
  • Certification issued
  • Record archived
  • Technical access blocked until completion
  • Automatic block in Git/Azure DevOps/CI/CD pipelines
  • Exceptions documented with AppSec/Management approval
  • Annual recertification (12-month validity) or upon a new-risk trigger

Artefacts & evidence. LMS certificates, block records in Git/Azure DevOps, exceptions document.

Proportionality.

L1L2L3
Mandatory (basic content)MandatoryMandatory + practical assessment

Integration into the SDLC.

PhaseTriggerResponsibleSLA
OnboardingArrival of a new staff memberHR / People Operations + AppSec EngineerBefore technical access

Useful links.
Technical Onboarding Checklist
Roles and Responsibilities


US-02 - Continuous training by profile​

Context. Without continuous updating, practices become obsolete.

User Story

Story.
As an AppSec Engineer, I want to provide continuous training by profile (Dev, QA, DevOps, Management), so that staying up to date with the latest practices is ensured.

Acceptance criteria (BDD).

  • Given a quarterly (L3), half-yearly (L2) or annual (L1) cycle
    When the LMS makes courses available
    Then each profile completes its specific track

Checklist.

  • Courses defined by profile
  • Record in the LMS
  • Cycle defined: quarterly for L3, half-yearly for L2, annual for L1 (TRN-005)
  • Additional triggers: new technical chapter, new risk, incident
  • Communication to teams (announcement, deadline, completion criterion)
  • Integration into individual OKRs or performance assessments
  • Quarterly effectiveness review

Artefacts & evidence. LMS reports, communications to teams, completion records, OKRs that include training.

Proportionality.

L1L2L3
Recommended annuallyMandatory half-yearlyMandatory quarterly

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Continuous cycleQuarterly (L3) / Half-yearly (L2) / Annual (L1)AppSec Engineer + HR / People OperationsDeadline communicated 2 weeks in advance

Useful links.
Training Catalogue by Technical Profile
Training Tracks by Role and Risk
Roles and Responsibilities


US-03 - Security Champions Programme​

Context. Without champions, teams lack internal leadership.

User Story

Story.
As a Champion, I want to mentor and evangelise the team, so that the continuous application of SbD practices is ensured.

Acceptance criteria (BDD).

  • Given a sprint in progress
    When questions arise
    Then the champion supports and guides the team

Checklist.

  • Champion appointed per team
  • Monthly meetings recorded
  • Feedback collected
  • Formal Champions community (monthly meeting, Teams/Slack channel)
  • Collective documentation of practices and anti-patterns (wiki)
  • Badges or institutional recognition (email, board, salary)
  • Budget for security events or conferences (optional depending on maturity)

Artefacts & evidence. Meeting records, practices wiki, community channel, list of recognitions.

Proportionality.

L1L2L3
OptionalRecommendedMandatory

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Continuous cycleMonthlySecurity Champion + AppSec EngineerMonthly meeting confirmed

Useful links.
Security Champions Programme
Roles and Responsibilities


US-04 - Practical exercises and simulations​

Context. Theoretical training without practice has low retention.

User Story

Story.
As a QA role, I want to carry out practical exercises (labs, CTFs, simulations), so that it is ensured that the knowledge is applicable.

Acceptance criteria (BDD).

  • Given a training plan
    When I run an exercise
    Then I record the result and performance metrics

Acceptance criteria (DoD).

  • Labs run
  • Results recorded
  • Metrics analysed

Artefacts & evidence. Exercise logs

Proportionality.

L1L2L3
OptionalRecommendedMandatory

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Training cycleExecution of an exercise provided for in the training planQA + AppSec EngineerResult and performance metrics recorded upon execution

US-05 - Measuring training effectiveness​

Context. Without measuring effectiveness, there is no continuous improvement.

User Story

Story.
As GRC / Compliance, I want to measure upskilling KPIs (completion rate, effectiveness in audit), so that the real impact of training is assessed.

Acceptance criteria (BDD).

  • Given a training cycle
    When I collect metrics
    Then KPIs are reported to management

Acceptance criteria (DoD).

  • KPIs defined
  • Metrics collected
  • Quarterly reports

Artefacts & evidence. GRC reports

Proportionality.

L1L2L3
BasicAnnual KPIsQuarterly KPIs with targets

Integration into the SDLC.

PhaseTriggerResponsibleSLA
AuditCollection of metrics in the training cycleGRC / ComplianceAnnual KPIs (L2); quarterly KPIs with targets (L3)

US-06 - Structured and Recurring Code Clinics​

Context. Code clinics are regular sessions of public review of real code, educating on secure patterns. Without structure, they become ad hoc and lose impact.

User Story

Story.
As an AppSec Engineer, I want to run structured code clinics (reviews of real PRs, educational, with a security checklist applied), so that continuous learning and the visible application of secure patterns are ensured.

Acceptance criteria (BDD).

  • Given that one or more PRs are selected
    When the session is conducted (in person or asynchronously)
    Then the security checklist is applied publicly
  • And feedback is recorded and shared in an internal channel
  • And lessons learned are documented for reuse

Checklist.

  • Cadence defined (weekly or fortnightly)
  • Checklist templates by domain (Dev, DevOps, IaC)
  • Exemplary PRs archived (good practices + failures)
  • Sessions recorded (video, summary, asynchronous discussion)
  • Rotating participation (Developers, Security Champions, QA)

Artefacts & evidence.

  • Repository of exemplary PRs (with comments)
  • Session summaries and feedback
  • Participation statistics

Proportionality L1–L3.

L1L2L3
Occasional (monthly)Recurring (fortnightly)Recurring + rotating (weekly)

Integration into the SDLC.

PhaseTriggerResponsibleSLA
DevelopmentSubmission of PRsAppSec Engineer + Security ChampionWeekly/fortnightly

Useful links.
Advanced Training Techniques
Example - Secure Pull Request
Roles and Responsibilities


US-07 - Threat Modeling Peer-led and Rotating​

Context. Threat modelling is a critical practice but concentrated in AppSec. Operationalising it as a peer-led, rotating activity increases the distribution of knowledge.

User Story

Story.
As a Developer / Security Champion, I want to lead threat modelling sessions (per feature, epic or refactor), so that risk analysis knowledge is disseminated and SbD is applied in design.

Acceptance criteria (BDD).

  • Given that a new feature or refactor is planned
    When the threat modelling session is scheduled
    Then it is facilitated by a Developer or Champion with the support of an AppSec Engineer
  • And the output is documented (diagram, risk matrix)
  • And security decisions are traced to the Manual's requirements

Checklist.

  • Session scheduled before design is finalised
  • Threat modelling template (e.g. STRIDE) applied
  • Architecture/flow diagram documented
  • Risk matrix (threat × impact × control)
  • Decisions and exceptions justified
  • Rotation of leadership among Security Champions

Artefacts & evidence.

  • Diagrams (draw.io, Lucidchart)
  • Session minutes
  • Risk matrix with traceability to the requirements of Ch. 02

Proportionality L1–L3.

L1L2L3
Optional / ad hocMandatory for significant architectural changes (peer-led recommended per epic)Mandatory before design is finalised

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Planning/DesignFeature approvalSecurity Champion + AppSec EngineerBefore the development sprint

Useful links.
Advanced Training Techniques
Cross-cutting Integration with the Technical Chapters
Threat Modelling - Chapter 03
Roles and Responsibilities


US-08 - War Room and Incident Simulations​

Context. Incident simulations train teams to respond under pressure, validate processes and build a culture of readiness.

User Story

Story.
As Executive Management / GRC, I want to run incident simulations (war room) regularly, so that teams are trained in response and communication and remediation processes are validated.

Acceptance criteria (BDD).

  • Given that an incident scenario is simulated
    When the response is executed in real time
    Then all roles (Developer, DevOps, AppSec Engineer, Operations, Management) take part
  • And the process is documented and analysed in an educational debrief
  • And lessons learned are incorporated into runbooks

Checklist.

  • Scenarios based on real or historical risks
  • Communication (alerts, escalation, internal/external comms) validated
  • Detection, response and resolution times measured (MTTD/MTTR)
  • Role of each participant documented (playbooks)
  • Debrief held with recommendations
  • Cadence defined (minimum: annual at L1, half-yearly at L2/L3 — Policy 32 §8; quarterly recommended)

Artefacts & evidence.

  • Simulation scenarios and scripts
  • Execution logs (timelines, communications)
  • Debrief report with observed MTTD/MTTR
  • Updated playbooks and runbooks

Proportionality L1–L3.

L1L2L3
Annual (minimum)Half-yearly (minimum)Half-yearly (minimum) + rotating by threat

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Operations/AuditQuarterly or post-incidentExecutive Management + GRCPlanned annually

Useful links.
Advanced Training Techniques
Monitoring and Operations - Chapter 12
Roles and Responsibilities


US-09 - Maintenance and Updating of Training Tracks​

Context. Training tracks need periodic review based on new risks, technologies and lessons learned.

User Story

Story.
As an AppSec Engineer / GRC, I want to maintain and update training tracks by profile and risk (annually or on a trigger), so that it is ensured that training reflects current practices and lessons learned.

Acceptance criteria (BDD).

  • Given that a year has passed or a new risk is identified
    When the review of tracks is scheduled
    Then content is reassessed against incidents, technology updates and feedback from Security Champions
  • And tracks are updated or new content is added
  • And changes are communicated to HR and to the teams

Checklist.

  • Annual review scheduled (e.g. Q1 of each year)
  • Feedback from Security Champions collected (survey or meeting)
  • Lessons learned from incidents integrated
  • New technical chapters or practices mapped
  • Tracks updated (document and matrix)
  • Communication to stakeholders (HR, teams, Executive Management)

Artefacts & evidence.

  • Document with version and changelog
  • Feedback survey of Security Champions
  • Mapping of new content to chapters
  • Release note with changes

Proportionality L1–L3.

L1L2L3
OccasionalAnnual + per triggerAnnual + continuous on trigger

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Governance/AuditAnnual (Q1) or new riskAppSec Engineer + GRC / Compliance + HR / People OperationsBefore the new training cycle

Useful links.
Training Catalogue by Technical Profile
Training Tracks by Role and Risk
Roles and Responsibilities


US-10 - Training Tracks Proportional to Risk (L1–L3)​

Context.
Training tracks need to be explicitly proportional to the application's risk. Although US-02 mentions "by profile", there is a lack of clarity about the L1–L3 application and its integration with the risk classification matrix of Ch. 01.

User Story

Story.
As an AppSec Engineer / GRC, I want to apply training tracks in a way that is explicitly proportional to the risk level (L1, L2, L3) of the application and to the technical profile, so that each staff member receives training suited to their context and responsibility.

Acceptance criteria (BDD).

  • Given an application classified as L1, L2 or L3
    When a new staff member is onboarded or a track is updated
    Then the training track applied corresponds to the proportionality matrix
  • And content reflects the mandatory practices according to the risk level
  • And traceability between classification → track is documented

Checklist.

  • Application risk classification documented (Ch. 01)
  • Track matrix (addon/02) referenced in the training plan
  • L1 track: basic content (secure coding, dependencies, policies)
  • L2 track: intermediate content (threat modelling, SCA, secure PR, CI/CD scanners)
  • L3 track: advanced content (secure architecture, labs on vulnerable apps, fuzzing, IRP integration)
  • Explicit assignment of the track per staff member in the LMS or a document
  • Traceability: link between application classification → track → HR/LMS
  • Periodic review (annual or on a reclassification trigger)
  • Catalogue → Track: there is a catalogue→track mapping artefact (catalogo_trilhos.csv or catalogo_trilhos.json) that lists, for each chapter/topic of addon/01, the recommended module/track and the applicable L1/L2/L3 version.

Additional artefacts & evidence. catalogo_trilhos.csv with minimum columns: capitulo, topico, trilho_L1, trilho_L2, trilho_L3, formato_sugerido, exemplo_import_lms. An import example (small CSV) must accompany the training plan.

Artefacts & evidence.
Risk classification document (Ch. 01), track matrix (addon/02) with the selection of the track applied, assignment in the LMS or training plan document, documented traceability.

Proportionality L1–L3.

L1L2L3
Basic track (essential content)Intermediate track (mandatory content + labs)Advanced track (complete content + simulations + continuous audit)

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Onboarding / GovernanceApplication classificationAppSec Engineer + HR / People OperationsBefore the first technical assignment

Useful links.
Training Tracks by Role and Risk
Risk Management and Classification - Chapter 01
Roles and Responsibilities


US-11 - Formal Onboarding Validation via Checklist​

Context. Onboarding without formal validation leaves gaps. A structured checklist ensures that all the minimum steps are completed before any technical access.

User Story

Story.
As HR / GRC, I want to formally validate the onboarding of each staff member (via a structured checklist), so that it is ensured that everyone meets the minimum requirements before technical access and auditable traceability is created.

Acceptance criteria (BDD).

  • Given that a new staff member starts
    When the onboarding process is carried out
    Then all checklist items are validated by a designated owner
  • And the formal record is archived
  • And technical access is blocked until completion

Checklist.

  • Correct training track assigned by role and risk
  • Track completion validated (LMS or practical evidence)
  • Knowledge validation completed (quiz, exercise or PR)
  • Access to good-practice repositories and templates confirmed
  • Technical access (Git, pipelines, environments) conditional on completion
  • Formal record archived with date and owner
  • Support contact (Champion, SPOC) identified
  • Applicable to internal and external staff (suppliers with technical access)

Artefacts & evidence.

  • Checklist completed and signed (digital or paper)
  • Record in the LMS, permissions system or GitHub/ADO
  • Evidence of completion (certificate, PDF, closed issue)

Proportionality L1–L3.

L1L2L3
Basic (role)Structured (role + risk)Structured + periodic audit

Integration into the SDLC.

PhaseTriggerResponsibleSLA
OnboardingArrival of a new staff memberHR / People Operations + GRC / ComplianceBefore technical access

Useful links.
Technical Onboarding Checklist
Training Tracks by Role and Risk
Roles and Responsibilities


US-12 - Knowledge Validation via Structured Quizzes​

Context. Training without validation of knowledge retention is ineffective. Structured quizzes ensure real understanding and act as objective traceability.

User Story

Story.
As an AppSec Engineer / HR, I want to implement and run validation quizzes (post-onboarding, continuous, by role) so that knowledge retention is ensured and an auditable record of competence is created.

Acceptance criteria (BDD).

  • Given that a staff member completes training
    When the quiz is administered
    Then a result ≥ 80% is obtained
  • And the record (score, date, validator) is archived
  • And technical access is only unblocked with a pass result

Checklist.

  • Quizzes defined by training track (onboarding, continuous, role)
  • Questions adapted to the real content of the Manual and the application
  • Accessible format (LMS, form, online tool, paper)
  • Minimum pass mark defined (e.g. 80%)
  • Immediate feedback with explanations of answers
  • Record with timestamp, name, result and validator
  • Periodic refresher (e.g. annual or on a new-risk trigger)
  • Applicable to internal staff, suppliers and third parties with access

Artefacts & evidence.

  • Quiz templates by track and role
  • Submission records with results
  • Trend analysis (pass rate, most-failed topics)

Proportionality L1–L3.

L1L2L3
One-off (onboarding)Periodic (annual)Periodic + adaptive (on trigger)

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Onboarding / ContinuousTrack completion or annuallyAppSec Engineer + HR / People OperationsBefore/during access

Useful links.
Quiz Template for Onboarding
Validation Quiz for Third Parties
Training Catalogue by Technical Profile
Roles and Responsibilities


US-13 - Operationalising Third-Party Training​

Context. Suppliers and third parties with technical access need mandatory minimum training to reduce the risk of security failures.

User Story

Story.
As GRC / Executive Management, I want to ensure that suppliers and third parties with access receive mandatory minimum training, so that the risk of security failures through lack of knowledge is reduced and regulatory obligations (NIS2, DORA) are met.

Acceptance criteria (BDD).

  • Given that a supplier with technical access is onboarded
    When access is established
    Then they complete a mandatory training track (e.g. the organisation's policy, support channels, minimum requirements)
  • And the certification is recorded contractually
  • And access is blocked until completion

Checklist.

  • Categorisation of third parties (access level, data sensitivity)
  • Minimum track defined per category
  • Quiz or practical validation with a result ≥ 80%
  • Certificate issued and archived
  • Compliance record in GRC
  • Access conditional on completion
  • Quarterly or annual refresher

Artefacts & evidence.

  • Tracks by third-party category (as per addon/21)
  • Validation quizzes and templates (as per addon/22)
  • Certificates and completion records
  • Contractual compliance record

Proportionality L1–L3.

L1L2L3
Mandatory (minimum track)MandatoryMandatory + annual

Integration into the SDLC.

PhaseTriggerResponsibleSLA
OnboardingSupplier contractGRC / Compliance + HR / People Operations + AppSec EngineerBefore access

Useful links.
Model for the Inclusion of Third Parties
Training Plan for Third Parties
Validation Quiz for Third Parties
Governance and Contracting - Chapter 14
Roles and Responsibilities

US-14 - Upskilling KPIs and Reporting (GRC)​

Context. Scattered KPIs reduce the ability to assess the impact of training. It is necessary to formalise the list, owners and cadence.

User Story

Story. As GRC / Executive Management, I want to define and collect upskilling KPIs (completion rate, pass rate, effectiveness in audit, MTTR in exercises), so that impact is assessed and compliance is reported.

Acceptance criteria (BDD).

  • Given a defined training cycle When the metrics are collected Then the KPIs are reported to the dashboard and sent quarterly to Executive Management

Checklist.

  • List of KPIs defined (e.g. completion rate, pass rate ≥80%, % of failed topics, average time to complete labs)
  • Owner defined (GRC owner)
  • Collection and reporting cadence defined (monthly/quarterly)
  • Automated dashboard or report configured (e.g. PowerBI/Looker/Grafana)
  • Evidence archived for audit (CSV/PDF report)

Artefacts & evidence. KPIs_formacao.md document with definition, owner, cadence; sample CSV export; link to the dashboard.

Proportionality L1–L3.

L1L2L3
Annual KPIsQuarterly KPIs with targetsQuarterly KPIs + targets per track and practical audit

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Audit/TrainingMonthly/QuarterlyGRC / Compliance + AppSec EngineerQuarterly report

US-15 - Delivery Formats and DoD per Format​

Context. The lack of a minimum specification per format (labs, code clinics, microlearning, simulations) hinders replicability and quality levels.

User Story

Story. As an AppSec Engineer / HR, I want to define the delivery formats and the minimum DoD per format (labs, code clinics, microlearning, quizzes, simulations), so that consistency and quality in training are ensured.

Acceptance criteria (BDD).

  • Given a chosen format (e.g. lab) When the session is planned Then there is a minimum DoD (infra + scenario + scoring + record) and associated artefacts

Checklist / DoD per format.

  • Labs: provisioned infra + vulnerable app (or VM) + exercise guide + automatic/manual scoring + logs and report
  • Code clinics: selected PRs + checklist applied + recording/summary + lessons-learned package
  • Microlearning: micro-modules ≤15min + quiz of 3–5 questions + reference material
  • Simulations: scripted scenario + updated playbook + debrief with MTTD/MTTR and improvements
  • Quizzes: template per track + threshold (e.g. ≥80%) + timestamped record

Artefacts & evidence. Examples: lab_template.md, code_clinic_template.md, microlearning_manifest.csv, simulation_script.yaml.

Proportionality L1–L3.

L1L2L3
Basic formats (microlearning)Structured labs and quizzesLabs with scoring + simulations + audit

Integration into the SDLC.

PhaseTriggerResponsibleSLA
PlanningPlanning of a session in a chosen formatAppSec Engineer / HRMinimum DoD and associated artefacts defined at planning

US-16 - Remediation Path Below the Threshold​

A result below the minimum threshold cannot leave onboarding in an undefined state.

Context. TRN-003 requires results below the acceptance threshold to have a defined remediation path. Without that path, a staff member who fails the validation is left in limbo: access is neither blocked in a traceable way, nor is there a clear route to recover the competence. Operationalising remediation closes the cycle between objective validation and the unblocking of access.

User Story

Story.
As an AppSec Engineer / HR, I want to define and execute a remediation path for those who fall below the validation threshold, so that it is ensured that failing has an operational consequence and a traceable recovery route, with no technical access until a pass.

Acceptance criteria (BDD).

  • Given a staff member who obtains a result below the minimum threshold in the onboarding validation
    When the result is recorded
    Then a remediation plan (targeted retraining + new validation) is triggered automatically and technical access remains blocked until a pass

Checklist.

  • Minimum pass threshold documented and versioned alongside the content
  • Remediation plan defined per track (retraining targeted at the failed topics)
  • Maximum number of attempts and escalation to AppSec/management once exhausted
  • Technical access blocked until a new validation is passed (enforcement of TRN-004)
  • Record of the failure, the remediation and the reassessment traceable to the staff member and to the content version

Artefacts & evidence. Record of results (score, date, validator, content version); remediation plan per failed topic; record of access blocking until re-approval; trail of attempts and escalations.

Proportionality L1–L3.

L1L2L3
Defined remediation (retraining + new attempt) + technical access blocked until approvalDocumented remediation plan + access blockFormal plan + attempt limit + escalation to AppSec and audit

Integration into the SDLC.

PhaseTriggerResponsibleSLA
OnboardingResult below the thresholdAppSec Engineer + HR / People OperationsRemediation started before any granting of access

Useful links. Training Requirements Catalogue (TRN-003)
Technical Onboarding Checklist
Roles and Responsibilities


US-17 - Third-Party Responsibility Statement​

The onboarding of a third party is only complete when responsibility has been formally accepted and recorded.

Context. TRN-007 requires the onboarding of third parties and contractors to include a responsibility statement and a formal record (name, entity, date, validator). Training on its own is not binding: without explicit acceptance of the security obligations and without an auditable record, there is no evidence that the third party has taken on the commitment proportional to its access profile. This statement is the piece that makes the onboarding of third parties equivalent — and not merely similar — to that of internal staff.

User Story

Story.
As GRC / Executive Management, I want to record a responsibility statement signed by each third party with technical access, so that the third party is formally bound to the security obligations and auditable evidence is created that conditions access (NIS2, DORA).

Acceptance criteria (BDD).

  • Given a third party or contractor with access to code, pipelines or sensitive data
    When they complete the security onboarding
    Then they sign a responsibility statement and the record (name, entity, date, validator, access profile) is archived before access is granted

Checklist.

  • Responsibility statement defined per access profile (proportional)
  • Minimum fields of the record: name, entity, date, validator, access scope
  • Signature (digital or contractual) collected before access is granted
  • Record archived in a traceable institutional repository
  • Link to the contract/GRC compliance (NIS2, DORA)
  • Access blocked in the absence of a valid statement

Artefacts & evidence. Responsibility statement signed by the third party; formal record with minimum fields (name, entity, date, validator); contractual link in GRC; evidence of access blocking without a statement.

Proportionality L1–L3.

L1L2L3
Simple statement + recordStatement per profile + traceable archiveStatement per profile + contractual binding + periodic audit

Integration into the SDLC.

PhaseTriggerResponsibleSLA
OnboardingContract with a third party with technical accessGRC / Compliance + HR / People Operations + AppSec EngineerStatement recorded before access

Useful links. Training Requirements Catalogue (TRN-007)
Model for the Inclusion of Third Parties
Training Plan for Third Parties
Roles and Responsibilities


US-18 - Corrective Action on KPI Deviations​

KPIs without corrective action are decorative metrics.

Context. TRN-009 requires deviations of training KPIs from defined thresholds to generate corrective action with an owner and a deadline. US-14 defines and collects the KPIs, but collection does not close the cycle: what is missing is the mechanism that turns a deviation (e.g. onboarding coverage below target, a falling pass rate) into an actionable and traceable decision. This US operationalises the triggering, not the definition of the indicators.

User Story

Story.
As GRC / Executive Management, I want to trigger a corrective action whenever a training KPI deviates from the threshold, so that it is ensured that the indicators produce decisions with an owner and a deadline, and not just reports.

Acceptance criteria (BDD).

  • Given a training KPI with a defined threshold
    When periodic collection reveals a deviation from the threshold
    Then a corrective action is opened with an owner and a deadline, recorded and followed up until closure

Checklist.

  • Explicit threshold per KPI (onboarding coverage, pass rate, average time, content updating)
  • Triggering rule documented (deviation → corrective action)
  • Corrective action with a named owner and a defined deadline
  • Follow-up until closure recorded (status, evidence of resolution)
  • Deviations and actions reported to Executive Management in the reporting cycle

Artefacts & evidence. Record of deviations from thresholds; corrective actions with owner and deadline; follow-up trail until closure; deviations section in the quarterly report to Executive Management.

Proportionality L1–L3.

L1L2L3
Informal review of deviationsCorrective action with owner and deadline recordedCorrective action + follow-up until closure + reporting and audit

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Audit/TrainingKPI deviation from the thresholdGRC / Compliance + AppSec EngineerAction opened in the collection cycle; closure within the defined deadline

Useful links. Training Requirements Catalogue (TRN-009)
Training KPIs and Metrics
Roles and Responsibilities


US-19 - Training in the Secure Use of AI and Tooling​

Tools assist; humans decide. Training has to teach where the boundary lies.

Context. With the pervasive adoption of code assistants, code/test generators, SAST/DAST/SCA and SOAR, it is critical that training covers when to trust vs. when to validate the outputs. Addon/12 defines the content by technical chapter — anti-patterns (accepting generated code without reading it, tests that merely "prove" the implementation, blind trust in alerts), the limits of automation (guardrails) and the principle that non-deterministic automation always requires validation. What is missing is a US that makes this training mandatory and verifiable.

User Story

Story.
As an AppSec Engineer / HR, I want to make training in the secure use of AI and tooling mandatory and verifiable, so that vulnerabilities from unreviewed generated code, tautological tests and automated decisions without governance in non-deterministic contexts are prevented.

Acceptance criteria (BDD).

  • Given a staff member with access to code assistants, generators or pipeline/SOAR automation
    When they complete the training track for their profile
    Then it includes the module on the secure use of AI/tooling (when to trust vs. validate, guardrails, validation of generated code and tests) with a passed objective validation

Checklist.

  • Module on the secure use of AI/tooling included in the track per profile (Developer, QA, DevOps, AppSec, IR/Ops, Management)
  • Content covers anti-patterns, guardrails and validation of outputs (code and tests) from addon/12
  • Practical labs: identify vulnerabilities in generated code and tautological tests
  • Objective validation (quiz ≥ threshold) specific to the module
  • Secure prompt engineering (explicit security requirements) covered
  • Content review annually or on a new-risk trigger

Artefacts & evidence. AI/tooling modules per profile; completion and validation records in the LMS; lab outputs (vulnerabilities and tautological tests identified); version of the training content.

Proportionality L1–L3.

L1L2L3
Microlearning on principles (assisting vs. deciding)Module per profile + labs + quiz (≥ half-yearly)Module per profile + advanced labs + adaptive validation (≥ quarterly)

Integration into the SDLC.

PhaseTriggerResponsibleSLA
Onboarding / Continuous cycleAccess to AI/automation tooling or new riskAppSec Engineer + HR / People OperationsBefore autonomous use of AI tooling

Useful links. Training in the Secure Use of AI and Tooling
Training Catalogue by Technical Profile
Roles and Responsibilities


US-20 - Isolated Sandbox for Contractor Practice​

Contractors practise in an isolated environment before touching real systems.

Context. The sandbox preparation guide (addon/13) defines an isolated, controlled and ephemeral environment in which contractors practise security tools and procedures before production access — with read-only initial permissions, network isolation from production, logging of all activity, validation through exercises (≥70%) and a quiz (≥80%), and destruction after onboarding. What is missing is a US that makes this sandbox a verifiable step of the contractor track, with a sign-off that conditions real access.

User Story

Story.
As a DevOps / AppSec Engineer, I want to provision and operate an isolated sandbox for contractor practice before access to real systems, so that the risk of error in production is reduced and understanding of policies is validated empirically before access is granted.

Acceptance criteria (BDD).

  • Given a contractor in technical onboarding
    When the sandbox is provisioned
    Then the contractor practises in an environment isolated from production (initially read-only, logging active) and real access is only granted after exercises (≥70%), a quiz (≥80%) and sign-off

Checklist.

  • Sandbox provisioned per profile (Developer, DevOps, QA) with a demonstration app
  • Network isolation from production and resource limits applied
  • Read-only initial permissions, evolving only after validation
  • Logging of all activity (logins, commits, access to secrets) enabled
  • Practical exercises (≥70%) and comprehension quiz (≥80%) completed
  • Completion sign-off (Tech Lead + AppSec) conditions real access
  • Sandbox destroyed and credentials revoked after onboarding; logs archived

Artefacts & evidence. Sandbox infrastructure definition (repos, namespace, IaC); activity logging records; exercise and quiz results; signed completion sign-off; evidence of destruction and revocation after onboarding.

Proportionality L1–L3.

L1L2L3
Optional simple sandboxIsolated sandbox per profile + exercises + quizIsolated sandbox + audited logging + formal sign-off + traceable destruction

Integration into the SDLC.

PhaseTriggerResponsibleSLA
OnboardingTechnical onboarding of a contractorDevOps / SRE + AppSec Engineer + Training ManagerProvisioning T-5 days; sign-off before real access (T+7)

Useful links. Sandbox Preparation Guide for Contractors
Model for the Inclusion of Third Parties
Governance and Contracting - Chapter 14
Roles and Responsibilities


📦 Expected artefacts​

ArtefactEvidence
LMS certificatesOnboarding completed
LMS reportsContinuous training
Champion recordsMeetings + feedback
Exercise logsResults and metrics
GRC reportsKPIs and effectiveness
Repository of exemplary PRsRecorded code clinics
Threat modelling diagramsMinutes and risk matrix
Simulation scenarios and logsDebrief reports and playbooks
Tracks document with changelogChampions survey + feedback
Validated onboarding checklistFormal records per staff member
Quiz recordsScores, dates and validators
Third-party certificatesGRC contractual compliance records

⚖️ L1–L3 proportionality matrix​

PracticeL1L2L3
Secure onboardingMandatory (basic content)MandatoryMandatory + practical assessment
Continuous trainingAnnualHalf-yearlyQuarterly
ChampionsOptionalRecommendedMandatory
Practical exercisesOptionalRecommendedMandatory
Effectiveness metricsBasicAnnualQuarterly with targets
Code ClinicsOccasionalRecurring (fortnightly)Recurring + rotating (weekly)
Threat ModellingOptionalMandatory for architectural changes (peer-led recommended per epic)Mandatory before design
Incident simulationsAnnual (minimum)Half-yearly (minimum)Half-yearly (minimum) + rotating
Track maintenanceOccasionalAnnual + per triggerAnnual + continuous on trigger
Tracks proportional to riskBasic trackIntermediate track + labsAdvanced track + simulations + audit
Onboarding validation (checklist)BasicStructured (role + risk)Structured + periodic audit
Knowledge validation (quizzes)One-offPeriodic (annual)Periodic + adaptive
Third-party trainingMandatory (minimum track)MandatoryMandatory + annual

🏁 Final recommendations​

  • Onboarding is critical: without initial training, basic errors propagate.
  • Formal validation via checklist ensures that all the minimum steps are completed.
  • Structured quizzes validate knowledge retention in an auditable way.
  • Continuous training keeps practices up to date.
  • Champions create a security culture within teams.
  • Practical exercises increase retention and readiness.
  • Structured Code Clinics ensure visible and replicable learning.
  • Peer-led Threat Modelling distributes risk analysis knowledge.
  • Incident simulations train response under pressure and validate processes.
  • Periodic maintenance of tracks ensures the continuing relevance of training.
  • Tracks proportional to risk ensure training is suited to context.
  • Third-party training reduces the risk of failures through lack of knowledge and meets regulatory obligations.
  • KPI measurement ensures continuous improvement and a link to organisational objectives.