A
AIG Sentinel
Demo ยท Western Council
๐Ÿ‡ฆ๐Ÿ‡บ NSW LG ยท v1
โ† Back to marketing site
BM
Bob Millward
Governance Lead

AI Risk Register

Top AI risks mapped to each use case โ€” with controls, residual ratings, owners and review dates.

Open risks
6
of 10 total
Critical inherent
1
Pre-control rating
High inherent
4
Pre-control rating
Reduced to Low residual
4
Controls effective
R-001PrivacyOpen

Resident PII leakage via shadow ChatGPT

Staff pasting resident-identifying information into personal ChatGPT accounts. Data may be used for model training, retained indefinitely, breach NSW PPIPA.

InherentCritical
ResidualMedium
Controls in place
  • โœ“M365 DLP block on personal ChatGPT domains
  • โœ“Sanctioned Copilot path under UC-001
  • โœ“Mandatory training before re-enable
Owner
Privacy Officer
Next review
2026-08-22
Linked use cases
UC-004
R-002OperationalOpen

False-positive pipe failure predictions trigger unnecessary works

Predictive maintenance model on water mains flags pipes for replacement that don't actually need it. Direct financial impact and resident disruption from unnecessary digs.

InherentHigh
ResidualMedium
Controls in place
  • โœ“Human-in-loop required for any pipe-replacement spend > $25k
  • โœ“FP rate threshold: must remain < 15%
  • โœ“Monthly review by Water & Infra
Owner
Linda Park
Next review
2026-06-25
Linked use cases
UC-002
R-003Legal / RegulatoryOpen

Planning chatbot gives legally misleading advice

Chatbot answers planning enquiries from residents. Risk that hallucinated or out-of-date answers lead to non-compliant works, complaints, or Council liability.

InherentHigh
ResidualMedium
Controls in place
  • โœ“Disclaimer required on every response
  • โœ“Complex cases must route to human officer
  • โœ“Logged conversations reviewed weekly
Owner
Marcus Webb
Next review
2026-06-14
Linked use cases
UC-003
R-004Bias / FairnessOpen

Algorithmic bias in rates valuation anomaly detection

Model trained on historical valuations may encode geographic or demographic bias, flagging properties in certain suburbs disproportionately.

InherentHigh
ResidualMedium
Controls in place
  • โœ“All flags reviewed by valuer before notice issued
  • โœ“Quarterly fairness audit across suburb/postcode
  • โœ“Sensitive attributes (age, income) excluded from features
Owner
David Mwangi
Next review
2026-07-15
Linked use cases
UC-007
R-005Legal / RegulatoryOpen

DA summariser misses material detail in 200-page applications

LLM summary of development application omits a clause that an assessing officer would have caught. Resulting determination may be challengeable.

InherentHigh
ResidualLow
Controls in place
  • โœ“Summary clearly labelled 'AI-generated, not authoritative'
  • โœ“Officer must read full application for determinations
  • โœ“Random 10% sample audited by senior officer
Owner
Marcus Webb
Next review
2026-07-14
Linked use cases
UC-008
R-006Legal / RegulatoryOpen

Records Act 1998 non-compliance for transient AI outputs

Chatbot conversations, AI-drafted documents, and summariser outputs may constitute State Records that aren't being captured.

InherentMedium
ResidualMedium
Controls in place
  • โœ“Records retention policy update in progress (AG-07)
  • โœ“Auto-capture of chatbot transcripts to TRIM
  • โœ“Annual records audit
Owner
Records Officer
Next review
2026-08-15
Linked use cases
UC-001UC-003UC-008UC-010
R-007OperationalMitigated

Vendor product introduces AI feature without notification

Existing software vendor (e.g., M365, SirsiDynix) ships AI capability in an update. Council uses it without going through AIRC.

InherentMedium
ResidualLow
Controls in place
  • โœ“Quarterly vendor questionnaire (Q-2026-03)
  • โœ“Procurement screening update in progress (AG-09)
  • โœ“Vendor release notes monitored by ICT
Owner
James O'Connor
Next review
2026-08-12
Linked use cases
UC-001UC-006
R-008PrivacyMitigated

Roadside camera ML inadvertently captures faces / number plates

Despite design choice not to retain faces / plates, ML pipeline may briefly process them. Risk of PPIPA breach if data is logged or exported.

InherentMedium
ResidualLow
Controls in place
  • โœ“Vendor (RoadAI) blur applied at edge before upload
  • โœ“Quarterly sample audit by Privacy Officer
  • โœ“No raw imagery retained > 7 days
Owner
Linda Park
Next review
2026-08-20
Linked use cases
UC-005
R-009FinancialAccepted

AI vendor lock-in for critical operational systems

Roadside ML, waste optimisation, library recommender all depend on commercial vendors. Vendor exit could disrupt operations or trigger expensive migration.

InherentMedium
ResidualMedium
Controls in place
  • โœ“Data portability clause in all contracts (Procurement standard)
  • โœ“Annual exit-plan tabletop review
Owner
CIO
Next review
2026-10-30
Linked use cases
UC-005UC-006UC-011
R-010ReputationalMitigated

Reputational damage from public AI failure

Resident-facing AI (chatbot, transparency register) produces a high-profile incorrect or offensive output. Media coverage and trust loss.

InherentMedium
ResidualLow
Controls in place
  • โœ“AIRC sign-off required for all resident-facing AI
  • โœ“Communications team has incident response playbook
  • โœ“All public AI feeds the Transparency Register
Owner
Communications
Next review
2026-08-18
Linked use cases
UC-003UC-006