Publications

Check Google Scholar for latest publications

2026

Audit Trails for Accountability in Large Language Models
Victor Ojewale, Harini Suresh, Suresh Venkatasubramanian
arXiv preprint arXiv:2601.20727, 2026
[PDF]
Beyond Static Leaderboards: A Roadmap to Naturalistic, Functional Evaluation of LLMs
Victor Ojewale, Suresh Venkatasubramanian
Second Workshop on Language Models for Underserved Communities (LM4UC) at AAAI 2026
[PDF]

2025

Multi-lingual Functional Evaluation for Large Language Models
Victor Ojewale, Inioluwa Deborah Raji, Suresh Venkatasubramanian
arXiv preprint arXiv:2506.20793, 2025
[PDF]
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane & Inioluwa Deborah Raji
CHI, 2025
[PDF]

2024

AI Auditing: The Broken Bus on the Road to AI Accountability
Abeba Birhane, Ryan Steed, Victor Ojewale, Briana Vecchione & Inioluwa Deborah Raji
SaTML, 2024 (Distinguished Paper)
[PDF]
Comment on NIST–2023–0309
Inioluwa Deborah Raji, Abeba Birhane, Briana Vecchione, Ryan Steed & Victor Ojewale
NIST Request for Information (RFI)
[Link]

2023

Comment on NTIA-2023-0005
Inioluwa Deborah Raji, Briana Vecchione, Abeba Birhane, Ryan Steed & Victor Ojewale
NTIA AI Accountability Request for Comment
[Link]
Feedback on Data Access, Digital Services Act
Inioluwa Deborah Raji, Briana Vecchione, Abeba Birhane, Ryan Steed & Victor Ojewale
European Commission, Call for Evidence
[Link]