26 Sep 2024
Fully Funded 4-year Doctoral Studentship Joint with the Oxford Martin AI Governance Initiative and the EPSRC CDT in Autonomous Intelligent Machines & Systems (AIMS)
Fully Funded 4-year Doctoral Studentship
Joint with the Oxford Martin AI Governance Initiative and the EPSRC CDT in Autonomous Intelligent Machines & Systems (AIMS)
Note: This studentship is fully funded.
Supervisor(s): Professor Michael Osborne
Start Date: October 2025
Autonomous systems powered by artificial intelligence will have a transformative impact on economy, industry and society as a whole. Our mission is to train cohorts with both theoretical, practical and systems skills in autonomous systems - comprising machine learning, robotics, sensor systems and verification- and a deep understanding of the cross-disciplinary requirements of these domains. Industrial partnerships have been and will continue to be at the heart of AIMS, shaping its training and ensuring the delivery of Oxford’s world-leading research in autonomous systems to a wide variety of sectors, including smart health, transport, finance, energy and extreme environments. Given the broad importance of autonomous systems, AIMS provides training on the ethical, governance, economic and societal implications of autonomous systems. For more information regarding the AIMS programme, see our web pages at: aims.robots.ox.ac.uk.
Title
Advancing Technical AI Governance and Safety
Abstract
This DPhil project aims to address problems within the emerging fields of technical AI governance and safety, building upon the foundational work of Reuel et al. (2024) in their survey "Open Problems in Technical AI Governance." The research will focus on three critical areas: identifying key intervention points in AI development and deployment, assessing the efficacy of potential governance actions, and enhancing governance options through novel technical mechanisms. Specific technical challenges to be addressed include developing robust methods for detecting and mitigating data bias, creating verifiable computation techniques for AI model training, designing privacy-preserving methods for external auditing of AI systems, and formulating technical approaches to ensure AI safety throughout the development pipeline.
The project's expected outcomes include an expanded taxonomy of technical AI governance and safety challenges, novel algorithmic approaches for monitoring and enforcing AI safety standards, and case studies demonstrating the real-world application of these governance tools. By bridging the gap between technical AI development, safety research, and policy-making, this research aims to contribute significantly to the responsible advancement of AI technologies in society. The findings will provide valuable insights for AI researchers, safety experts, policymakers, and governance bodies, ultimately supporting the creation of more effective, safer, and technically informed AI governance frameworks.
This project will be affiliated with the Oxford Martin AI Governance Initiative, will be jointly supervised by a policy supervisor from the Initiative, and will contribute to the AIGI/Oxford safety and technical governance community.
References: Reuel, A., Bucknall, B., et al. (2024). Open Problems in Technical AI Governance, https://www.governance.ai/research-paper/open-problems-in-technical-ai-governance
Award Value
The studentship covers the full course fees plus a stipend (tax-free maintenance grant).
Eligibility
Prospective candidates will be judged according to how well they meet the following criteria:
· Applicants are normally expected to be predicted or have achieved a first-class or strong upper second-class undergraduate degree with honours (or equivalent international qualifications), as a minimum, in computer science, engineering, physics, mathematics, statistics or other related disciplines. A previous master's qualification is not required.
· Excellent English written and spoken communication skills
Candidates will also need to demonstrate a broad interest in some or all of the four AIMS themes:
· machine learning, as a unifying core
· robotics & vision
· cyber-physical systems (e.g. sensor networks)
· control & verification
The deadline for applying is Wednesday 29th January 2025. Candidates are therefore recommended to apply as soon as possible to and to inform wendy.adams@eng.ox.ac.uk when they have done so.
If you have any technical questions about the DPhil Studentship, please email wendy.adams@eng.ox.ac.uk
Please quote AIMS-AIGI-2025 in the studentship reference box.
aims.robots.ox.ac.uk
Further details and how to apply can be found here: Autonomous Intelligent Machines and Systems (EPSRC CDT) | University of Oxford