AI Safety Fund (AISF) Grants 2025 (up to $500,000) Deadline: 20 January, 2025

Applications are open for the AI Safety Fund (AISF) Grants 2025. The AI Safety Fund (AISF) awards grants to accelerate research efforts that identify potential safety threats that arise from the development and use of frontier AI models. As AI is increasingly applied across domains, they are looking to develop strategies to avoid negative outcomes through funding research to identify and assess risks and improve the safe deployment of AI for the benefit of society.

To further these goals, the AISF also seeks to support technical research for AI agent identity verification systems and AI agent safety evaluations. This funding aims to promote the safe and responsible development of AI agents while establishing robust frameworks for agent authentication and verification and synthetic media authentication. 

In this funding round, they are prioritizing three critical research areas: Biosecurity, Cybersecurity and AI Agent Evaluation & Synthetic Content.

Grant

• The AISF plans to fund research projects by academic labs, non-profits, independent researchers, and for-profit mission-driven entities across these topics. Proposed budgets should not exceed $500,000.

Eligibility

• The AISF makes grants for independent researchers affiliated with academic institutions, research institutions, NGOs, and social enterprises across the globe that aim to promote the safe and responsible development of frontier models by testing, evaluating, and/or addressing safety and security risks.
• The AISF seeks to fund research that accelerates the identification of threats posed by the development and use of AI to prevent widespread harm.
• Projects must focus on frontier AI models and their deployed versions.

Selection Criteria

All proposals will be reviewed based on these criteria:

• Impact to improve safety measures for deployed frontier AI models.
• Feasibility of the proposed research.
• Relevance of the proposed research for the field of AI safety.
• Peer Review and the research team’s approach to engaging the broader research community to provide feedback on the research findings.
• Technical qualifications of the research team, and relevance for the domain under which the application is submitted.
• Ethics of the research, and the specific safety protocols that will be employed to manage immediate and long-term risk implications of the research findings.
• Equity will be considered as a metric of how the research project will support advancing equity and diversity in the field.
• Accessibility of the research findings to promote transparency in the field. Researchers should also consider potential risk or harm that could result from research findings and provide justification for limiting access of the research findings.

Application

Application deadline for Biosecurity and Cybersecurity is January 20, 2025 and application deadline for AI Agent Evaluation & Synthetic Content is January 31, 2025.

Click here to apply

For more information, visit AISF Grant.