Into AI Safety Transistor (https://transistor.fm) https://feeds.transistor.fm/intoaisafety The Into AI Safety podcast aims to make it easier for everyone, regardless of background, to get meaningfully involved with the conversations surrounding the rules and regulations which should govern the research, development, deployment, and use of the technologies encompassed by the term "artificial intelligence" or "AI" For better formatted show notes, additional resources, and more, go to https://kairos.fm/intoaisafety/ © Kairos.fm afd4d964-588e-5677-aac8-ef1ce12e6510 yes Chase Precopia Jacob Haimes en-us Wed, 15 Apr 2026 04:35:07 -0600 Wed, 15 Apr 2026 04:39:43 -0600 https://kairos.fm/intoaisafety/ https://img.transistorcdn.com/t8Eetvpf3AgRbLLIjMLfZlGck8gh7daH1uKZWBFmlHI/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS8yOTE5/MTU3M2U5NDAzYjJk/OTcwZTc5NzNkYzE3/ZWFjNC5qcGVn.jpg Into AI Safety https://kairos.fm/intoaisafety/ episodic Jacob Haimes The Into AI Safety podcast aims to make it easier for everyone, regardless of background, to get meaningfully involved with the conversations surrounding the rules and regulations which should govern the research, development, deployment, and use of the technologies encompassed by the term "artificial intelligence" or "AI" For better formatted show notes, additional resources, and more, go to https://kairos.fm/intoaisafety/ The Into AI Safety podcast aims to make it easier for everyone, regardless of background, to get meaningfully involved with the conversations surrounding the rules and regulations which should govern the research, development, deployment, and use of the technologies encompassed by the term "artificial intelligence" or "AI" For better formatted show notes, additional resources, and more, go to https://kairos.fm/intoaisafety/. technology, AI, artificial intelligence, machine learning, safety Jacob Haimes listen@kairos.fm No No Drawing Red Lines w/ Su Cizem 29 29 Drawing Red Lines w/ Su Cizem full 9be72f75-c464-4f82-9d67-11fd2f08dd45 https://kairos.fm/intoaisafety/e029 Technology has been moving faster than policy for some time now, and the advent of AI isn't changing that, so what can we do to maintain safety despite uncertainty? Su Cizem has spent the last few years trying to answer that question. As an analyst at the Future Society, she works on global AI governance, specifically on building international consensus around AI red lines: the thresholds we collectively agree must never be crossed. In this conversation, Su walks through her path from philosophy to policy, the evolution of the global AI safety summit series, why voluntary commitments from AI labs aren't enough, and what it would actually take to make international cooperation on AI safety real.

Chapters

  • (00:00) - Introduction
  • (03:23) - From Philosophy to Policy
  • (22:25) - What AI Governance Actually Means
  • (26:49) - The Summit Series
  • (43:01) - Drawing The Red Lines
  • (01:10:51) - Can These Companies Govern Themselves?
  • (01:24:01) - Breaking Into The Field
  • (01:27:51) - Closing Thoughts & Outro

Critical Links
Below are the most important links for this episode. For more, visit the episode page on Kairos.fm.
  • Su's LinkedIn
  • Global Call for AI Red Lines
  • The Futures Society report - “Facing the Stakes of AI Together”: 2025 Athens Roundtable Report
  • Politico article - How the global effort to keep AI safe went off the rails
  • TechPolicy.Press article - A Timeline of the Anthropic-Pentagon Dispute
  • The Guardian article - AI got the blame for the Iran school bombing. The truth is far more worrying
  • Google and OpenAI Employee open letter - We Will Not Be Divided
  • The Register article - Altman said no to military AI abuses – then signed Pentagon deal anyway
  • SaferAI report - Evaluating AI Providers’ Frontier AI Safety Frameworks
]]> Technology has been moving faster than policy for some time now, and the advent of AI isn't changing that, so what can we do to maintain safety despite uncertainty? Su Cizem has spent the last few years trying to answer that question. As an analyst at the Future Society, she works on global AI governance, specifically on building international consensus around AI red lines: the thresholds we collectively agree must never be crossed. In this conversation, Su walks through her path from philosophy to policy, the evolution of the global AI safety summit series, why voluntary commitments from AI labs aren't enough, and what it would actually take to make international cooperation on AI safety real.

Chapters

  • (00:00) - Introduction
  • (03:23) - From Philosophy to Policy
  • (22:25) - What AI Governance Actually Means
  • (26:49) - The Summit Series
  • (43:01) - Drawing The Red Lines
  • (01:10:51) - Can These Companies Govern Themselves?
  • (01:24:01) - Breaking Into The Field
  • (01:27:51) - Closing Thoughts & Outro

Critical Links
Below are the most important links for this episode. For more, visit the episode page on Kairos.fm.
  • Su's LinkedIn
  • Global Call for AI Red Lines
  • The Futures Society report - “Facing the Stakes of AI Together”: 2025 Athens Roundtable Report
  • Politico article - How the global effort to keep AI safe went off the rails
  • TechPolicy.Press article - A Timeline of the Anthropic-Pentagon Dispute
  • The Guardian article - AI got the blame for the Iran school bombing. The truth is far more worrying
  • Google and OpenAI Employee open letter - We Will Not Be Divided
  • The Register article - Altman said no to military AI abuses – then signed Pentagon deal anyway
  • SaferAI report - Evaluating AI Providers’ Frontier AI Safety Frameworks
]]> Mon, 06 Apr 2026 10:30:00 -0600 Jacob Haimes Jacob Haimes 5507 Technology has been moving faster than policy for some time now, and the advent of AI isn't changing that, so what can we do to maintain safety despite uncertainty? Su Cizem has spent the last few years trying to answer that question. As an analyst at the Future Society, she works on global AI governance, specifically on building international consensus around AI red lines: the thresholds we collectively agree must never be crossed. In this conversation, Su walks through her path from philosophy to policy, the evolution of the global AI safety summit series, why voluntary commitments from AI labs aren't enough, and what it would actually take to make international cooperation on AI safety real.

Chapters

  • (00:00) - Introduction
  • (03:23) - From Philosophy to Policy
  • (22:25) - What AI Governance Actually Means
  • (26:49) - The Summit Series
  • (43:01) - Drawing The Red Lines
  • (01:10:51) - Can These Companies Govern Themselves?
  • (01:24:01) - Breaking Into The Field
  • (01:27:51) - Closing Thoughts & Outro

Critical Links
Below are the most important links for this episode. For more, visit the episode page on Kairos.fm.
  • Su's LinkedIn
  • Global Call for AI Red Lines
  • The Futures Society report - “Facing the Stakes of AI Together”: 2025 Athens Roundtable Report
  • Politico article - How the global effort to keep AI safe went off the rails
  • TechPolicy.Press article - A Timeline of the Anthropic-Pentagon Dispute
  • The Guardian article - AI got the blame for the Iran school bombing. The truth is far more worrying
  • Google and OpenAI Employee open letter - We Will Not Be Divided
  • The Register article - Altman said no to military AI abuses – then signed Pentagon deal anyway
  • SaferAI report - Evaluating AI Providers’ Frontier AI Safety Frameworks
]]> technology, AI, artificial intelligence, machine learning, safety No Chase Precopia Jacob Haimes Su Cizem Thinking Through "Digital Minds" w/ Jacy Reese-Anthis 28 28 Thinking Through "Digital Minds" w/ Jacy Reese-Anthis full ed8de43f-63ce-452c-818b-e19a3c429779 https://kairos.fm/intoaisafety/e028/ Jacy Reese-Anthis, founder of Sentience Institute and researcher at Stanford, began his journey working for animal welfare, but is now finishing up his PhD with research in many different AI subfields at the intersection of neuroscience, philosophy, social science, and machine learning. While this may seem like an odd jump at first, Jacy shares how his work has all been centered around the idea of moral circle expansion. In this episode, we dig into what sentience actually means (or at least how we can begin to think about it), why anthropomorphization is more complicated than it sounds, and how language models may be able to be leveraged as an effective tool for social science research.


Jacy also shares his median AGI estimate somewhere in there, so stay tuned if you want to catch it.

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.


Chapters

  • (00:00) - Introduction
  • (05:41) - From Animal Welfare to Digital Minds
  • (09:00) - Founding Sentience Institute
  • (22:00) - Defining Sentience
  • (27:13) - The Anthropomorphization Problem
  • (47:51) - Why "Digital Minds" (Not "Artificial Intelligence")
  • (51:05) - LLMs as Social Science Tools
  • (01:07:03) - Jacy’s AGI Timeline & The Singularity
  • (01:09:23) - Final Thoughts & Outro

Critical Links
Below are the most important links for this episode. For more, visit the episode page on Kairos.fm.
  • Jacy's website
  • Wikipedia article - Jacy Reese Anthis
  • Sentience Institute website
  • CHI paper - Digital Companionship: Overlapping Uses of AI Companions and AI Assistants
  • ICML paper - LLM Social Simulations Are a Promising Research Method
  • ACL paper - The Impossibility of Fair LLMs
  • Wikipedia article - ELIZA effect
  • The Atlantic article - How a Google Employee Fell for the Eliza Effect
]]> Jacy Reese-Anthis, founder of Sentience Institute and researcher at Stanford, began his journey working for animal welfare, but is now finishing up his PhD with research in many different AI subfields at the intersection of neuroscience, philosophy, social science, and machine learning. While this may seem like an odd jump at first, Jacy shares how his work has all been centered around the idea of moral circle expansion. In this episode, we dig into what sentience actually means (or at least how we can begin to think about it), why anthropomorphization is more complicated than it sounds, and how language models may be able to be leveraged as an effective tool for social science research.


Jacy also shares his median AGI estimate somewhere in there, so stay tuned if you want to catch it.

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.


Chapters

  • (00:00) - Introduction
  • (05:41) - From Animal Welfare to Digital Minds
  • (09:00) - Founding Sentience Institute
  • (22:00) - Defining Sentience
  • (27:13) - The Anthropomorphization Problem
  • (47:51) - Why "Digital Minds" (Not "Artificial Intelligence")
  • (51:05) - LLMs as Social Science Tools
  • (01:07:03) - Jacy’s AGI Timeline & The Singularity
  • (01:09:23) - Final Thoughts & Outro

Critical Links
Below are the most important links for this episode. For more, visit the episode page on Kairos.fm.
  • Jacy's website
  • Wikipedia article - Jacy Reese Anthis
  • Sentience Institute website
  • CHI paper - Digital Companionship: Overlapping Uses of AI Companions and AI Assistants
  • ICML paper - LLM Social Simulations Are a Promising Research Method
  • ACL paper - The Impossibility of Fair LLMs
  • Wikipedia article - ELIZA effect
  • The Atlantic article - How a Google Employee Fell for the Eliza Effect
]]> Mon, 09 Mar 2026 21:00:00 -0600 Jacob Haimes Jacob Haimes 4276 Jacy Reese-Anthis, founder of Sentience Institute and researcher at Stanford, began his journey working for animal welfare, but is now finishing up his PhD with research in many different AI subfields at the intersection of neuroscience, philosophy, social science, and machine learning. While this may seem like an odd jump at first, Jacy shares how his work has all been centered around the idea of moral circle expansion. In this episode, we dig into what sentience actually means (or at least how we can begin to think about it), why anthropomorphization is more complicated than it sounds, and how language models may be able to be leveraged as an effective tool for social science research.


Jacy also shares his median AGI estimate somewhere in there, so stay tuned if you want to catch it.

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.


Chapters

  • (00:00) - Introduction
  • (05:41) - From Animal Welfare to Digital Minds
  • (09:00) - Founding Sentience Institute
  • (22:00) - Defining Sentience
  • (27:13) - The Anthropomorphization Problem
  • (47:51) - Why "Digital Minds" (Not "Artificial Intelligence")
  • (51:05) - LLMs as Social Science Tools
  • (01:07:03) - Jacy’s AGI Timeline & The Singularity
  • (01:09:23) - Final Thoughts & Outro

Critical Links
Below are the most important links for this episode. For more, visit the episode page on Kairos.fm.
  • Jacy's website
  • Wikipedia article - Jacy Reese Anthis
  • Sentience Institute website
  • CHI paper - Digital Companionship: Overlapping Uses of AI Companions and AI Assistants
  • ICML paper - LLM Social Simulations Are a Promising Research Method
  • ACL paper - The Impossibility of Fair LLMs
  • Wikipedia article - ELIZA effect
  • The Atlantic article - How a Google Employee Fell for the Eliza Effect
]]> technology, AI, artificial intelligence, sentience, artificial sentience, artificial minds, AI anthropomorphization, digital minds, AI safety, AI welfare, AI companions, companion apps, perceptions of AI, sentience institute No Chase Precopia Jacob Haimes Jacy Reese-Anthis Scaling AI Safety Through Mentorship w/ Dr. Ryan Kidd 27 27 Scaling AI Safety Through Mentorship w/ Dr. Ryan Kidd full 8fb864c3-29d4-4c26-b672-b9eb4710165c https://kairos.fm/intoaisafety/e027 What does it actually take to build a successful AI safety organization? I'm joined by Dr. Ryan Kidd, who has co-led MATS from a small pilot program to one of the field's premier talent pipelines. In this episode, he reveals the low-hanging fruit in AI safety field-building that most people are missing: the amplifier archetype.

I pushed Ryan on some hard questions, from balancing funder priorities and research independence, to building a robust selection process for both mentors and participants. Whether you're considering a career pivot into AI safety or already working in the field, this conversation offers practical advice on how to actually make an impact.

Chapters

  • (00:00) - - Intro
  • (08:16) - - Building MATS Post-FTX & Summer of Love
  • (13:09) - - Balancing Funder Priorities and Research Independence
  • (19:44) - - The MATS Selection Process
  • (33:15) - - Talent Archetypes in AI Safety
  • (50:22) - - Comparative Advantage and Career Capital in AI Safety
  • (01:04:35) - - Building the AI Safety Ecosystem
  • (01:15:28) - - What Makes a Great AI Safety Amplifier
  • (01:21:44) - - Lightning Round Questions
  • (01:30:30) - - Final Thoughts & Outro

Links

Ryan's Writing

  • LessWrong post - Talent needs of technical AI safety teams
  • LessWrong post - AI safety undervalues founders
  • LessWrong comment - Comment permalink with 2025 MATS program details
  • LessWrong post - Talk: AI Safety Fieldbuilding at MATS
  • LessWrong post - MATS Mentor Selection
  • LessWrong post - Why I funded PIBBSS
  • EA Forum post - How MATS addresses mass movement building concerns

FTX Funding of AI Safety

  • LessWrong blogpost - An Overview of the AI Safety Funding Situation
  • Fortune article - Why Sam Bankman-Fried’s FTX debacle is roiling A.I. research
  • NY Times article - FTX probes $6.5M in payments to AI safety group amid clawback crusade
  • Cointelegraph article - FTX probes $6.5M in payments to AI safety group amid clawback crusade
  • FTX Future Fund article - Future Fund June 2022 Update (archive)
  • Tracxn page - Anthropic Funding and Investors

Training & Support Programs

Funding Organizations

Coworking Spaces

Research Organizations & Startups

Other Sources

  • AXRP website - The AI X-risk Research Podcast
  • LessWrong blogpost - Shard Theory: An Overview
]]> What does it actually take to build a successful AI safety organization? I'm joined by Dr. Ryan Kidd, who has co-led MATS from a small pilot program to one of the field's premier talent pipelines. In this episode, he reveals the low-hanging fruit in AI safety field-building that most people are missing: the amplifier archetype.

I pushed Ryan on some hard questions, from balancing funder priorities and research independence, to building a robust selection process for both mentors and participants. Whether you're considering a career pivot into AI safety or already working in the field, this conversation offers practical advice on how to actually make an impact.

Chapters

  • (00:00) - - Intro
  • (08:16) - - Building MATS Post-FTX & Summer of Love
  • (13:09) - - Balancing Funder Priorities and Research Independence
  • (19:44) - - The MATS Selection Process
  • (33:15) - - Talent Archetypes in AI Safety
  • (50:22) - - Comparative Advantage and Career Capital in AI Safety
  • (01:04:35) - - Building the AI Safety Ecosystem
  • (01:15:28) - - What Makes a Great AI Safety Amplifier
  • (01:21:44) - - Lightning Round Questions
  • (01:30:30) - - Final Thoughts & Outro

Links

Ryan's Writing

  • LessWrong post - Talent needs of technical AI safety teams
  • LessWrong post - AI safety undervalues founders
  • LessWrong comment - Comment permalink with 2025 MATS program details
  • LessWrong post - Talk: AI Safety Fieldbuilding at MATS
  • LessWrong post - MATS Mentor Selection
  • LessWrong post - Why I funded PIBBSS
  • EA Forum post - How MATS addresses mass movement building concerns

FTX Funding of AI Safety

  • LessWrong blogpost - An Overview of the AI Safety Funding Situation
  • Fortune article - Why Sam Bankman-Fried’s FTX debacle is roiling A.I. research
  • NY Times article - FTX probes $6.5M in payments to AI safety group amid clawback crusade
  • Cointelegraph article - FTX probes $6.5M in payments to AI safety group amid clawback crusade
  • FTX Future Fund article - Future Fund June 2022 Update (archive)
  • Tracxn page - Anthropic Funding and Investors

Training & Support Programs

Funding Organizations

Coworking Spaces

Research Organizations & Startups

Other Sources

  • AXRP website - The AI X-risk Research Podcast
  • LessWrong blogpost - Shard Theory: An Overview
]]> Mon, 02 Feb 2026 14:00:00 -0700 Jacob Haimes Jacob Haimes 5496 What does it actually take to build a successful AI safety organization? I'm joined by Dr. Ryan Kidd, who has co-led MATS from a small pilot program to one of the field's premier talent pipelines. In this episode, he reveals the low-hanging fruit in AI safety field-building that most people are missing: the amplifier archetype.

I pushed Ryan on some hard questions, from balancing funder priorities and research independence, to building a robust selection process for both mentors and participants. Whether you're considering a career pivot into AI safety or already working in the field, this conversation offers practical advice on how to actually make an impact.

Chapters

  • (00:00) - - Intro
  • (08:16) - - Building MATS Post-FTX & Summer of Love
  • (13:09) - - Balancing Funder Priorities and Research Independence
  • (19:44) - - The MATS Selection Process
  • (33:15) - - Talent Archetypes in AI Safety
  • (50:22) - - Comparative Advantage and Career Capital in AI Safety
  • (01:04:35) - - Building the AI Safety Ecosystem
  • (01:15:28) - - What Makes a Great AI Safety Amplifier
  • (01:21:44) - - Lightning Round Questions
  • (01:30:30) - - Final Thoughts & Outro

Links

Ryan's Writing

  • LessWrong post - Talent needs of technical AI safety teams
  • LessWrong post - AI safety undervalues founders
  • LessWrong comment - Comment permalink with 2025 MATS program details
  • LessWrong post - Talk: AI Safety Fieldbuilding at MATS
  • LessWrong post - MATS Mentor Selection
  • LessWrong post - Why I funded PIBBSS
  • EA Forum post - How MATS addresses mass movement building concerns

FTX Funding of AI Safety

  • LessWrong blogpost - An Overview of the AI Safety Funding Situation
  • Fortune article - Why Sam Bankman-Fried’s FTX debacle is roiling A.I. research
  • NY Times article - FTX probes $6.5M in payments to AI safety group amid clawback crusade
  • Cointelegraph article - FTX probes $6.5M in payments to AI safety group amid clawback crusade
  • FTX Future Fund article - Future Fund June 2022 Update (archive)
  • Tracxn page - Anthropic Funding and Investors

Training & Support Programs

Funding Organizations

Coworking Spaces

Research Organizations & Startups

Other Sources

  • AXRP website - The AI X-risk Research Podcast
  • LessWrong blogpost - Shard Theory: An Overview
]]> artificial intelligence, technology, AI, AI safety, AI safety field-building, field building, mentorship, MATS, machine learning alignment and theory scholars, Ryan Kidd, AI security, upskilling, AI upskilling, Fellowship programs, AI fellowships, Open Philanthropy, Coefficient Giving, AI risk, AI safety research, SERI-MATS No Chase Precopia Jacob Haimes Dr. Ryan Kidd Sobering Up on AI Progress w/ Dr. Sean McGregor 26 26 Sobering Up on AI Progress w/ Dr. Sean McGregor full b4b58807-63b7-4986-879e-8571ede6dc17 https://kairos.fm/intoaisafety/e026/ Sean McGregor and I discuss about why evaluating AI systems has become so difficult; we cover everything from the breakdown of benchmarking, how incentives shape safety work, and what approaches like BenchRisk (his recent paper at NeurIPS) and AI auditing aim to fix as systems move into the real world. We also talk about his history and journey in AI safety, including his PhD on ML for public policy, how he started the AI Incident Database, and what he's working on now: AVERI, a non-profit for frontier model auditing.

Chapters

  • (00:00) - Intro
  • (02:36) - What's broken about benchmarking
  • (03:41) - Sean’s wild PhD
  • (14:28) - The phantom internship
  • (19:25) - Sean's journey
  • (22:25) - Market-vs-regulatory modes and AIID
  • (32:13) - Drunk on AI progress
  • (38:34) - BenchRisk
  • (43:20) - Moral hazards and Master Hand
  • (50:34) - Liability, Section 230, and open source
  • (59:20) - AVERI
  • (01:11:30) - Closing thoughts & outro

Links

BenchRisk

  • BenchRisk website
  • NeurIPS paper - Risk Management for Mitigating Benchmark Failure Modes: BenchRisk
  • NeurIPS paper - AI and the Everything in the Whole Wide World Benchmark

AIID

  • AI Incident Database website
  • IAAI paper - Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database
  • Preprint - Lessons for Editors of AI Incidents from the AI Incident Database
  • AIAAIC website (another incident tracker)

Hot AI Summer

  • CACM article - A Few Useful Things to Know About Machine Learning
  • CACM article - How the AI Boom Went Bust
  • Undergraduate Thesis - Analyzing the Prospect of an Approaching AI Winter
  • Tech Genies article - AI History: The First Summer and Winter of AI
  • CACM article - There Was No ‘First AI Winter’

Measuring Generalization

  • Neural Computation article - The Lack of A Priori Distinctions Between Learning Algorithms
  • ICLR paper - Understanding deep learning requires rethinking generalization
  • ICML paper - Model-agnostic Measure of Generalization Difficulty
  • Radiology Artificial Intelligence article - Generalizability of Machine Learning Models: Quantitative Evaluation of Three Methodological Pitfalls
  • Preprint - Quantifying Generalization Complexity for Large Language Models

Insurers Exclude AI

  • Financial Times article - Insurers retreat from AI cover as risk of multibillion-dollar claims mount
  • Tom's Hardware article - Major insurers move to avoid liability for AI lawsuits as multi-billion dollar risks emerge — Recent public incidents have lead to costly repercussions
  • Insurance Newsnet article - Insurers Scale Back AI Coverage Amid Fears of Billion-Dollar Claims
  • Insurance Business article - Insurance’s gen AI reckoning has come

Section 230

  • Section 230 overview
  • Legal sidebar - Section 230 Immunity and Generative Artificial Intelligence
  • Bad Internet Bills website
  • TechDirt article - Section 230 Faces Repeal. Support The Coverage That’s Been Getting It Right All Along.
  • Privacy Guides video - Dissecting Bad Internet Bills with Taylor Lorenz: KOSA, SCREEN Act, Section 230
  • Journal of Technology in Behavioral Health article - Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice
  • Time article - Lawmakers Unveil New Bills to Curb Big Tech’s Power and Profit
  • House Hearing transcript - Legislative Solutions to Protect Children and Teens Online

Relevant Kairos.fm Episodes

  • Into AI Safety episode - Growing BlueDot's Impact w/ Li-Lian Ang
  • muckrAIkers episode - NeurIPS 2024 Wrapped 🌯

Other Links

]]> Sean McGregor and I discuss about why evaluating AI systems has become so difficult; we cover everything from the breakdown of benchmarking, how incentives shape safety work, and what approaches like BenchRisk (his recent paper at NeurIPS) and AI auditing aim to fix as systems move into the real world. We also talk about his history and journey in AI safety, including his PhD on ML for public policy, how he started the AI Incident Database, and what he's working on now: AVERI, a non-profit for frontier model auditing.

Chapters

  • (00:00) - Intro
  • (02:36) - What's broken about benchmarking
  • (03:41) - Sean’s wild PhD
  • (14:28) - The phantom internship
  • (19:25) - Sean's journey
  • (22:25) - Market-vs-regulatory modes and AIID
  • (32:13) - Drunk on AI progress
  • (38:34) - BenchRisk
  • (43:20) - Moral hazards and Master Hand
  • (50:34) - Liability, Section 230, and open source
  • (59:20) - AVERI
  • (01:11:30) - Closing thoughts & outro

Links

BenchRisk

  • BenchRisk website
  • NeurIPS paper - Risk Management for Mitigating Benchmark Failure Modes: BenchRisk
  • NeurIPS paper - AI and the Everything in the Whole Wide World Benchmark

AIID

  • AI Incident Database website
  • IAAI paper - Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database
  • Preprint - Lessons for Editors of AI Incidents from the AI Incident Database
  • AIAAIC website (another incident tracker)

Hot AI Summer

  • CACM article - A Few Useful Things to Know About Machine Learning
  • CACM article - How the AI Boom Went Bust
  • Undergraduate Thesis - Analyzing the Prospect of an Approaching AI Winter
  • Tech Genies article - AI History: The First Summer and Winter of AI
  • CACM article - There Was No ‘First AI Winter’

Measuring Generalization

  • Neural Computation article - The Lack of A Priori Distinctions Between Learning Algorithms
  • ICLR paper - Understanding deep learning requires rethinking generalization
  • ICML paper - Model-agnostic Measure of Generalization Difficulty
  • Radiology Artificial Intelligence article - Generalizability of Machine Learning Models: Quantitative Evaluation of Three Methodological Pitfalls
  • Preprint - Quantifying Generalization Complexity for Large Language Models

Insurers Exclude AI

  • Financial Times article - Insurers retreat from AI cover as risk of multibillion-dollar claims mount
  • Tom's Hardware article - Major insurers move to avoid liability for AI lawsuits as multi-billion dollar risks emerge — Recent public incidents have lead to costly repercussions
  • Insurance Newsnet article - Insurers Scale Back AI Coverage Amid Fears of Billion-Dollar Claims
  • Insurance Business article - Insurance’s gen AI reckoning has come

Section 230

  • Section 230 overview
  • Legal sidebar - Section 230 Immunity and Generative Artificial Intelligence
  • Bad Internet Bills website
  • TechDirt article - Section 230 Faces Repeal. Support The Coverage That’s Been Getting It Right All Along.
  • Privacy Guides video - Dissecting Bad Internet Bills with Taylor Lorenz: KOSA, SCREEN Act, Section 230
  • Journal of Technology in Behavioral Health article - Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice
  • Time article - Lawmakers Unveil New Bills to Curb Big Tech’s Power and Profit
  • House Hearing transcript - Legislative Solutions to Protect Children and Teens Online

Relevant Kairos.fm Episodes

  • Into AI Safety episode - Growing BlueDot's Impact w/ Li-Lian Ang
  • muckrAIkers episode - NeurIPS 2024 Wrapped 🌯

Other Links

]]> Mon, 29 Dec 2025 13:00:00 -0700 Jacob Haimes Jacob Haimes 4421 Sean McGregor and I discuss about why evaluating AI systems has become so difficult; we cover everything from the breakdown of benchmarking, how incentives shape safety work, and what approaches like BenchRisk (his recent paper at NeurIPS) and AI auditing aim to fix as systems move into the real world. We also talk about his history and journey in AI safety, including his PhD on ML for public policy, how he started the AI Incident Database, and what he's working on now: AVERI, a non-profit for frontier model auditing.

Chapters

  • (00:00) - Intro
  • (02:36) - What's broken about benchmarking
  • (03:41) - Sean’s wild PhD
  • (14:28) - The phantom internship
  • (19:25) - Sean's journey
  • (22:25) - Market-vs-regulatory modes and AIID
  • (32:13) - Drunk on AI progress
  • (38:34) - BenchRisk
  • (43:20) - Moral hazards and Master Hand
  • (50:34) - Liability, Section 230, and open source
  • (59:20) - AVERI
  • (01:11:30) - Closing thoughts & outro

Links

BenchRisk

  • BenchRisk website
  • NeurIPS paper - Risk Management for Mitigating Benchmark Failure Modes: BenchRisk
  • NeurIPS paper - AI and the Everything in the Whole Wide World Benchmark

AIID

  • AI Incident Database website
  • IAAI paper - Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database
  • Preprint - Lessons for Editors of AI Incidents from the AI Incident Database
  • AIAAIC website (another incident tracker)

Hot AI Summer

  • CACM article - A Few Useful Things to Know About Machine Learning
  • CACM article - How the AI Boom Went Bust
  • Undergraduate Thesis - Analyzing the Prospect of an Approaching AI Winter
  • Tech Genies article - AI History: The First Summer and Winter of AI
  • CACM article - There Was No ‘First AI Winter’

Measuring Generalization

  • Neural Computation article - The Lack of A Priori Distinctions Between Learning Algorithms
  • ICLR paper - Understanding deep learning requires rethinking generalization
  • ICML paper - Model-agnostic Measure of Generalization Difficulty
  • Radiology Artificial Intelligence article - Generalizability of Machine Learning Models: Quantitative Evaluation of Three Methodological Pitfalls
  • Preprint - Quantifying Generalization Complexity for Large Language Models

Insurers Exclude AI

  • Financial Times article - Insurers retreat from AI cover as risk of multibillion-dollar claims mount
  • Tom's Hardware article - Major insurers move to avoid liability for AI lawsuits as multi-billion dollar risks emerge — Recent public incidents have lead to costly repercussions
  • Insurance Newsnet article - Insurers Scale Back AI Coverage Amid Fears of Billion-Dollar Claims
  • Insurance Business article - Insurance’s gen AI reckoning has come

Section 230

  • Section 230 overview
  • Legal sidebar - Section 230 Immunity and Generative Artificial Intelligence
  • Bad Internet Bills website
  • TechDirt article - Section 230 Faces Repeal. Support The Coverage That’s Been Getting It Right All Along.
  • Privacy Guides video - Dissecting Bad Internet Bills with Taylor Lorenz: KOSA, SCREEN Act, Section 230
  • Journal of Technology in Behavioral Health article - Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice
  • Time article - Lawmakers Unveil New Bills to Curb Big Tech’s Power and Profit
  • House Hearing transcript - Legislative Solutions to Protect Children and Teens Online

Relevant Kairos.fm Episodes

  • Into AI Safety episode - Growing BlueDot's Impact w/ Li-Lian Ang
  • muckrAIkers episode - NeurIPS 2024 Wrapped 🌯

Other Links

]]> AI, AI safety, technology, artificial intelligence, AI skepticism, AI hype, Benchmarking, AI Business, Machine Learning Safety, Generalization, Section 230, AIID, Sean McGregor, AVERI, LLM auditing, auditing LLMs, frontier model audits, bad internet bills, AI summer, BenchRisk, No Jacob Haimes Chase Precopia Dr. Sean McGregor Against 'The Singularity' w/ Dr. David Thorstad 25 25 Against 'The Singularity' w/ Dr. David Thorstad full f3d8a985-e290-45ae-bda1-b8de2d57cc85 https://kairos.fm/intoaisafety/e025/ Philosopher Dr. David Thorstad tears into one of AI safety's most influential arguments: the singularity hypothesis. We discuss why the idea of recursive self-improvement leading to superintelligence doesn't hold up under scrutiny, how these arguments have redirected hundreds of millions in funding away from proven interventions, and why people keep backpedaling to weaker versions when challenged.

David walks through the actual structure of singularity arguments, explains why similar patterns show up in other longtermist claims, and makes the case for why we should focus on concrete problems happening right now like poverty, disease, the rise of authoritarianism instead of speculative far-future scenarios.

Chapters

  • (00:00) - Intro
  • (02:13) - David's background
  • (08:00) - (Against) The Singularity Hypothesis
  • (29:46) - Beyond the The Singularity
  • (39:56) - What We Should Actually Be Worried About
  • (49:00) - Philanthropic Funding

Links

The Singularity Hypothesis

  • David's Philosophical Studies article - Against the singularity hypothesis
  • Time "AI Dictionary" page - Singularity
  • EA Forum blogpost - Summary: Against the singularity hypothesis
  • Journal of Conciousness Studies article - The Singularity: A Philisophical Analysis
  • Interim Report from the Panel Chairs: AAAI Presidential Panel on Long-Term AI Futures
  • Epoch AI blogpost - Do the returns to software R&D point towards a singularity?
  • Epoch AI report - Estimating Idea Production: A Methodological Survey

Funding References

  • LessWrong blogpost - An Overview of the AI Safety Funding Situation
  • AISafety.com funding page
  • Report - Stanford AI Index 2025, Chapter 4.3
  • Forbes article - AI Spending To Exceed A Quarter Trillion Next Year
  • AI Panic article - The “AI Existential Risk” Industrial Complex
  • GiveWell webpage - How Much Does It Cost To Save a Life?
  • Wikipedia article - Purchasing power parity

Pascal's Mugging and the St. Petersburg Paradox

  • Wikipedia article - St. Petersburg Paradox
  • Conjecture Magazine article - Pascal’s Mugging and Bad Explanations
  • neurabites explainer - Ergodicity: the Most Over-Looked Assumption
  • Wikipedia article - Extraordinary claims require extraordinary evidence

The Time of Perils

  • Global Priorities Institute working paper - Existential risk pessimism and the time of perils
  • Ethics article - Mistakes in the Moral Mathematics of Existential Risk
  • Philosophy & Public Affairs article - High Risk, Low Reward: A Challenge to the Astronomical Value of Existential Risk Mitigation
  • Toby Ord Book - The Precipice
  • Rethink Priorities blogpost - Charting the precipice
  • AI Futures Project blogpost - AI 2027

Trump's Higher Education Threat Compact

  • Wikipedia article - Compact for Academic Excellence in Higher Education
  • Pen America explainer - What is Trump’s Compact for Higher Education? And More Frequently Asked Questions
  • Statement by the Vanderbilt AAUP Executive Committee on the “Compact for Academic Excellence in Higher Education”
  • The Vanderbilt Hustler article - BREAKING: Chancellor Daniel Diermeier fails to reject higher education compact, reaffirms Vanderbilt’s values and openness to discussion
  • The Vanderbilt Hustler article - Students and faculty organize rally outside Kirkland Hall against Trump administration’s higher education compact
  • Free Speech Center article - Compact for Academic Excellence

More of David's Work

  • Global Priorities Institute working paper - What power-seeking theorems do not show
  • Book - Essays on Longtermism

Vibe Shift

  • Blood in the Machine article - GPT-5 Is a Joke. Will It Matter?
  • Futurism article - Evidence Grows That GPT-5 Is a Bit of a Dud
  • Gary Marcus substack - GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
  • Pew Research report - How the U.S. Public and AI Experts View Artificial Intelligence
  • N...
]]> Philosopher Dr. David Thorstad tears into one of AI safety's most influential arguments: the singularity hypothesis. We discuss why the idea of recursive self-improvement leading to superintelligence doesn't hold up under scrutiny, how these arguments have redirected hundreds of millions in funding away from proven interventions, and why people keep backpedaling to weaker versions when challenged.

David walks through the actual structure of singularity arguments, explains why similar patterns show up in other longtermist claims, and makes the case for why we should focus on concrete problems happening right now like poverty, disease, the rise of authoritarianism instead of speculative far-future scenarios.

Chapters

  • (00:00) - Intro
  • (02:13) - David's background
  • (08:00) - (Against) The Singularity Hypothesis
  • (29:46) - Beyond the The Singularity
  • (39:56) - What We Should Actually Be Worried About
  • (49:00) - Philanthropic Funding

Links

The Singularity Hypothesis

  • David's Philosophical Studies article - Against the singularity hypothesis
  • Time "AI Dictionary" page - Singularity
  • EA Forum blogpost - Summary: Against the singularity hypothesis
  • Journal of Conciousness Studies article - The Singularity: A Philisophical Analysis
  • Interim Report from the Panel Chairs: AAAI Presidential Panel on Long-Term AI Futures
  • Epoch AI blogpost - Do the returns to software R&D point towards a singularity?
  • Epoch AI report - Estimating Idea Production: A Methodological Survey

Funding References

  • LessWrong blogpost - An Overview of the AI Safety Funding Situation
  • AISafety.com funding page
  • Report - Stanford AI Index 2025, Chapter 4.3
  • Forbes article - AI Spending To Exceed A Quarter Trillion Next Year
  • AI Panic article - The “AI Existential Risk” Industrial Complex
  • GiveWell webpage - How Much Does It Cost To Save a Life?
  • Wikipedia article - Purchasing power parity

Pascal's Mugging and the St. Petersburg Paradox

  • Wikipedia article - St. Petersburg Paradox
  • Conjecture Magazine article - Pascal’s Mugging and Bad Explanations
  • neurabites explainer - Ergodicity: the Most Over-Looked Assumption
  • Wikipedia article - Extraordinary claims require extraordinary evidence

The Time of Perils

  • Global Priorities Institute working paper - Existential risk pessimism and the time of perils
  • Ethics article - Mistakes in the Moral Mathematics of Existential Risk
  • Philosophy & Public Affairs article - High Risk, Low Reward: A Challenge to the Astronomical Value of Existential Risk Mitigation
  • Toby Ord Book - The Precipice
  • Rethink Priorities blogpost - Charting the precipice
  • AI Futures Project blogpost - AI 2027

Trump's Higher Education Threat Compact

  • Wikipedia article - Compact for Academic Excellence in Higher Education
  • Pen America explainer - What is Trump’s Compact for Higher Education? And More Frequently Asked Questions
  • Statement by the Vanderbilt AAUP Executive Committee on the “Compact for Academic Excellence in Higher Education”
  • The Vanderbilt Hustler article - BREAKING: Chancellor Daniel Diermeier fails to reject higher education compact, reaffirms Vanderbilt’s values and openness to discussion
  • The Vanderbilt Hustler article - Students and faculty organize rally outside Kirkland Hall against Trump administration’s higher education compact
  • Free Speech Center article - Compact for Academic Excellence

More of David's Work

  • Global Priorities Institute working paper - What power-seeking theorems do not show
  • Book - Essays on Longtermism

Vibe Shift

  • Blood in the Machine article - GPT-5 Is a Joke. Will It Matter?
  • Futurism article - Evidence Grows That GPT-5 Is a Bit of a Dud
  • Gary Marcus substack - GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
  • Pew Research report - How the U.S. Public and AI Experts View Artificial Intelligence
  • N...
]]> Mon, 24 Nov 2025 09:00:00 -0700 Jacob Haimes Jacob Haimes 4150 Philosopher Dr. David Thorstad tears into one of AI safety's most influential arguments: the singularity hypothesis. We discuss why the idea of recursive self-improvement leading to superintelligence doesn't hold up under scrutiny, how these arguments have redirected hundreds of millions in funding away from proven interventions, and why people keep backpedaling to weaker versions when challenged.

David walks through the actual structure of singularity arguments, explains why similar patterns show up in other longtermist claims, and makes the case for why we should focus on concrete problems happening right now like poverty, disease, the rise of authoritarianism instead of speculative far-future scenarios.

Chapters

  • (00:00) - Intro
  • (02:13) - David's background
  • (08:00) - (Against) The Singularity Hypothesis
  • (29:46) - Beyond the The Singularity
  • (39:56) - What We Should Actually Be Worried About
  • (49:00) - Philanthropic Funding

Links

The Singularity Hypothesis

  • David's Philosophical Studies article - Against the singularity hypothesis
  • Time "AI Dictionary" page - Singularity
  • EA Forum blogpost - Summary: Against the singularity hypothesis
  • Journal of Conciousness Studies article - The Singularity: A Philisophical Analysis
  • Interim Report from the Panel Chairs: AAAI Presidential Panel on Long-Term AI Futures
  • Epoch AI blogpost - Do the returns to software R&D point towards a singularity?
  • Epoch AI report - Estimating Idea Production: A Methodological Survey

Funding References

  • LessWrong blogpost - An Overview of the AI Safety Funding Situation
  • AISafety.com funding page
  • Report - Stanford AI Index 2025, Chapter 4.3
  • Forbes article - AI Spending To Exceed A Quarter Trillion Next Year
  • AI Panic article - The “AI Existential Risk” Industrial Complex
  • GiveWell webpage - How Much Does It Cost To Save a Life?
  • Wikipedia article - Purchasing power parity

Pascal's Mugging and the St. Petersburg Paradox

  • Wikipedia article - St. Petersburg Paradox
  • Conjecture Magazine article - Pascal’s Mugging and Bad Explanations
  • neurabites explainer - Ergodicity: the Most Over-Looked Assumption
  • Wikipedia article - Extraordinary claims require extraordinary evidence

The Time of Perils

  • Global Priorities Institute working paper - Existential risk pessimism and the time of perils
  • Ethics article - Mistakes in the Moral Mathematics of Existential Risk
  • Philosophy & Public Affairs article - High Risk, Low Reward: A Challenge to the Astronomical Value of Existential Risk Mitigation
  • Toby Ord Book - The Precipice
  • Rethink Priorities blogpost - Charting the precipice
  • AI Futures Project blogpost - AI 2027

Trump's Higher Education Threat Compact

  • Wikipedia article - Compact for Academic Excellence in Higher Education
  • Pen America explainer - What is Trump’s Compact for Higher Education? And More Frequently Asked Questions
  • Statement by the Vanderbilt AAUP Executive Committee on the “Compact for Academic Excellence in Higher Education”
  • The Vanderbilt Hustler article - BREAKING: Chancellor Daniel Diermeier fails to reject higher education compact, reaffirms Vanderbilt’s values and openness to discussion
  • The Vanderbilt Hustler article - Students and faculty organize rally outside Kirkland Hall against Trump administration’s higher education compact
  • Free Speech Center article - Compact for Academic Excellence

More of David's Work

  • Global Priorities Institute working paper - What power-seeking theorems do not show
  • Book - Essays on Longtermism

Vibe Shift

  • Blood in the Machine article - GPT-5 Is a Joke. Will It Matter?
  • Futurism article - Evidence Grows That GPT-5 Is a Bit of a Dud
  • Gary Marcus substack - GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
  • Pew Research report - How the U.S. Public and AI Experts View Artificial Intelligence
  • N...
]]> AI, AI safety, technology, the singularity, singularity, artificial intelligence, effective altruism, philosophy, longtermism, superintelligence, AI skepticism, AI hype, AI funding, AI safety funding, philanthropy, open philanthropy, coefficient giving, global priorities institute, vanderbilt No Dr. David Thorstad Jacob Haimes Chase Precopia Getting Agentic w/ Alistair Lowe-Norris 24 24 Getting Agentic w/ Alistair Lowe-Norris full 6a0a2091-0747-4deb-bad3-48ab59fa4fbe https://kairos.fm/intoaisafety/e024 Alistair Lowe-Norris, Chief Responsible AI Officer at Iridius and co-host of The Agentic Insider podcast, joins to discuss AI compliance standards, the importance of narrowly scoping systems, and how procurement requirements could encourage responsible AI adoption across industries. We explore the gap between the empty promises companies provide and actual safety practices, as well as the importance of vigilance and continuous oversight.

Listen to Alistair on his podcast, The Agentic Insider!

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.

Chapters

  • (00:00) - Intro
  • (02:46) - Trustworthy AI and the Human Side of Change
  • (13:57) - This is Essentially Avatar, Right?
  • (23:00) - AI Call Centers
  • (49:38) - Standards, Audits, and Accountability
  • (01:04:11) - What Happens when Standards aren’t Met?

Links

GPT-5 Commentary

  • Where's Your Ed At blogpost - How Does GPT-5 Work?
  • Zvi LessWrong blogpost - GPT-5: The Reverse DeepSeek moment
  • Blood in the Machine article - GPT-5 Is a Joke. Will It Matter?
  • Futurism article - Evidence Grows That GPT-5 Is a Bit of a Dud
  • Gary Marcus substack - GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.

Customer Service and AI Adoption

  • Gartner press release - Gartner Survey Finds 64% of Customers Would Prefer That Companies Didn't Use AI for Customer Service
  • Preprint - Deploying Chatbots in Customer Service: Adoption Hurdles and Simple Remedies
  • KDD '25 paper - Retrieval And Structuring Augmented Generation with Large Language Models
  • Global Nerdy blogpost - Retrieval-augmented generation explained “Star Wars” style
  • The Security Cafe article - A Quick And Dirty Guide To Starting SOC2

Standards

Governance and Regulation

  • NIST framework - AI Risk Management Framework
  • EU AI Act article - Article 99: Penalties
  • Colorado Senate Bill 24-205 (Colorado AI Act) webpage
  • Utah Senate Bill 149 webpage

Microsoft AI Compliance

  • Schellman blogpost - Microsoft DPR AI Requirements and ISO 42001
  • Microsoft documentation - ISO/IEC 42001 AI Management System offering
  • Microsoft webpage - Responsible AI Principles and Approach
  • Microsoft Service Trust Portal documentation - Responsible AI Standard v2
  • Microsoft documentation - Supplier Security & Privacy Assurance Program Guide v11 April 2025
]]> Alistair Lowe-Norris, Chief Responsible AI Officer at Iridius and co-host of The Agentic Insider podcast, joins to discuss AI compliance standards, the importance of narrowly scoping systems, and how procurement requirements could encourage responsible AI adoption across industries. We explore the gap between the empty promises companies provide and actual safety practices, as well as the importance of vigilance and continuous oversight.

Listen to Alistair on his podcast, The Agentic Insider!

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.

Chapters

  • (00:00) - Intro
  • (02:46) - Trustworthy AI and the Human Side of Change
  • (13:57) - This is Essentially Avatar, Right?
  • (23:00) - AI Call Centers
  • (49:38) - Standards, Audits, and Accountability
  • (01:04:11) - What Happens when Standards aren’t Met?

Links

GPT-5 Commentary

  • Where's Your Ed At blogpost - How Does GPT-5 Work?
  • Zvi LessWrong blogpost - GPT-5: The Reverse DeepSeek moment
  • Blood in the Machine article - GPT-5 Is a Joke. Will It Matter?
  • Futurism article - Evidence Grows That GPT-5 Is a Bit of a Dud
  • Gary Marcus substack - GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.

Customer Service and AI Adoption

  • Gartner press release - Gartner Survey Finds 64% of Customers Would Prefer That Companies Didn't Use AI for Customer Service
  • Preprint - Deploying Chatbots in Customer Service: Adoption Hurdles and Simple Remedies
  • KDD '25 paper - Retrieval And Structuring Augmented Generation with Large Language Models
  • Global Nerdy blogpost - Retrieval-augmented generation explained “Star Wars” style
  • The Security Cafe article - A Quick And Dirty Guide To Starting SOC2

Standards

Governance and Regulation

  • NIST framework - AI Risk Management Framework
  • EU AI Act article - Article 99: Penalties
  • Colorado Senate Bill 24-205 (Colorado AI Act) webpage
  • Utah Senate Bill 149 webpage

Microsoft AI Compliance

  • Schellman blogpost - Microsoft DPR AI Requirements and ISO 42001
  • Microsoft documentation - ISO/IEC 42001 AI Management System offering
  • Microsoft webpage - Responsible AI Principles and Approach
  • Microsoft Service Trust Portal documentation - Responsible AI Standard v2
  • Microsoft documentation - Supplier Security & Privacy Assurance Program Guide v11 April 2025
]]> Mon, 20 Oct 2025 14:30:00 -0600 Jacob Haimes Jacob Haimes 4290 Alistair Lowe-Norris, Chief Responsible AI Officer at Iridius and co-host of The Agentic Insider podcast, joins to discuss AI compliance standards, the importance of narrowly scoping systems, and how procurement requirements could encourage responsible AI adoption across industries. We explore the gap between the empty promises companies provide and actual safety practices, as well as the importance of vigilance and continuous oversight.

Listen to Alistair on his podcast, The Agentic Insider!

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.

Chapters

  • (00:00) - Intro
  • (02:46) - Trustworthy AI and the Human Side of Change
  • (13:57) - This is Essentially Avatar, Right?
  • (23:00) - AI Call Centers
  • (49:38) - Standards, Audits, and Accountability
  • (01:04:11) - What Happens when Standards aren’t Met?

Links

GPT-5 Commentary

  • Where's Your Ed At blogpost - How Does GPT-5 Work?
  • Zvi LessWrong blogpost - GPT-5: The Reverse DeepSeek moment
  • Blood in the Machine article - GPT-5 Is a Joke. Will It Matter?
  • Futurism article - Evidence Grows That GPT-5 Is a Bit of a Dud
  • Gary Marcus substack - GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.

Customer Service and AI Adoption

  • Gartner press release - Gartner Survey Finds 64% of Customers Would Prefer That Companies Didn't Use AI for Customer Service
  • Preprint - Deploying Chatbots in Customer Service: Adoption Hurdles and Simple Remedies
  • KDD '25 paper - Retrieval And Structuring Augmented Generation with Large Language Models
  • Global Nerdy blogpost - Retrieval-augmented generation explained “Star Wars” style
  • The Security Cafe article - A Quick And Dirty Guide To Starting SOC2

Standards

Governance and Regulation

  • NIST framework - AI Risk Management Framework
  • EU AI Act article - Article 99: Penalties
  • Colorado Senate Bill 24-205 (Colorado AI Act) webpage
  • Utah Senate Bill 149 webpage

Microsoft AI Compliance

  • Schellman blogpost - Microsoft DPR AI Requirements and ISO 42001
  • Microsoft documentation - ISO/IEC 42001 AI Management System offering
  • Microsoft webpage - Responsible AI Principles and Approach
  • Microsoft Service Trust Portal documentation - Responsible AI Standard v2
  • Microsoft documentation - Supplier Security & Privacy Assurance Program Guide v11 April 2025
]]> AI, AI safety, AI governance, AI compliance, Agentic AI, ISO 42001, ISO, Responsible AI, AI leadership, Alistair Lowe Norris, Alistair Lowe-Norris, compliance, auditing, AI auditing, AI compliance, AI standards, AI regulation, standards No Jacob Haimes Chase Precopia Alistair Lowe-Norris Growing BlueDot's Impact w/ Li-Lian Ang 23 23 Growing BlueDot's Impact w/ Li-Lian Ang full 32b8731b-d8de-472e-b02f-284a3d86505c https://kairos.fm/intoaisafety/e023/ I'm joined by my good friend, Li-Lian Ang, first hire and product manager at BlueDot Impact. We discuss how BlueDot has evolved from their original course offerings to a new "defense-in-depth" approach, which focuses on three core threat models: reduced oversight in high risk scenarios (e.g. accelerated warfare), catastrophic terrorism (e.g. rogue actors with bioweapons), and the concentration of wealth and power (e.g. supercharged surveillance states). On top of that, we cover how BlueDot's strategies account for and reduce the negative impacts of common issues in AI safety, including exclusionary tendencies, elitism, and echo chambers.

2025.09.15: Learn more about how to make design effective interventions to make AI go well and potentially even get funded for it on BlueDot Impact's AGI Strategy course! BlueDot is also hiring, so if you think you’d be a good fit, I definitely recommend applying; I had a great experience when I contracted as a course facilitator. If you do end up applying, let them know you found out about the opportunity from the podcast!


Follow Li-Lian on LinkedIn, and look at more of her work on her blog!

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.


  • (03:23) - Meeting Through the Course
  • (05:46) - Eating Your Own Dog Food
  • (13:13) - Impact Acceleration
  • (22:13) - Breaking Out of the AI Safety Mold
  • (26:06) - Bluedot’s Risk Framework
  • (41:38) - Dangers of "Frontier" Models
  • (54:06) - The Need for AI Safety Advocates
  • (01:00:11) - Hot Takes and Pet Peeves

Links

Defense-in-Depth

  • BlueDot Impact blogpost - Our vision for comprehensive AI safety training
  • Engineering for Humans blogpost - The Swiss cheese model: Designing to reduce catastrophic losses
  • Open Journal of Safety Science and Technology article - The Evolution of Defense in Depth Approach: A Cross Sectorial Analysis

X-clusion and X-risk

  • Nature article - AI Safety for Everyone
  • Ben Kuhn blogpost - On being welcoming
  • Reflective Altruism blogpost - Belonging (Part 1: That Bostrom email)

AIxBio

  • RAND report - The Operational Risks of AI in Large-Scale Biological Attacks
  • OpenAI "publication" (press release) - Building an early warning system for LLM-aided biological threat creation
  • Anthropic Frontier AI Red Team blogpost - Why do we take LLMs seriously as a potential source of biorisk?
  • Kevin Esvelt preprint - Foundation models may exhibit staged progression in novel CBRN threat disclosure
  • Anthropic press release - Activating AI Safety Level 3 protections

Persuasive AI

  • Preprint - Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models
  • Nature Human Behavior article - On the conversational persuasiveness of GPT-4
  • Preprint - Large Language Models Are More Persuasive Than Incentivized Human Persuaders

AI, Anthropomorphization, and Mental Health

  • Western News article - Expert insight: Humanlike chatbots detract from developing AI for the human good
  • AI & Society article - Anthropomorphization and beyond: conceptualizing humanwashing of AI-enabled machines
  • Artificial Ignorance article - The Chatbot Trap
  • Making Noise and Hearing Things blogpost - Large language models cannot replace mental health professionals
  • Idealogo blogpost - 4 reasons not to turn ChatGPT into your therapist
  • Journal of Medical Society Editorial - Importance of informed consent in medical practice
  • Indian Journal of Medical Research article - Consent in psychiatry - concept, application & implications
  • Media Naama article - The Risk of Humanising AI Chabots: Why ChatGPT Mimicking Feelings Can Backfire
  • Becker's Behavioral Health blogpost - OpenAI’s mental health roadmap: 5 things to know

Miscellaneous References

  • Carnegie Council blogpost - What Do We Mean When We Talk About "AI Democratization"?
  • Collective Intelligence Project policy brief - Four Approaches to Democratizing AI
  • BlueDot Impact blogpost - How Does AI Learn? A Beginner's Guide with Examples
  • BlueDot Impact blogpost - AI safety needs more public-facing advocacy

More Li-Lian Links

  • Humans of Minerva podcast website
  • Li-Lian's book - Purple is the Noblest Shroud

Relevant Podcasts from Kairos.fm

]]> I'm joined by my good friend, Li-Lian Ang, first hire and product manager at BlueDot Impact. We discuss how BlueDot has evolved from their original course offerings to a new "defense-in-depth" approach, which focuses on three core threat models: reduced oversight in high risk scenarios (e.g. accelerated warfare), catastrophic terrorism (e.g. rogue actors with bioweapons), and the concentration of wealth and power (e.g. supercharged surveillance states). On top of that, we cover how BlueDot's strategies account for and reduce the negative impacts of common issues in AI safety, including exclusionary tendencies, elitism, and echo chambers.

2025.09.15: Learn more about how to make design effective interventions to make AI go well and potentially even get funded for it on BlueDot Impact's AGI Strategy course! BlueDot is also hiring, so if you think you’d be a good fit, I definitely recommend applying; I had a great experience when I contracted as a course facilitator. If you do end up applying, let them know you found out about the opportunity from the podcast!


Follow Li-Lian on LinkedIn, and look at more of her work on her blog!

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.


  • (03:23) - Meeting Through the Course
  • (05:46) - Eating Your Own Dog Food
  • (13:13) - Impact Acceleration
  • (22:13) - Breaking Out of the AI Safety Mold
  • (26:06) - Bluedot’s Risk Framework
  • (41:38) - Dangers of "Frontier" Models
  • (54:06) - The Need for AI Safety Advocates
  • (01:00:11) - Hot Takes and Pet Peeves

Links

Defense-in-Depth

  • BlueDot Impact blogpost - Our vision for comprehensive AI safety training
  • Engineering for Humans blogpost - The Swiss cheese model: Designing to reduce catastrophic losses
  • Open Journal of Safety Science and Technology article - The Evolution of Defense in Depth Approach: A Cross Sectorial Analysis

X-clusion and X-risk

  • Nature article - AI Safety for Everyone
  • Ben Kuhn blogpost - On being welcoming
  • Reflective Altruism blogpost - Belonging (Part 1: That Bostrom email)

AIxBio

  • RAND report - The Operational Risks of AI in Large-Scale Biological Attacks
  • OpenAI "publication" (press release) - Building an early warning system for LLM-aided biological threat creation
  • Anthropic Frontier AI Red Team blogpost - Why do we take LLMs seriously as a potential source of biorisk?
  • Kevin Esvelt preprint - Foundation models may exhibit staged progression in novel CBRN threat disclosure
  • Anthropic press release - Activating AI Safety Level 3 protections

Persuasive AI

  • Preprint - Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models
  • Nature Human Behavior article - On the conversational persuasiveness of GPT-4
  • Preprint - Large Language Models Are More Persuasive Than Incentivized Human Persuaders

AI, Anthropomorphization, and Mental Health

  • Western News article - Expert insight: Humanlike chatbots detract from developing AI for the human good
  • AI & Society article - Anthropomorphization and beyond: conceptualizing humanwashing of AI-enabled machines
  • Artificial Ignorance article - The Chatbot Trap
  • Making Noise and Hearing Things blogpost - Large language models cannot replace mental health professionals
  • Idealogo blogpost - 4 reasons not to turn ChatGPT into your therapist
  • Journal of Medical Society Editorial - Importance of informed consent in medical practice
  • Indian Journal of Medical Research article - Consent in psychiatry - concept, application & implications
  • Media Naama article - The Risk of Humanising AI Chabots: Why ChatGPT Mimicking Feelings Can Backfire
  • Becker's Behavioral Health blogpost - OpenAI’s mental health roadmap: 5 things to know

Miscellaneous References

  • Carnegie Council blogpost - What Do We Mean When We Talk About "AI Democratization"?
  • Collective Intelligence Project policy brief - Four Approaches to Democratizing AI
  • BlueDot Impact blogpost - How Does AI Learn? A Beginner's Guide with Examples
  • BlueDot Impact blogpost - AI safety needs more public-facing advocacy

More Li-Lian Links

  • Humans of Minerva podcast website
  • Li-Lian's book - Purple is the Noblest Shroud

Relevant Podcasts from Kairos.fm

]]> Mon, 15 Sep 2025 09:14:55 -0600 Jacob Haimes Jacob Haimes 4061 I'm joined by my good friend, Li-Lian Ang, first hire and product manager at BlueDot Impact. We discuss how BlueDot has evolved from their original course offerings to a new "defense-in-depth" approach, which focuses on three core threat models: reduced oversight in high risk scenarios (e.g. accelerated warfare), catastrophic terrorism (e.g. rogue actors with bioweapons), and the concentration of wealth and power (e.g. supercharged surveillance states). On top of that, we cover how BlueDot's strategies account for and reduce the negative impacts of common issues in AI safety, including exclusionary tendencies, elitism, and echo chambers.

2025.09.15: Learn more about how to make design effective interventions to make AI go well and potentially even get funded for it on BlueDot Impact's AGI Strategy course! BlueDot is also hiring, so if you think you’d be a good fit, I definitely recommend applying; I had a great experience when I contracted as a course facilitator. If you do end up applying, let them know you found out about the opportunity from the podcast!


Follow Li-Lian on LinkedIn, and look at more of her work on her blog!

As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Patreon which includes an extended version of this episode. Supporting gets you access to these extended cuts, as well as other perks in development.


  • (03:23) - Meeting Through the Course
  • (05:46) - Eating Your Own Dog Food
  • (13:13) - Impact Acceleration
  • (22:13) - Breaking Out of the AI Safety Mold
  • (26:06) - Bluedot’s Risk Framework
  • (41:38) - Dangers of "Frontier" Models
  • (54:06) - The Need for AI Safety Advocates
  • (01:00:11) - Hot Takes and Pet Peeves

Links

Defense-in-Depth

  • BlueDot Impact blogpost - Our vision for comprehensive AI safety training
  • Engineering for Humans blogpost - The Swiss cheese model: Designing to reduce catastrophic losses
  • Open Journal of Safety Science and Technology article - The Evolution of Defense in Depth Approach: A Cross Sectorial Analysis

X-clusion and X-risk

  • Nature article - AI Safety for Everyone
  • Ben Kuhn blogpost - On being welcoming
  • Reflective Altruism blogpost - Belonging (Part 1: That Bostrom email)

AIxBio

  • RAND report - The Operational Risks of AI in Large-Scale Biological Attacks
  • OpenAI "publication" (press release) - Building an early warning system for LLM-aided biological threat creation
  • Anthropic Frontier AI Red Team blogpost - Why do we take LLMs seriously as a potential source of biorisk?
  • Kevin Esvelt preprint - Foundation models may exhibit staged progression in novel CBRN threat disclosure
  • Anthropic press release - Activating AI Safety Level 3 protections

Persuasive AI

  • Preprint - Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models
  • Nature Human Behavior article - On the conversational persuasiveness of GPT-4
  • Preprint - Large Language Models Are More Persuasive Than Incentivized Human Persuaders

AI, Anthropomorphization, and Mental Health

  • Western News article - Expert insight: Humanlike chatbots detract from developing AI for the human good
  • AI & Society article - Anthropomorphization and beyond: conceptualizing humanwashing of AI-enabled machines
  • Artificial Ignorance article - The Chatbot Trap
  • Making Noise and Hearing Things blogpost - Large language models cannot replace mental health professionals
  • Idealogo blogpost - 4 reasons not to turn ChatGPT into your therapist
  • Journal of Medical Society Editorial - Importance of informed consent in medical practice
  • Indian Journal of Medical Research article - Consent in psychiatry - concept, application & implications
  • Media Naama article - The Risk of Humanising AI Chabots: Why ChatGPT Mimicking Feelings Can Backfire
  • Becker's Behavioral Health blogpost - OpenAI’s mental health roadmap: 5 things to know

Miscellaneous References

  • Carnegie Council blogpost - What Do We Mean When We Talk About "AI Democratization"?
  • Collective Intelligence Project policy brief - Four Approaches to Democratizing AI
  • BlueDot Impact blogpost - How Does AI Learn? A Beginner's Guide with Examples
  • BlueDot Impact blogpost - AI safety needs more public-facing advocacy

More Li-Lian Links

  • Humans of Minerva podcast website
  • Li-Lian's book - Purple is the Noblest Shroud

Relevant Podcasts from Kairos.fm

]]> AI, artificial intelligence, AI safety, responsible AI, AI safety training, BlueDot Impact, BlueDot, Intro to Transformative AI, AI safety strategy, AIxBio, Defense in depth, Defense-in-depth, swiss cheese model, swiss cheese method Yes Jacob Haimes Chase Precopia Li-Lian Ang Layoffs to Leadership w/ Andres Sepulveda Morales 22 22 Layoffs to Leadership w/ Andres Sepulveda Morales full a7322f60-bd7f-4726-be49-6bf9c8fa54b9 https://kairos.fm/intoaisafety/e022 Andres Sepulveda Morales joins me to discuss his journey from three tech layoffs to founding Red Mage Creative and leading the Fort Collins chapter of the Rocky Mountain AI Interest Group (RMAIIG). We explore the current tech job market, AI anxiety in nonprofits, dark patterns in AI systems, and building inclusive tech communities that welcome diverse perspectives.


Reach out to Andres on his LinkedIn, or check out the Red Mage Creative website!

For any listeners in Colorado, consider attending an RMAIIG event: Boulder; Fort Collins

  • (00:00) - Intro
  • (01:04) - Andres' Journey
  • (05:15) - Tech Layoff Cycle
  • (26:12) - Why AI?
  • (30:58) - What is Red Mage?
  • (36:12) - AI as a Tool
  • (41:55) - AInxiety
  • (47:26) - Dark Patterns and Critical Perspectives
  • (01:01:35) - RMAIIG
  • (01:10:09) - Inclusive Tech Education
  • (01:18:05) - Colorado AI Governance
  • (01:23:46) - Building Your Own Tech Community

Links

Tech Job Market

  • Layoff tracker website
  • The Big Newsletter article - Why Are We Pretending AI Is Going to Take All the Jobs?
  • METR preprint - Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
  • AI Business blogpost - https://aibusiness.com/responsible-ai/debunking-the-ai-job-crisis
  • Crunchbase article - Data: Tech Layoffs Remain Stubbornly High, With Big Tech Leading The Way
  • Computerworld article - Tech layoffs surge even as US unemployment remains stable
  • Apollo Technical blogpost - Ghost jobs in tech: Why companies are posting roles they don’t plan to fill
  • The HR Digest article - The Rise of Ghost Jobs Is Leaving Job Seekers Frustrated and Disappointed
  • A Life After Layoff video - The Tech Job Market Is Hot Trash Right Now
  • Economy Media video - Will The Tech Job Market Ever Recover?
  • Soleyman Shahir video - Tech CEO Explains: The Real Reason Behind AI Layoffs

Dark Patterns

  • Deceptive Design website
  • Journal of Legal Analysis article - Shining a Light on Dark Patterns
  • ICLR paper - DarkBench: Benchmarking Dark Patterns in Large Language Models
  • Computing Within Limits paper - Imposing AI: Deceptive design patterns against sustainability
  • Communications of the ACM blogpost - Dark Patterns
  • [Preprint] - A Comprehensive Study on Dark Patterns

Colorado AI Regulation

  • Senate Bill 24-205 (Colorado AI Act) bill and webpage
  • NAAG article - A Deep Dive into Colorado’s Artificial Intelligence Act
  • Colorado Sun article - Why Colorado’s artificial intelligence law is a big deal for the whole country
  • CFO Dive blogpost - ‘Heavy lift’: Colorado AI law sets high bar, analysts say
  • Denver 7 article - Colorado could lose federal funding as Trump administration targets AI regulations
  • America's AI Action Plan document

Other Sources

]]> Andres Sepulveda Morales joins me to discuss his journey from three tech layoffs to founding Red Mage Creative and leading the Fort Collins chapter of the Rocky Mountain AI Interest Group (RMAIIG). We explore the current tech job market, AI anxiety in nonprofits, dark patterns in AI systems, and building inclusive tech communities that welcome diverse perspectives.


Reach out to Andres on his LinkedIn, or check out the Red Mage Creative website!

For any listeners in Colorado, consider attending an RMAIIG event: Boulder; Fort Collins

  • (00:00) - Intro
  • (01:04) - Andres' Journey
  • (05:15) - Tech Layoff Cycle
  • (26:12) - Why AI?
  • (30:58) - What is Red Mage?
  • (36:12) - AI as a Tool
  • (41:55) - AInxiety
  • (47:26) - Dark Patterns and Critical Perspectives
  • (01:01:35) - RMAIIG
  • (01:10:09) - Inclusive Tech Education
  • (01:18:05) - Colorado AI Governance
  • (01:23:46) - Building Your Own Tech Community

Links

Tech Job Market

  • Layoff tracker website
  • The Big Newsletter article - Why Are We Pretending AI Is Going to Take All the Jobs?
  • METR preprint - Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
  • AI Business blogpost - https://aibusiness.com/responsible-ai/debunking-the-ai-job-crisis
  • Crunchbase article - Data: Tech Layoffs Remain Stubbornly High, With Big Tech Leading The Way
  • Computerworld article - Tech layoffs surge even as US unemployment remains stable
  • Apollo Technical blogpost - Ghost jobs in tech: Why companies are posting roles they don’t plan to fill
  • The HR Digest article - The Rise of Ghost Jobs Is Leaving Job Seekers Frustrated and Disappointed
  • A Life After Layoff video - The Tech Job Market Is Hot Trash Right Now
  • Economy Media video - Will The Tech Job Market Ever Recover?
  • Soleyman Shahir video - Tech CEO Explains: The Real Reason Behind AI Layoffs

Dark Patterns

  • Deceptive Design website
  • Journal of Legal Analysis article - Shining a Light on Dark Patterns
  • ICLR paper - DarkBench: Benchmarking Dark Patterns in Large Language Models
  • Computing Within Limits paper - Imposing AI: Deceptive design patterns against sustainability
  • Communications of the ACM blogpost - Dark Patterns
  • [Preprint] - A Comprehensive Study on Dark Patterns

Colorado AI Regulation

  • Senate Bill 24-205 (Colorado AI Act) bill and webpage
  • NAAG article - A Deep Dive into Colorado’s Artificial Intelligence Act
  • Colorado Sun article - Why Colorado’s artificial intelligence law is a big deal for the whole country
  • CFO Dive blogpost - ‘Heavy lift’: Colorado AI law sets high bar, analysts say
  • Denver 7 article - Colorado could lose federal funding as Trump administration targets AI regulations
  • America's AI Action Plan document

Other Sources

]]> Mon, 04 Aug 2025 09:00:00 -0600 Jacob Haimes Jacob Haimes 5999 Andres Sepulveda Morales joins me to discuss his journey from three tech layoffs to founding Red Mage Creative and leading the Fort Collins chapter of the Rocky Mountain AI Interest Group (RMAIIG). We explore the current tech job market, AI anxiety in nonprofits, dark patterns in AI systems, and building inclusive tech communities that welcome diverse perspectives.


Reach out to Andres on his LinkedIn, or check out the Red Mage Creative website!

For any listeners in Colorado, consider attending an RMAIIG event: Boulder; Fort Collins

  • (00:00) - Intro
  • (01:04) - Andres' Journey
  • (05:15) - Tech Layoff Cycle
  • (26:12) - Why AI?
  • (30:58) - What is Red Mage?
  • (36:12) - AI as a Tool
  • (41:55) - AInxiety
  • (47:26) - Dark Patterns and Critical Perspectives
  • (01:01:35) - RMAIIG
  • (01:10:09) - Inclusive Tech Education
  • (01:18:05) - Colorado AI Governance
  • (01:23:46) - Building Your Own Tech Community

Links

Tech Job Market

  • Layoff tracker website
  • The Big Newsletter article - Why Are We Pretending AI Is Going to Take All the Jobs?
  • METR preprint - Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
  • AI Business blogpost - https://aibusiness.com/responsible-ai/debunking-the-ai-job-crisis
  • Crunchbase article - Data: Tech Layoffs Remain Stubbornly High, With Big Tech Leading The Way
  • Computerworld article - Tech layoffs surge even as US unemployment remains stable
  • Apollo Technical blogpost - Ghost jobs in tech: Why companies are posting roles they don’t plan to fill
  • The HR Digest article - The Rise of Ghost Jobs Is Leaving Job Seekers Frustrated and Disappointed
  • A Life After Layoff video - The Tech Job Market Is Hot Trash Right Now
  • Economy Media video - Will The Tech Job Market Ever Recover?
  • Soleyman Shahir video - Tech CEO Explains: The Real Reason Behind AI Layoffs

Dark Patterns

  • Deceptive Design website
  • Journal of Legal Analysis article - Shining a Light on Dark Patterns
  • ICLR paper - DarkBench: Benchmarking Dark Patterns in Large Language Models
  • Computing Within Limits paper - Imposing AI: Deceptive design patterns against sustainability
  • Communications of the ACM blogpost - Dark Patterns
  • [Preprint] - A Comprehensive Study on Dark Patterns

Colorado AI Regulation

  • Senate Bill 24-205 (Colorado AI Act) bill and webpage
  • NAAG article - A Deep Dive into Colorado’s Artificial Intelligence Act
  • Colorado Sun article - Why Colorado’s artificial intelligence law is a big deal for the whole country
  • CFO Dive blogpost - ‘Heavy lift’: Colorado AI law sets high bar, analysts say
  • Denver 7 article - Colorado could lose federal funding as Trump administration targets AI regulations
  • America's AI Action Plan document

Other Sources

]]> AI, artificial intelligence, tech layoffs, dark patterns, dark patterns in AI, tech job market, Colorado AI, Colorado AI legislation, AI legislation, America's AI Action Plan, inclusivity, AI consulting, RMAIIG, Rocky Mountain AI Interest Group No Jacob Haimes Chase Precopia Getting Into PauseAI w/ Will Petillo 21 21 Getting Into PauseAI w/ Will Petillo full 24daa207-d0a6-489f-9655-353db0daea99 https://kairos.fm/intoaisafety/e021/ Will Petillo, onboarding team lead at PauseAI, joins me to discuss the grassroots movement advocating for a pause on frontier AI model development. We explore PauseAI's strategy, talk about common misconceptions Will hears, and dig into how diverse perspectives still converge on the need to slow down AI development.

Will's Links


  • (00:00) - Intro
  • (03:36) - What is PauseAI
  • (10:10) - Will Petillo's journey into AI safety advocacy
  • (21:13) - Understanding PauseAI
  • (31:35) - Pursuing a pause
  • (40:06) - Balancing advocacy in a complex world
  • (45:54) - Why a pause on frontier models?
  • (54:48) - Diverse perspectives within PauseAI
  • (59:55) - PauseAI misconceptions
  • (01:16:40) - Ongoing AI governance efforts (SB1047)
  • (01:28:52) - The role of incremental progress
  • (01:35:16) - Safety-washing and corporate responsibility
  • (01:37:23) - Lessons from environmentalism
  • (01:41:59) - Will's superlatives

Links

Related Kairos.fm Episodes

  • Into AI Safety episode with Dr. Igor Krawczuk
  • muckrAIkers episode on SB1047

Exclusionary Tendencies

  • Jacobin article - Elite Universities Gave Us Effective Altruism, the Dumbest Idea of the Century
  • SSIR article - The Elitist Philanthropy of So-Called Effective Altruism
  • Persuasion blogpost - The Problem with Effective Altruism
  • Dark Markets blogpost - What's So Bad About Rationalism?
  • FEE blogpost - What’s Wrong With the Rationality Community?

AI in Warfare

  • Master's Thesis - The Evolution of Artificial Intelligence and Expert Computer Systems in the Army
  • International Journal of Intelligent Systems article - Artificial Intelligence in the Military: An Overview of the Capabilities, Applications, and Challenges
  • Preprint - Basic Research, Lethal Effects: Military AI Research Funding as Enlistment
  • AOAV Article - ‘Military Age Males’ in US Drone Strikes
  • The Conversation article - Gaza war: Israel using AI to identify human targets raising fears that innocents are being caught in the net
  • 972 article - ‘Lavender’: The AI machine directing Israel’s bombing spree in Gaza
  • IDF press release - The IDF's Use of Data Technologies in Intelligence Processing
  • Lieber Institute West Point article - Israel–Hamas 2024 Symposium
  • Verfassungsblog article - Gaza, Artificial Intelligence, and Kill Lists
  • RAND research report - Dr. Li Bicheng, or How China Learned to Stop Worrying and Love Social Media Manipulation
  • The Intercept article collection - The Drone Papers
  • AFIT faculty publication - On Large Language Models in National Security Applications
  • Nature article - Death by Metadata: The Bioinformationalisation of Life and the Transliteration of Algorithms to Flesh

Legislation

  • LegiScan page on SB1047
  • NY State Senate page on the RAISE Act
  • Congress page on the TAKE IT DOWN Act

The Gavernor

  • FastCompany article - Big Tech may be focusing its lobbying push on the California AI safety bill’s last stop: Gavin Newsom
  • POLITICO article - How California politics killed a nationally important AI bill
  • Newsom's veto message
  • Additional relevant lobbying documentation - [1], [2]
  • Jacobin article - With Newsom’s Veto, Big Tech Beats Democracy

Misc. Links

  • FLI Open Letter on an AI pause
  • Wikipedia article - Overton window
  • Daniel Smachtenburger YouTube video - An Introduction to the Metacrisis
  • VAISU website (looks broken as of 2025.06.19)
  • AI Impacts report - Why Did Environmentalism Become Partisan?
]]> Will Petillo, onboarding team lead at PauseAI, joins me to discuss the grassroots movement advocating for a pause on frontier AI model development. We explore PauseAI's strategy, talk about common misconceptions Will hears, and dig into how diverse perspectives still converge on the need to slow down AI development.

Will's Links


  • (00:00) - Intro
  • (03:36) - What is PauseAI
  • (10:10) - Will Petillo's journey into AI safety advocacy
  • (21:13) - Understanding PauseAI
  • (31:35) - Pursuing a pause
  • (40:06) - Balancing advocacy in a complex world
  • (45:54) - Why a pause on frontier models?
  • (54:48) - Diverse perspectives within PauseAI
  • (59:55) - PauseAI misconceptions
  • (01:16:40) - Ongoing AI governance efforts (SB1047)
  • (01:28:52) - The role of incremental progress
  • (01:35:16) - Safety-washing and corporate responsibility
  • (01:37:23) - Lessons from environmentalism
  • (01:41:59) - Will's superlatives

Links

Related Kairos.fm Episodes

  • Into AI Safety episode with Dr. Igor Krawczuk
  • muckrAIkers episode on SB1047

Exclusionary Tendencies

  • Jacobin article - Elite Universities Gave Us Effective Altruism, the Dumbest Idea of the Century
  • SSIR article - The Elitist Philanthropy of So-Called Effective Altruism
  • Persuasion blogpost - The Problem with Effective Altruism
  • Dark Markets blogpost - What's So Bad About Rationalism?
  • FEE blogpost - What’s Wrong With the Rationality Community?

AI in Warfare

  • Master's Thesis - The Evolution of Artificial Intelligence and Expert Computer Systems in the Army
  • International Journal of Intelligent Systems article - Artificial Intelligence in the Military: An Overview of the Capabilities, Applications, and Challenges
  • Preprint - Basic Research, Lethal Effects: Military AI Research Funding as Enlistment
  • AOAV Article - ‘Military Age Males’ in US Drone Strikes
  • The Conversation article - Gaza war: Israel using AI to identify human targets raising fears that innocents are being caught in the net
  • 972 article - ‘Lavender’: The AI machine directing Israel’s bombing spree in Gaza
  • IDF press release - The IDF's Use of Data Technologies in Intelligence Processing
  • Lieber Institute West Point article - Israel–Hamas 2024 Symposium
  • Verfassungsblog article - Gaza, Artificial Intelligence, and Kill Lists
  • RAND research report - Dr. Li Bicheng, or How China Learned to Stop Worrying and Love Social Media Manipulation
  • The Intercept article collection - The Drone Papers
  • AFIT faculty publication - On Large Language Models in National Security Applications
  • Nature article - Death by Metadata: The Bioinformationalisation of Life and the Transliteration of Algorithms to Flesh

Legislation

  • LegiScan page on SB1047
  • NY State Senate page on the RAISE Act
  • Congress page on the TAKE IT DOWN Act

The Gavernor

  • FastCompany article - Big Tech may be focusing its lobbying push on the California AI safety bill’s last stop: Gavin Newsom
  • POLITICO article - How California politics killed a nationally important AI bill
  • Newsom's veto message
  • Additional relevant lobbying documentation - [1], [2]
  • Jacobin article - With Newsom’s Veto, Big Tech Beats Democracy

Misc. Links

  • FLI Open Letter on an AI pause
  • Wikipedia article - Overton window
  • Daniel Smachtenburger YouTube video - An Introduction to the Metacrisis
  • VAISU website (looks broken as of 2025.06.19)
  • AI Impacts report - Why Did Environmentalism Become Partisan?
]]> Mon, 23 Jun 2025 10:00:00 -0600 Jacob Haimes, Will Petillo Jacob Haimes, Will Petillo 6484 Will Petillo, onboarding team lead at PauseAI, joins me to discuss the grassroots movement advocating for a pause on frontier AI model development. We explore PauseAI's strategy, talk about common misconceptions Will hears, and dig into how diverse perspectives still converge on the need to slow down AI development.

Will's Links


  • (00:00) - Intro
  • (03:36) - What is PauseAI
  • (10:10) - Will Petillo's journey into AI safety advocacy
  • (21:13) - Understanding PauseAI
  • (31:35) - Pursuing a pause
  • (40:06) - Balancing advocacy in a complex world
  • (45:54) - Why a pause on frontier models?
  • (54:48) - Diverse perspectives within PauseAI
  • (59:55) - PauseAI misconceptions
  • (01:16:40) - Ongoing AI governance efforts (SB1047)
  • (01:28:52) - The role of incremental progress
  • (01:35:16) - Safety-washing and corporate responsibility
  • (01:37:23) - Lessons from environmentalism
  • (01:41:59) - Will's superlatives

Links

Related Kairos.fm Episodes

  • Into AI Safety episode with Dr. Igor Krawczuk
  • muckrAIkers episode on SB1047

Exclusionary Tendencies

  • Jacobin article - Elite Universities Gave Us Effective Altruism, the Dumbest Idea of the Century
  • SSIR article - The Elitist Philanthropy of So-Called Effective Altruism
  • Persuasion blogpost - The Problem with Effective Altruism
  • Dark Markets blogpost - What's So Bad About Rationalism?
  • FEE blogpost - What’s Wrong With the Rationality Community?

AI in Warfare

  • Master's Thesis - The Evolution of Artificial Intelligence and Expert Computer Systems in the Army
  • International Journal of Intelligent Systems article - Artificial Intelligence in the Military: An Overview of the Capabilities, Applications, and Challenges
  • Preprint - Basic Research, Lethal Effects: Military AI Research Funding as Enlistment
  • AOAV Article - ‘Military Age Males’ in US Drone Strikes
  • The Conversation article - Gaza war: Israel using AI to identify human targets raising fears that innocents are being caught in the net
  • 972 article - ‘Lavender’: The AI machine directing Israel’s bombing spree in Gaza
  • IDF press release - The IDF's Use of Data Technologies in Intelligence Processing
  • Lieber Institute West Point article - Israel–Hamas 2024 Symposium
  • Verfassungsblog article - Gaza, Artificial Intelligence, and Kill Lists
  • RAND research report - Dr. Li Bicheng, or How China Learned to Stop Worrying and Love Social Media Manipulation
  • The Intercept article collection - The Drone Papers
  • AFIT faculty publication - On Large Language Models in National Security Applications
  • Nature article - Death by Metadata: The Bioinformationalisation of Life and the Transliteration of Algorithms to Flesh

Legislation

  • LegiScan page on SB1047
  • NY State Senate page on the RAISE Act
  • Congress page on the TAKE IT DOWN Act

The Gavernor

  • FastCompany article - Big Tech may be focusing its lobbying push on the California AI safety bill’s last stop: Gavin Newsom
  • POLITICO article - How California politics killed a nationally important AI bill
  • Newsom's veto message
  • Additional relevant lobbying documentation - [1], [2]
  • Jacobin article - With Newsom’s Veto, Big Tech Beats Democracy

Misc. Links

  • FLI Open Letter on an AI pause
  • Wikipedia article - Overton window
  • Daniel Smachtenburger YouTube video - An Introduction to the Metacrisis
  • VAISU website (looks broken as of 2025.06.19)
  • AI Impacts report - Why Did Environmentalism Become Partisan?
]]> technology, AI, artificial intelligence, PauseAI, pause ai, AI pause, stop AI, AI risks No Jacob Haimes Chase Precopia Making Your Voice Heard w/ Tristan & Felix de Simone 20 20 Making Your Voice Heard w/ Tristan & Felix de Simone full b93ca71c-29ca-4790-a3cb-bc885b8c2c76 https://kairos.fm/intoaisafety/e020/ I am joined by Tristan Williams and Felix de Simone to discuss their work on the potential of constituent communication, specifically in the context of AI legislation. These two worked as part of an AI Safety Camp team to understand whether or not it would be useful for more people to be sharing their experiences, concerns, and opinions with their government representative (hint, it is).

Check out the blogpost on their findings, "Talking to Congress: Can constituents contacting their legislator influence policy?" and the tool they created!

  • (01:53) - Introductions
  • (04:04) - Starting the project
  • (13:30) - Project overview
  • (16:36) - Understanding constituent communication
  • (28:50) - Literature review
  • (35:52) - Phase 2
  • (43:26) - Creating a tool for citizen engagement
  • (50:16) - Crafting your message
  • (59:40) - The game of advocacy
  • (01:15:19) - Difficulties on the project
  • (01:22:33) - Call to action
  • (01:32:30) - Outro

Links

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

  • AI Safety Camp
  • Pause AI
  • BlueDot Impact
  • TIME article - There’s an AI Lobbying Frenzy in Washington. Big Tech Is Dominating
  • Congressional Management Foundation study - Communicating with Congress: Perceptions of Citizen Advocacy on Capitol Hill
  • Congressional Management Foundation study - The Future of Citizen Engagement: Rebuilding the Democratic Dialogue
  • Tristan and Felix's blogpost - Talking to Congress: Can constituents contacting their legislator influence policy?
  • Wired article - What It Takes to Make Congress Actually Listen
  • American Journal of Polical Science article - Congressional Representation: Accountability from the Constituent’s Perspective
  • Political Behavior article - Call Your Legislator: A Field Experimental Study of the Impact of a Constituency Mobilization Campaign on Legislative Voting
  • Guided Track website
  • The Tool
  • Holistic AI global regulatory tracker
  • White & Case global regulatory tracker
  • Steptoe US AI legislation tracker
  • Manatt US AIxHealth legislation tracker
  • Issue One article - Big Tech Cozies Up to New Administration After Spending Record Sums on Lobbying Last Year
  • Verfassungsblog article - BigTech’s Efforts to Derail the AI Act
  • MIT Technology Review article - OpenAI has upped its lobbying efforts nearly sevenfold
  • Open Secrets webpage - Issue Profile: Science & Technology
  • Statista data - Leading lobbying spenders in the United States in 2024
  • Global Justice Now report - Democracy at risk in Davos: new report exposes big tech lobbying and political interference
  • Ipsos article - Where Americans stand on AI
  • AP-NORC report - There Is Bipartisan Concern About the Use of AI in the 2024 Elections
  • AI Action Summit report - International AI Safety Report
  • YouGov article - Do Americans think AI will have a positive or negative impact on society?
]]> I am joined by Tristan Williams and Felix de Simone to discuss their work on the potential of constituent communication, specifically in the context of AI legislation. These two worked as part of an AI Safety Camp team to understand whether or not it would be useful for more people to be sharing their experiences, concerns, and opinions with their government representative (hint, it is).

Check out the blogpost on their findings, "Talking to Congress: Can constituents contacting their legislator influence policy?" and the tool they created!

  • (01:53) - Introductions
  • (04:04) - Starting the project
  • (13:30) - Project overview
  • (16:36) - Understanding constituent communication
  • (28:50) - Literature review
  • (35:52) - Phase 2
  • (43:26) - Creating a tool for citizen engagement
  • (50:16) - Crafting your message
  • (59:40) - The game of advocacy
  • (01:15:19) - Difficulties on the project
  • (01:22:33) - Call to action
  • (01:32:30) - Outro

Links

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

  • AI Safety Camp
  • Pause AI
  • BlueDot Impact
  • TIME article - There’s an AI Lobbying Frenzy in Washington. Big Tech Is Dominating
  • Congressional Management Foundation study - Communicating with Congress: Perceptions of Citizen Advocacy on Capitol Hill
  • Congressional Management Foundation study - The Future of Citizen Engagement: Rebuilding the Democratic Dialogue
  • Tristan and Felix's blogpost - Talking to Congress: Can constituents contacting their legislator influence policy?
  • Wired article - What It Takes to Make Congress Actually Listen
  • American Journal of Polical Science article - Congressional Representation: Accountability from the Constituent’s Perspective
  • Political Behavior article - Call Your Legislator: A Field Experimental Study of the Impact of a Constituency Mobilization Campaign on Legislative Voting
  • Guided Track website
  • The Tool
  • Holistic AI global regulatory tracker
  • White & Case global regulatory tracker
  • Steptoe US AI legislation tracker
  • Manatt US AIxHealth legislation tracker
  • Issue One article - Big Tech Cozies Up to New Administration After Spending Record Sums on Lobbying Last Year
  • Verfassungsblog article - BigTech’s Efforts to Derail the AI Act
  • MIT Technology Review article - OpenAI has upped its lobbying efforts nearly sevenfold
  • Open Secrets webpage - Issue Profile: Science & Technology
  • Statista data - Leading lobbying spenders in the United States in 2024
  • Global Justice Now report - Democracy at risk in Davos: new report exposes big tech lobbying and political interference
  • Ipsos article - Where Americans stand on AI
  • AP-NORC report - There Is Bipartisan Concern About the Use of AI in the 2024 Elections
  • AI Action Summit report - International AI Safety Report
  • YouGov article - Do Americans think AI will have a positive or negative impact on society?
]]> Mon, 19 May 2025 09:00:00 -0600 Jacob Haimes Jacob Haimes 5603 I am joined by Tristan Williams and Felix de Simone to discuss their work on the potential of constituent communication, specifically in the context of AI legislation. These two worked as part of an AI Safety Camp team to understand whether or not it would be useful for more people to be sharing their experiences, concerns, and opinions with their government representative (hint, it is).

Check out the blogpost on their findings, "Talking to Congress: Can constituents contacting their legislator influence policy?" and the tool they created!

  • (01:53) - Introductions
  • (04:04) - Starting the project
  • (13:30) - Project overview
  • (16:36) - Understanding constituent communication
  • (28:50) - Literature review
  • (35:52) - Phase 2
  • (43:26) - Creating a tool for citizen engagement
  • (50:16) - Crafting your message
  • (59:40) - The game of advocacy
  • (01:15:19) - Difficulties on the project
  • (01:22:33) - Call to action
  • (01:32:30) - Outro

Links

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

  • AI Safety Camp
  • Pause AI
  • BlueDot Impact
  • TIME article - There’s an AI Lobbying Frenzy in Washington. Big Tech Is Dominating
  • Congressional Management Foundation study - Communicating with Congress: Perceptions of Citizen Advocacy on Capitol Hill
  • Congressional Management Foundation study - The Future of Citizen Engagement: Rebuilding the Democratic Dialogue
  • Tristan and Felix's blogpost - Talking to Congress: Can constituents contacting their legislator influence policy?
  • Wired article - What It Takes to Make Congress Actually Listen
  • American Journal of Polical Science article - Congressional Representation: Accountability from the Constituent’s Perspective
  • Political Behavior article - Call Your Legislator: A Field Experimental Study of the Impact of a Constituency Mobilization Campaign on Legislative Voting
  • Guided Track website
  • The Tool
  • Holistic AI global regulatory tracker
  • White & Case global regulatory tracker
  • Steptoe US AI legislation tracker
  • Manatt US AIxHealth legislation tracker
  • Issue One article - Big Tech Cozies Up to New Administration After Spending Record Sums on Lobbying Last Year
  • Verfassungsblog article - BigTech’s Efforts to Derail the AI Act
  • MIT Technology Review article - OpenAI has upped its lobbying efforts nearly sevenfold
  • Open Secrets webpage - Issue Profile: Science & Technology
  • Statista data - Leading lobbying spenders in the United States in 2024
  • Global Justice Now report - Democracy at risk in Davos: new report exposes big tech lobbying and political interference
  • Ipsos article - Where Americans stand on AI
  • AP-NORC report - There Is Bipartisan Concern About the Use of AI in the 2024 Elections
  • AI Action Summit report - International AI Safety Report
  • YouGov article - Do Americans think AI will have a positive or negative impact on society?
]]> technology, AI, democracy, constituency, advocacy, AI governance, United States AI, AI safety No Jacob Haimes Chase Precopia INTERVIEW: Scaling Democracy w/ (Dr.) Igor Krawczuk 19 19 INTERVIEW: Scaling Democracy w/ (Dr.) Igor Krawczuk full 81c52538-5af2-40aa-abd7-02c08088f43e https://kairos.fm/intoaisafety/e019 The almost Dr. Igor Krawczuk joins me for what is the equivalent of 4 of my previous episodes. We get into all the classics: eugenics, capitalism, philosophical toads... Need I say more?

If you're interested in connecting with Igor, head on over to his website, or check out placeholder for thesis (it isn't published yet).

Because the full show notes have a whopping 115 additional links, I'll highlight some that I think are particularly worthwhile here:

Chapters

  • (02:32) - Introducing Igor
  • (10:11) - Aside on EY, LW, EA, etc., a.k.a. lettersoup
  • (18:30) - Igor on AI alignment
  • (33:06) - "Open Source" in AI
  • (41:20) - The story of infinite riches and suffering
  • (59:11) - On AI threat models
  • (01:09:25) - Representation in AI
  • (01:15:00) - Hazard fishing
  • (01:18:52) - Intelligence and eugenics
  • (01:34:38) - Emergence
  • (01:48:19) - Considering externalities
  • (01:53:33) - The shape of an argument
  • (02:01:39) - More eugenics
  • (02:06:09) - I'm convinced, what now?
  • (02:18:03) - AIxBio (round ??)
  • (02:29:09) - On open release of models
  • (02:40:28) - Data and copyright
  • (02:44:09) - Scientific accessibility and bullshit
  • (02:53:04) - Igor's point of view
  • (02:57:20) - Outro


Links

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. All references, including those only mentioned in the extended version of this episode, are included.

]]> The almost Dr. Igor Krawczuk joins me for what is the equivalent of 4 of my previous episodes. We get into all the classics: eugenics, capitalism, philosophical toads... Need I say more?

If you're interested in connecting with Igor, head on over to his website, or check out placeholder for thesis (it isn't published yet).

Because the full show notes have a whopping 115 additional links, I'll highlight some that I think are particularly worthwhile here:

Chapters

  • (02:32) - Introducing Igor
  • (10:11) - Aside on EY, LW, EA, etc., a.k.a. lettersoup
  • (18:30) - Igor on AI alignment
  • (33:06) - "Open Source" in AI
  • (41:20) - The story of infinite riches and suffering
  • (59:11) - On AI threat models
  • (01:09:25) - Representation in AI
  • (01:15:00) - Hazard fishing
  • (01:18:52) - Intelligence and eugenics
  • (01:34:38) - Emergence
  • (01:48:19) - Considering externalities
  • (01:53:33) - The shape of an argument
  • (02:01:39) - More eugenics
  • (02:06:09) - I'm convinced, what now?
  • (02:18:03) - AIxBio (round ??)
  • (02:29:09) - On open release of models
  • (02:40:28) - Data and copyright
  • (02:44:09) - Scientific accessibility and bullshit
  • (02:53:04) - Igor's point of view
  • (02:57:20) - Outro


Links

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. All references, including those only mentioned in the extended version of this episode, are included.

]]> Mon, 03 Jun 2024 10:11:00 -0600 Jacob Haimes Jacob Haimes 10726 The almost Dr. Igor Krawczuk joins me for what is the equivalent of 4 of my previous episodes. We get into all the classics: eugenics, capitalism, philosophical toads... Need I say more?

If you're interested in connecting with Igor, head on over to his website, or check out placeholder for thesis (it isn't published yet).

Because the full show notes have a whopping 115 additional links, I'll highlight some that I think are particularly worthwhile here:

Chapters

  • (02:32) - Introducing Igor
  • (10:11) - Aside on EY, LW, EA, etc., a.k.a. lettersoup
  • (18:30) - Igor on AI alignment
  • (33:06) - "Open Source" in AI
  • (41:20) - The story of infinite riches and suffering
  • (59:11) - On AI threat models
  • (01:09:25) - Representation in AI
  • (01:15:00) - Hazard fishing
  • (01:18:52) - Intelligence and eugenics
  • (01:34:38) - Emergence
  • (01:48:19) - Considering externalities
  • (01:53:33) - The shape of an argument
  • (02:01:39) - More eugenics
  • (02:06:09) - I'm convinced, what now?
  • (02:18:03) - AIxBio (round ??)
  • (02:29:09) - On open release of models
  • (02:40:28) - Data and copyright
  • (02:44:09) - Scientific accessibility and bullshit
  • (02:53:04) - Igor's point of view
  • (02:57:20) - Outro


Links

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. All references, including those only mentioned in the extended version of this episode, are included.

]]> AI, machine learning, democracy, AI safety Yes Jacob Haimes Chase Precopia Dr. Igor Krawczuk INTERVIEW: StakeOut.AI w/ Dr. Peter Park (3) 18 18 INTERVIEW: StakeOut.AI w/ Dr. Peter Park (3) full 0ca91074-f16c-428a-9408-550bfb7ceb4f https://kairos.fm/intoaisafety/e018 As always, the best things come in 3s: dimensions, musketeers, pyramids, and... 3 installments of my interview with Dr. Peter Park, an AI Existential Safety Post-doctoral Fellow working with Dr. Max Tegmark at MIT.

As you may have ascertained from the previous two segments of the interview, Dr. Park cofounded StakeOut.AI along with Harry Luk and one other cofounder whose name has been removed due to requirements of her current position. The non-profit had a simple but important mission: make the adoption of AI technology go well, for humanity, but unfortunately, StakeOut.AI had to dissolve in late February of 2024 because no granter would fund them. Although it certainly is disappointing that the organization is no longer functioning, all three cofounders continue to contribute positively towards improving our world in their current roles.

If you would like to investigate further into Dr. Park's work, view his website, Google Scholar, or follow him on Twitter

00:00:54 ❙ Intro
00:02:41 ❙ Rapid development
00:08:25 ❙ Provable safety, safety factors, & CSAM
00:18:50 ❙ Litigation
00:23:06 ❙ Open/Closed Source
00:38:52 ❙ AIxBio
00:47:50 ❙ Scientific rigor in AI
00:56:22 ❙ AI deception
01:02:45 ❙ No takesies-backsies
01:08:22 ❙ StakeOut.AI's start
01:12:53 ❙ Sustainability & Agency
01:18:21 ❙ "I'm sold, next steps?" -you
01:23:53 ❙ Lessons from the amazing Spiderman
01:33:15 ❙ "I'm ready to switch careers, next steps?" -you
01:40:00 ❙ The most important question
01:41:11 ❙ Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> As always, the best things come in 3s: dimensions, musketeers, pyramids, and... 3 installments of my interview with Dr. Peter Park, an AI Existential Safety Post-doctoral Fellow working with Dr. Max Tegmark at MIT.

As you may have ascertained from the previous two segments of the interview, Dr. Park cofounded StakeOut.AI along with Harry Luk and one other cofounder whose name has been removed due to requirements of her current position. The non-profit had a simple but important mission: make the adoption of AI technology go well, for humanity, but unfortunately, StakeOut.AI had to dissolve in late February of 2024 because no granter would fund them. Although it certainly is disappointing that the organization is no longer functioning, all three cofounders continue to contribute positively towards improving our world in their current roles.

If you would like to investigate further into Dr. Park's work, view his website, Google Scholar, or follow him on Twitter

00:00:54 ❙ Intro
00:02:41 ❙ Rapid development
00:08:25 ❙ Provable safety, safety factors, & CSAM
00:18:50 ❙ Litigation
00:23:06 ❙ Open/Closed Source
00:38:52 ❙ AIxBio
00:47:50 ❙ Scientific rigor in AI
00:56:22 ❙ AI deception
01:02:45 ❙ No takesies-backsies
01:08:22 ❙ StakeOut.AI's start
01:12:53 ❙ Sustainability & Agency
01:18:21 ❙ "I'm sold, next steps?" -you
01:23:53 ❙ Lessons from the amazing Spiderman
01:33:15 ❙ "I'm ready to switch careers, next steps?" -you
01:40:00 ❙ The most important question
01:41:11 ❙ Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 25 Mar 2024 09:00:00 -0600 Jacob Haimes Jacob Haimes 6120 As always, the best things come in 3s: dimensions, musketeers, pyramids, and... 3 installments of my interview with Dr. Peter Park, an AI Existential Safety Post-doctoral Fellow working with Dr. Max Tegmark at MIT.As you may have ascertained from the previous two segments of the interview, Dr. Park cofounded StakeOut.AI along with Harry Luk and one other cofounder whose name has been removed due to requirements of her current position. The non-profit had a simple but important mission: make the adoption of AI technology go well, for humanity, but unfortunately, StakeOut.AI had to dissolve in late February of 2024 because no granter would fund them. Although it certainly is disappointing that the organization is no longer functioning, all three cofounders continue to contribute positively towards improving our world in their current roles.If you would like to investigate further into Dr. Park's work, view his website, Google Scholar, or follow him on Twitter00:00:54 ❙ Intro00:02:41 ❙ Rapid development00:08:25 ❙ Provable safety, safety factors, & CSAM00:18:50 ❙ Litigation00:23:06 ❙ Open/Closed Source00:38:52 ❙ AIxBio00:47:50 ❙ Scientific rigor in AI00:56:22 ❙ AI deception01:02:45 ❙ No takesies-backsies01:08:22 ❙ StakeOut.AI's start01:12:53 ❙ Sustainability & Agency01:18:21 ❙ "I'm sold, next steps?" -you01:23:53 ❙ Lessons from the amazing Spiderman01:33:15 ❙ "I'm ready to switch careers, next steps?" -you01:40:00 ❙ The most important question01:41:11 ❙ OutroLinks to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.StakeOut.AIPause AIAI Governance Scorecard (go to Pg. 3)CIVITAIArticle on CIVITAI and CSAMSenate Hearing: Protecting Children OnlinePBS Newshour CoverageThe Times Sues OpenAI and Microsoft Over A.I. Use of Copyrighted WorkOpen Source/Weights/Release/InterpretationOpen Source InitiativeHistory of the OSIMeta’s LLaMa 2 license is not Open SourceIs Llama 2 open source? No – and perhaps we need a new definition of open…Apache License, Version 2.03Blue1Brown: Neural NetworksOpening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generatorsThe online tableSignalBloomz model on HuggingFaceMistral websiteNASA TragediesChallenger disaster on WikipediaColumbia disaster on WikipediaAIxBio RiskDual use of artificial-intelligence-powered drug discoveryCan large language models democratize access to dual-use biotechnology?Open-Sourcing Highly Capable Foundation Models (sadly, I can't rename the article...)Propaganda or Science: Open Source AI and Bioterrorism RiskExaggerating the risks (Part 15: Biorisk from LLMs)Will releasing the weights of future large language models grant widespread access to pandemic agents?On the Societal Impact of Open Foundation ModelsPolicy briefApart ResearchScienceCiceroHuman-level play in the game of Diplomacy by combining language models with strategic reasoningCicero webpageAI Deception: A Survey of Examples, Risks, and Potential SolutionsOpen Sourcing the AI Revolution: Framing the debate on open source, artificial intelligence and regulationAI Safety CampInto AI Safety Patreon As always, the best things come in 3s: dimensions, musketeers, pyramids, and... 3 installments of my interview with Dr. Peter Park, an AI Existential Safety Post-doctoral Fellow working with Dr. Max Tegmark at MIT.As you may have ascertained from the prev technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia Dr. Peter S. Park INTERVIEW: StakeOut.AI w/ Dr. Peter Park (2) 17 17 INTERVIEW: StakeOut.AI w/ Dr. Peter Park (2) full ecb55f43-ac84-4293-b93c-0b9562b236a4 https://kairos.fm/intoaisafety/e017 Join me for round 2 with Dr. Peter Park, an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. Dr. Park was a cofounder of StakeOut.AI, a non-profit focused on making AI go well for humans, along with Harry Luk and one other individual, whose name has been removed due to requirements of her current position.

In addition to the normal links, I wanted to include the links to the petitions that Dr. Park mentions during the podcast. Note that the nonprofit which began these petitions, StakeOut.AI, has been dissolved.
Right AI Laws, to Right Our Future: Support Artificial Intelligence Safety Regulations Now
Is Deepfake Illegal? Not Yet! Ban Deepfakes to Protect Your Family & Demand Deepfake Laws
Ban Superintelligence: Stop AI-Driven Human Extinction Risk 

00:00:54 - Intro
00:02:34 - Battleground 1: Copyright
00:06:28 - Battleground 2: Moral Critique of AI Collaborationists
00:08:15 - Rich Sutton
00:20:41 - OpenAI Drama
00:34:28 - Battleground 3: Contract Negotiations for AI Ban Clauses
00:37:57 - Tesla, Autopilot, and FSD
00:40:02 - Recycling
00:47:40 - Battleground 4: New Laws and Policies
00:50:00 - Battleground 5: Whistleblower Protections
00:53:07 - Whistleblowing on Microsoft
00:54:43 - Andrej Karpathy & Exercises in Empathy
01:05:57 - Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Join me for round 2 with Dr. Peter Park, an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. Dr. Park was a cofounder of StakeOut.AI, a non-profit focused on making AI go well for humans, along with Harry Luk and one other individual, whose name has been removed due to requirements of her current position.

In addition to the normal links, I wanted to include the links to the petitions that Dr. Park mentions during the podcast. Note that the nonprofit which began these petitions, StakeOut.AI, has been dissolved.
Right AI Laws, to Right Our Future: Support Artificial Intelligence Safety Regulations Now
Is Deepfake Illegal? Not Yet! Ban Deepfakes to Protect Your Family & Demand Deepfake Laws
Ban Superintelligence: Stop AI-Driven Human Extinction Risk 

00:00:54 - Intro
00:02:34 - Battleground 1: Copyright
00:06:28 - Battleground 2: Moral Critique of AI Collaborationists
00:08:15 - Rich Sutton
00:20:41 - OpenAI Drama
00:34:28 - Battleground 3: Contract Negotiations for AI Ban Clauses
00:37:57 - Tesla, Autopilot, and FSD
00:40:02 - Recycling
00:47:40 - Battleground 4: New Laws and Policies
00:50:00 - Battleground 5: Whistleblower Protections
00:53:07 - Whistleblowing on Microsoft
00:54:43 - Andrej Karpathy & Exercises in Empathy
01:05:57 - Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 18 Mar 2024 09:00:00 -0600 Jacob Haimes Jacob Haimes 3983 Join me for round 2 with Dr. Peter Park, an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. Dr. Park was a cofounder of StakeOut.AI, a non-profit focused on making AI go well for humans, along with Harry Luk and one other individual, whose name has been removed due to requirements of her current position.In addition to the normal links, I wanted to include the links to the petitions that Dr. Park mentions during the podcast. Note that the nonprofit which began these petitions, StakeOut.AI, has been dissolved.Right AI Laws, to Right Our Future: Support Artificial Intelligence Safety Regulations NowIs Deepfake Illegal? Not Yet! Ban Deepfakes to Protect Your Family & Demand Deepfake LawsBan Superintelligence: Stop AI-Driven Human Extinction Risk 00:00:54 - Intro00:02:34 - Battleground 1: Copyright00:06:28 - Battleground 2: Moral Critique of AI Collaborationists00:08:15 - Rich Sutton00:20:41 - OpenAI Drama00:34:28 - Battleground 3: Contract Negotiations for AI Ban Clauses00:37:57 - Tesla, Autopilot, and FSD00:40:02 - Recycling00:47:40 - Battleground 4: New Laws and Policies00:50:00 - Battleground 5: Whistleblower Protections00:53:07 - Whistleblowing on Microsoft00:54:43 - Andrej Karpathy & Exercises in Empathy01:05:57 - OutroLinks to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.StakeOut.AIThe Times Sues OpenAI and Microsoft Over A.I. Use of Copyrighted WorkSusman Godfrey LLPRich SuttonReinforcement Learning: An Introduction (textbook)AI Succession (presentation by Rich Sutton)The Alberta Plan for AI Research Moore's LawThe Future of Integrated Electronics (original paper)Computer History Museum's entry on Moore's LawStochastic gradient descent (SGD) on WikipediaOpenAI DramaMax Read's Substack postZvi Mowshowitz's Substack series, in order of postingOpenAI: Facts from a WeekendOpenAI: The Battle of the BoardOpenAI: Altman ReturnsOpenAI: Leaks Confirm the Story ← best singular post in the seriesOpenAI: The Board ExpandsOfficial OpenAI announcementWGA on WikipediaSAG-AFTRA on WikipediaTesla's False AdvertisingTesla's response to the DMV's false-advertising allegations: What took so long?Tesla Tells California DMV that FSD Is Not Capable of Autonomous DrivingWhat to Call Full Self-Driving When It Isn't Full Self-Driving?Tesla fired an employee after he posted driverless tech reviews on YouTubeTesla's page on Autopilot and Full Self-DrivingRecyclingBoulder County Recycling Center Stockpiles Accurately Sorted Recyclable MaterialsOut of sight, out of mindBoulder Eco-Cycle Recycling GuidelinesDivide-and-Conquer Dynamics in AI-Driven DisempowermentMicrosoft WhistleblowerWhistleblowers call out AI's flawsShane's LinkedIn postLetters sent by JonesKarpathy announces departure from OpenAI Join me for round 2 with Dr. Peter Park, an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. Dr. Park was a cofounder of StakeOut.AI, a non-profit focused on making AI go well for humans, along with Harry Luk and one other in technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia Dr. Peter S. Park MINISODE: Restructure Vol. 2 16 16 MINISODE: Restructure Vol. 2 full 6dc7d6e0-46ac-49ce-a60f-fe7c86e3f648 https://kairos.fm/intoaisafety/e016 UPDATE: Contrary to what I say in this episode, I won't be removing any episodes that are already published from the podcast RSS feed.

After getting some advice and reflecting more on my own personal goals, I have decided to shift the direction of the podcast towards accessible content regarding "AI" instead of the show's original focus. I will still be releasing what I am calling research ride-along content to my Patreon, but the show's feed will consist only of content that I aim to make as accessible as possible.

00:35 - TL;DL
01:12 - Advice from Pete
03:10 - My personal goal
05:39 - Reflection on refining my goal
09:08 - Looking forward (logistics

]]> UPDATE: Contrary to what I say in this episode, I won't be removing any episodes that are already published from the podcast RSS feed.

After getting some advice and reflecting more on my own personal goals, I have decided to shift the direction of the podcast towards accessible content regarding "AI" instead of the show's original focus. I will still be releasing what I am calling research ride-along content to my Patreon, but the show's feed will consist only of content that I aim to make as accessible as possible.

00:35 - TL;DL
01:12 - Advice from Pete
03:10 - My personal goal
05:39 - Reflection on refining my goal
09:08 - Looking forward (logistics

]]> Mon, 11 Mar 2024 09:00:00 -0600 Jacob Haimes Jacob Haimes 789 UPDATE: Contrary to what I say in this episode, I won't be removing any episodes that are already published from the podcast RSS feed. After getting some advice and reflecting more on my own personal goals, I have decided to shift the direction of the podcast towards accessible content regarding "AI" instead of the show's original focus. I will still be releasing what I am calling research ride-along content to my Patreon, but the show's feed will consist only of content that I aim to make as accessible as possible. 00:35 - TL;DL01:12 - Advice from Pete03:10 - My personal goal05:39 - Reflection on refining my goal09:08 - Looking forward (logistics UPDATE: Contrary to what I say in this episode, I won't be removing any episodes that are already published from the podcast RSS feed. After getting some advice and reflecting more on my own personal goals, I have decided to shift the direction of the po technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia INTERVIEW: StakeOut.AI w/ Dr. Peter Park (1) 15 15 INTERVIEW: StakeOut.AI w/ Dr. Peter Park (1) full cd0206b8-6690-44c7-97e3-240c2b082096 https://kairos.fm/intoaisafety/e015 Dr. Peter Park is an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. In conjunction with Harry Luk and one other cofounder, he founded ⁠StakeOut.AI, a non-profit focused on making AI go well for humans.

00:54 - Intro
03:15 - Dr. Park, x-risk, and AGI
08:55 - StakeOut.AI
12:05 - Governance scorecard
19:34 - Hollywood webinar
22:02 - Regulations.gov comments
23:48 - Open letters 
26:15 - EU AI Act
35:07 - Effective accelerationism
40:50 - Divide and conquer dynamics
45:40 - AI "art"
53:09 - Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Dr. Peter Park is an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. In conjunction with Harry Luk and one other cofounder, he founded ⁠StakeOut.AI, a non-profit focused on making AI go well for humans.

00:54 - Intro
03:15 - Dr. Park, x-risk, and AGI
08:55 - StakeOut.AI
12:05 - Governance scorecard
19:34 - Hollywood webinar
22:02 - Regulations.gov comments
23:48 - Open letters 
26:15 - EU AI Act
35:07 - Effective accelerationism
40:50 - Divide and conquer dynamics
45:40 - AI "art"
53:09 - Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 04 Mar 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 3251 Dr. Peter Park is an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. In conjunction with Harry Luk and one other cofounder, he founded ⁠StakeOut.AI, a non-profit focused on making AI go well for humans. 00:54 - Intro03:15 - Dr. Park, x-risk, and AGI08:55 - StakeOut.AI12:05 - Governance scorecard19:34 - Hollywood webinar22:02 - Regulations.gov comments23:48 - Open letters 26:15 - EU AI Act35:07 - Effective accelerationism40:50 - Divide and conquer dynamics45:40 - AI "art"53:09 - Outro Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. StakeOut.AI AI Governance Scorecard (go to Pg. 3) Pause AI Regulations.gov USCO StakeOut.AI Comment OMB StakeOut.AI Comment AI Treaty open letter TAISC Alpaca: A Strong, Replicable Instruction-Following Model References on EU AI Act and Cedric O Tweet from Cedric O EU policymakers enter the last mile for Artificial Intelligence rulebook AI Act: EU Parliament’s legal office gives damning opinion on high-risk classification ‘filters’ EU’s AI Act negotiations hit the brakes over foundation models The EU AI Act needs Foundation Model Regulation BigTech’s Efforts to Derail the AI Act Open Sourcing the AI Revolution: Framing the debate on open source, artificial intelligence and regulation Divide-and-Conquer Dynamics in AI-Driven Disempowerment Dr. Peter Park is an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. In conjunction with Harry Luk and one other cofounder, he founded ⁠StakeOut.AI, a non-profit focused on making AI go well for humans. 00:54 - Intro03:15 technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia Dr. Peter S. Park MINISODE: "LLMs, a Survey" 14 14 MINISODE: "LLMs, a Survey" full 2d7e4db8-5798-4148-9e19-53a5143c4919 https://kairos.fm/intoaisafety/e014 Take a trip with me through the paper Large Language Models, A Survey, published on February 9th of 2024. All figures and tables mentioned throughout the episode can be found on the Into AI Safety podcast website.

00:36 - Intro and authors
01:50 - My takes and paper structure
04:40 - Getting to LLMs
07:27 - Defining LLMs & emergence
12:12 - Overview of PLMs
15:00 - How LLMs are built
18:52 - Limitations if LLMs
23:06 - Uses of LLMs
25:16 - Evaluations and Benchmarks
28:11 - Challenges and future directions
29:21 - Recap & outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Take a trip with me through the paper Large Language Models, A Survey, published on February 9th of 2024. All figures and tables mentioned throughout the episode can be found on the Into AI Safety podcast website.

00:36 - Intro and authors
01:50 - My takes and paper structure
04:40 - Getting to LLMs
07:27 - Defining LLMs & emergence
12:12 - Overview of PLMs
15:00 - How LLMs are built
18:52 - Limitations if LLMs
23:06 - Uses of LLMs
25:16 - Evaluations and Benchmarks
28:11 - Challenges and future directions
29:21 - Recap & outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 26 Feb 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 1855 Take a trip with me through the paper Large Language Models, A Survey, published on February 9th of 2024. All figures and tables mentioned throughout the episode can be found on the Into AI Safety podcast website. 00:36 - Intro and authors01:50 - My takes and paper structure04:40 - Getting to LLMs07:27 - Defining LLMs & emergence12:12 - Overview of PLMs15:00 - How LLMs are built18:52 - Limitations if LLMs23:06 - Uses of LLMs25:16 - Evaluations and Benchmarks28:11 - Challenges and future directions29:21 - Recap & outro Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.Large Language Models, A SurveyMeysam's LinkedIn PostClaude E. ShannonA symbolic analysis of relay and switching circuits (Master's Thesis)Communication theory of secrecy systemsA mathematical theory of communicationPrediction and entropy of printed EnglishFuture ML Systems Will Be Qualitatively DifferentMore Is DifferentSleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingAre Emergent Abilities of Large Language Models a Mirage?Are Emergent Abilities of Large Language Models just In-Context Learning?Attention is all you needDirect Preference Optimization: Your Language Model is Secretly a Reward ModelKTO: Model Alignment as Prospect Theoretic OptimizationOptimization by Simulated AnnealingMemory and new controls for ChatGPTHallucinations and related concepts—their conceptual background Take a trip with me through the paper Large Language Models, A Survey, published on February 9th of 2024. All figures and tables mentioned throughout the episode can be found on the Into AI Safety podcast website. 00:36 - Intro and authors01:50 - My take technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia FEEDBACK: Applying for Funding w/ Esben Kran 13 13 FEEDBACK: Applying for Funding w/ Esben Kran full 9c9288c4-d48b-48fa-aec6-b11cc5803619 https://kairos.fm/intoaisafety/e013 Esben reviews an application that I would soon submit for Open Philanthropy's Career Transitition Funding opportunity. Although I didn't end up receiving the funding, I do think that this episode can be a valuable resource for both others and myself when applying for funding in the future.

Head over to Apart Research's website to check out their work, or the Alignment Jam website for information on upcoming hackathons.

A doc-capsule of the application at the time of this recording can be found at this link.

01:38 - Interview starts
05:41 - Proposal
11:00 - Personal statement
14:00 - Budget
21:12 - CV
22:45 - Application questions
34:06 - Funding questions
44:25 - Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Esben reviews an application that I would soon submit for Open Philanthropy's Career Transitition Funding opportunity. Although I didn't end up receiving the funding, I do think that this episode can be a valuable resource for both others and myself when applying for funding in the future.

Head over to Apart Research's website to check out their work, or the Alignment Jam website for information on upcoming hackathons.

A doc-capsule of the application at the time of this recording can be found at this link.

01:38 - Interview starts
05:41 - Proposal
11:00 - Personal statement
14:00 - Budget
21:12 - CV
22:45 - Application questions
34:06 - Funding questions
44:25 - Outro

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 19 Feb 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 2713 Esben reviews an application that I would soon submit for Open Philanthropy's Career Transitition Funding opportunity. Although I didn't end up receiving the funding, I do think that this episode can be a valuable resource for both others and myself when applying for funding in the future.Head over to Apart Research's website to check out their work, or the Alignment Jam website for information on upcoming hackathons.A doc-capsule of the application at the time of this recording can be found at this link.01:38 - Interview starts05:41 - Proposal11:00 - Personal statement14:00 - Budget21:12 - CV22:45 - Application questions34:06 - Funding questions44:25 - OutroLinks to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.AI governance talent profiles we’d like to seeThe AI Governance Research SprintReasoning TransparencyPlaces to look for fundingOpen Philanthropy's Career development and transition fundingLong-Term Future FundManifund Esben reviews an application that I would soon submit for Open Philanthropy's Career Transitition Funding opportunity. Although I didn't end up receiving the funding, I do think that this episode can be a valuable resource for both others and myself when technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia MINISODE: Reading a Research Paper 12 12 MINISODE: Reading a Research Paper full 37fd4eb5-ba2f-419e-aa24-9a1425a69051 https://kairos.fm/intoaisafety/e012 Before I begin with the paper-distillation based minisodes, I figured we would go over best practices for reading research papers. I go through the anatomy of typical papers, and some generally applicable advice.

00:56 - Anatomy of a paper
02:38 - Most common advice
05:24 - Reading sparsity and path
07:30 - Notes and motivation

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Before I begin with the paper-distillation based minisodes, I figured we would go over best practices for reading research papers. I go through the anatomy of typical papers, and some generally applicable advice.

00:56 - Anatomy of a paper
02:38 - Most common advice
05:24 - Reading sparsity and path
07:30 - Notes and motivation

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 12 Feb 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 565 Before I begin with the paper-distillation based minisodes, I figured we would go over best practices for reading research papers. I go through the anatomy of typical papers, and some generally applicable advice.00:56 - Anatomy of a paper02:38 - Most common advice05:24 - Reading sparsity and path07:30 - Notes and motivationLinks to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.Ten simple rules for reading a scientific paperBest sources I foundLet's get critical: Reading academic articles#GradHacks: A guide to reading research papersHow to read a scientific paper (presentation)Some more sourcesHow to read a scientific articleHow to read a research paperReading a scientific article Before I begin with the paper-distillation based minisodes, I figured we would go over best practices for reading research papers. I go through the anatomy of typical papers, and some generally applicable advice.00:56 - Anatomy of a paper02:38 - Most comm technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia HACKATHON: Evals November 2023 (2) 11 11 HACKATHON: Evals November 2023 (2) full 5e003e1c-4e32-487d-905f-9672cc241a26 https://kairos.fm/intoaisafety/e011 Join our hackathon group for the second episode in the Evals November 2023 Hackathon subseries. In this episode, we solidify our goals for the hackathon after some preliminary experimentation and ideation.

Check out Stellaric's website, or follow them on Twitter.

01:53 - Meeting starts
05:05 - Pitch: extension of locked models
23:23 - Pitch: retroactive holdout datasets
34:04 - Preliminary results
37:44 - Next steps
42:55 - Recap

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Join our hackathon group for the second episode in the Evals November 2023 Hackathon subseries. In this episode, we solidify our goals for the hackathon after some preliminary experimentation and ideation.

Check out Stellaric's website, or follow them on Twitter.

01:53 - Meeting starts
05:05 - Pitch: extension of locked models
23:23 - Pitch: retroactive holdout datasets
34:04 - Preliminary results
37:44 - Next steps
42:55 - Recap

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 05 Feb 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 2919 Join our hackathon group for the second episode in the Evals November 2023 Hackathon subseries. In this episode, we solidify our goals for the hackathon after some preliminary experimentation and ideation.Check out Stellaric's website, or follow them on Twitter.01:53 - Meeting starts05:05 - Pitch: extension of locked models23:23 - Pitch: retroactive holdout datasets34:04 - Preliminary results37:44 - Next steps42:55 - RecapLinks to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.Evalugator libraryPassword Locked Model blogpostTruthfulQA: Measuring How Models Mimic Human FalsehoodsBLEU: a Method for Automatic Evaluation of Machine TranslationBoolQ: Exploring the Surprising Difficulty of Natural Yes/No QuestionsDetecting Pretraining Data from Large Language Models Join our hackathon group for the second episode in the Evals November 2023 Hackathon subseries. In this episode, we solidify our goals for the hackathon after some preliminary experimentation and ideation.Check out Stellaric's website, or follow them on T technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia MINISODE: Portfolios 10 10 MINISODE: Portfolios full d42a5525-a155-4891-9cd1-98b1af663463 https://kairos.fm/intoaisafety/e010 I provide my thoughts and recommendations regarding personal professional portfolios.

00:35 - Intro to portfolios
01:42 - Modern portfolios
02:27 - What to include
04:38 - Importance of visual
05:50 - The "About" page
06:25 - Tools
08:12 - Future of "Minisodes"

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> I provide my thoughts and recommendations regarding personal professional portfolios.

00:35 - Intro to portfolios
01:42 - Modern portfolios
02:27 - What to include
04:38 - Importance of visual
05:50 - The "About" page
06:25 - Tools
08:12 - Future of "Minisodes"

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 29 Jan 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 579 I provide my thoughts and recommendations regarding personal professional portfolios. 00:35 - Intro to portfolios01:42 - Modern portfolios02:27 - What to include04:38 - Importance of visual05:50 - The "About" page06:25 - Tools08:12 - Future of "Minisodes" Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.From Portafoglio to Eportfolio: The Evolution of Portfolio in Higher EducationGIMPAlternativeToJekyllGitHub PagesMinimal MistakesMy portfolio I provide my thoughts and recommendations regarding personal professional portfolios. 00:35 - Intro to portfolios01:42 - Modern portfolios02:27 - What to include04:38 - Importance of visual05:50 - The "About" page06:25 - Tools08:12 - Future of "Minisodes technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia INTERVIEW: Polysemanticity w/ Dr. Darryl Wright 9 9 INTERVIEW: Polysemanticity w/ Dr. Darryl Wright full f4ca1b13-2c6d-4c18-a458-9131448382b3 https://kairos.fm/intoaisafety/e009 Darryl and I discuss his background, how he became interested in machine learning, and a project we are currently working on investigating the penalization of polysemanticity during the training of neural networks.

Check out a diagram of the decoder task used for our research!

01:46 - Interview begins
02:14 - Supernovae classification
08:58 - Penalizing polysemanticity
20:58 - Our "toy model"
30:06 - Task description
32:47 - Addressing hurdles
39:20 - Lessons learned

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Darryl and I discuss his background, how he became interested in machine learning, and a project we are currently working on investigating the penalization of polysemanticity during the training of neural networks.

Check out a diagram of the decoder task used for our research!

01:46 - Interview begins
02:14 - Supernovae classification
08:58 - Penalizing polysemanticity
20:58 - Our "toy model"
30:06 - Task description
32:47 - Addressing hurdles
39:20 - Lessons learned

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 22 Jan 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 2709 Darryl and I discuss his background, how he became interested in machine learning, and a project we are currently working on investigating the penalization of polysemanticity during the training of neural networks. Check out a diagram of the decoder task used for our research! 01:46 - Interview begins02:14 - Supernovae classification08:58 - Penalizing polysemanticity20:58 - Our "toy model"30:06 - Task description32:47 - Addressing hurdles39:20 - Lessons learned Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. Zooniverse BlueDot Impact AI Safety Support Zoom In: An Introduction to Circuits MNIST dataset on PapersWithCode Clusterability in Neural Networks CIFAR-10 dataset Effective Altruism Global CLIP (blog post) Long Term Future Fund Engineering Monosemanticity in Toy Models Darryl and I discuss his background, how he became interested in machine learning, and a project we are currently working on investigating the penalization of polysemanticity during the training of neural networks. Check out a diagram of the decoder task technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia MINISODE: Starting a Podcast 8 8 MINISODE: Starting a Podcast full 24d72baa-2a3e-4ae1-8d64-2af3b7cb34bb https://kairos.fm/intoaisafety/e008 A summary and reflections on the path I have taken to get this podcast started, including some resources recommendations for others who want to do something similar.


Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> A summary and reflections on the path I have taken to get this podcast started, including some resources recommendations for others who want to do something similar.


Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 15 Jan 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 635 A summary and reflections on the path I have taken to get this podcast started, including some resources recommendations for others who want to do something similar.Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.LessWrongSpotify for PodcastersInto AI Safety podcast websiteEffective Altruism GlobalOpen Broadcaster Software (OBS)CraigRiverside A summary and reflections on the path I have taken to get this podcast started, including some resources recommendations for others who want to do something similar.Links to all articles/papers which are mentioned throughout the episode can be found below technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia HACKATHON: Evals November 2023 (1) 7 7 HACKATHON: Evals November 2023 (1) full cbde84b2-3937-4512-8d71-fee6c23e2ec6 https://kairos.fm/intoaisafety/e007 This episode kicks off our first subseries, which will consist of recordings taken during my team's meetings for the AlignmentJams Evals Hackathon in November of 2023. Our team won first place, so you'll be listening to the process which, at the end of the day, turned out to be pretty good.


Check out Apart Research, the group that runs the AlignmentJamz Hackathons.


Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> This episode kicks off our first subseries, which will consist of recordings taken during my team's meetings for the AlignmentJams Evals Hackathon in November of 2023. Our team won first place, so you'll be listening to the process which, at the end of the day, turned out to be pretty good.


Check out Apart Research, the group that runs the AlignmentJamz Hackathons.


Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 08 Jan 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 4119 This episode kicks off our first subseries, which will consist of recordings taken during my team's meetings for the AlignmentJams Evals Hackathon in November of 2023. Our team won first place, so you'll be listening to the process which, at the end of the day, turned out to be pretty good.Check out Apart Research, the group that runs the AlignmentJamz Hackathons.Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure DomainsNew paper shows truthfulness & instruction-following don't generalize by defaultGeneralization Analogies WebsiteDiscovering Language Model Behaviors with Model-Written EvaluationsModel-Written Evals WebsiteOpenAI Evals GitHubMETR (previously ARC Evals)Goodharting on WikipediaFrom Instructions to Intrinsic Human Values, a Survey of Alignment Goals for Big ModelsFine Tuning Aligned Language Models Compromises Safety Even When Users Do Not IntendShadow Alignment: The Ease of Subverting Safely Aligned Language ModelsWill Releasing the Weights of Future Large Language Models Grant Widespread Access to Pandemic Agents?Building Less Flawed Metrics, Understanding and Creating Better Measurement and Incentive SystemseLeutherAI's Model Evaluation HarnessEvalugator Library This episode kicks off our first subseries, which will consist of recordings taken during my team's meetings for the AlignmentJams Evals Hackathon in November of 2023. Our team won first place, so you'll be listening to the process which, at the end of th technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia MINISODE: Staying Up-to-Date in AI 6 6 MINISODE: Staying Up-to-Date in AI full affbff67-b344-480f-bdf4-d62c1ee3e82c https://kairos.fm/intoaisafety/e006 In this minisode I give some tips for staying up-to-date in the everchanging landscape of AI. I would like to point out that I am constantly iterating on these strategies, tools, and sources, so it is likely that I will make an update episode in the future.


Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> In this minisode I give some tips for staying up-to-date in the everchanging landscape of AI. I would like to point out that I am constantly iterating on these strategies, tools, and sources, so it is likely that I will make an update episode in the future.


Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

]]> Mon, 01 Jan 2024 09:00:00 -0700 Jacob Haimes Jacob Haimes 785 In this minisode I give some tips for staying up-to-date in the everchanging landscape of AI. I would like to point out that I am constantly iterating on these strategies, tools, and sources, so it is likely that I will make an update episode in the future. Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. ToolsFeedlyarXiv Sanity LiteZoteroAlternativeToMy "Distilled AI" FolderAI Explained YouTube channelAI Safety newsletterData Machina newsletterImport AIMidwit AlignmentHonourable MentionsAI Alignment ForumLessWrongBounded Regret (Jacob Steinhart's blog)Cold Takes (Holden Karnofsky's blog)Chris Olah's blog Tim Dettmers blogEpoch blogApollo Research blog In this minisode I give some tips for staying up-to-date in the everchanging landscape of AI. I would like to point out that I am constantly iterating on these strategies, tools, and sources, so it is likely that I will make an update episode in the futur technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia INTERVIEW: Applications w/ Alice Rigg 5 5 INTERVIEW: Applications w/ Alice Rigg full b2215bea-18f8-497a-b76f-4bb095c79cf0 https://kairos.fm/intoaisafety/e005 Alice Rigg, a mechanistic interpretability researcher from Ottawa, Canada, joins me to discuss their path and the applications process for research/mentorship programs.

Join the Mech Interp Discord server and attend reading groups at 11:00am on Wednesdays (Mountain Time)!

Check out Alice's website.

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 


]]> Alice Rigg, a mechanistic interpretability researcher from Ottawa, Canada, joins me to discuss their path and the applications process for research/mentorship programs.

Join the Mech Interp Discord server and attend reading groups at 11:00am on Wednesdays (Mountain Time)!

Check out Alice's website.

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 


]]> Mon, 18 Dec 2023 09:00:00 -0700 Jacob Haimes Jacob Haimes 4241 Alice Rigg, a mechanistic interpretability researcher from Ottawa, Canada, joins me to discuss their path and the applications process for research/mentorship programs. Join the Mech Interp Discord server and attend reading groups at 11:00am on Wednesdays (Mountain Time)! Check out Alice's website. Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. EleutherAI Join the public EleutherAI discord server Distill Effective Altruism (EA) MATS Retrospective Summer 2023 post Ambitious Mechanistic Interpretability AISC research plan by Alice Rigg SPAR Stability AI During their most recent fundraising round, Stability AI had a valuation of $4B (Bloomberg) Mech Interp Discord Server Alice Rigg, a mechanistic interpretability researcher from Ottawa, Canada, joins me to discuss their path and the applications process for research/mentorship programs. Join the Mech Interp Discord server and attend reading groups at 11:00am on Wednesday technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia MINISODE: Program Applications (Winter 2024) 4 4 MINISODE: Program Applications (Winter 2024) full 2f5c7fd0-e665-4850-a48c-b4d20f05f4af https://kairos.fm/intoaisafety/e004 We're back after a month-long hiatus with a podcast refactor and advice on the applications process for research/mentorship programs.

Check out the About page on the Into AI Safety website for a summary of the logistics updates.

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 

]]> We're back after a month-long hiatus with a podcast refactor and advice on the applications process for research/mentorship programs.

Check out the About page on the Into AI Safety website for a summary of the logistics updates.

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 

]]> Mon, 11 Dec 2023 09:00:00 -0700 Jacob Haimes Jacob Haimes 1085 We're back after a month-long hiatus with a podcast refactor and advice on the applications process for research/mentorship programs. Check out the About page on the Into AI Safety website for a summary of the logistics updates. Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. MATSASTRA FellowshipARENAAI Safety Camp BlueDot ImpactTech with TimFast.AI's Practical Deep Learning for CodersKaggleAlignmentJamsLessWrongAI Alignment Forum We're back after a month-long hiatus with a podcast refactor and advice on the applications process for research/mentorship programs. Check out the About page on the Into AI Safety website for a summary of the logistics updates. Links to all articles/pa technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes Chase Precopia MINISODE: EAG Takeaways (Boston 2023) 3 3 MINISODE: EAG Takeaways (Boston 2023) full dc2fc55a-dca7-44c6-bf9e-be0c4e9eb971 https://kairos.fm/intoaisafety/e003 This episode is a brief overview of the major takeaways I had from attending EAG Boston 2023, and an update on my plans for the podcast moving forward.

TL;DL

  • Starting in early December (2023), I will be uploading episodes on a biweekly basis (day TBD).
  • I won't be releasing another episode until then, so that I can build a cache of episodes up.
  • During this month (November 2023), I'll also try to get the podcast up on more platforms, set up comments on more platforms, and create an anonymous feedback form.

Links Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 

Like the show? Think it could be improved? Fill out this anonymous feedback form to let me know!

Please email all inquiries to intoaisafety@gmail.com.

]]> This episode is a brief overview of the major takeaways I had from attending EAG Boston 2023, and an update on my plans for the podcast moving forward.

TL;DL

  • Starting in early December (2023), I will be uploading episodes on a biweekly basis (day TBD).
  • I won't be releasing another episode until then, so that I can build a cache of episodes up.
  • During this month (November 2023), I'll also try to get the podcast up on more platforms, set up comments on more platforms, and create an anonymous feedback form.

Links Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 

Like the show? Think it could be improved? Fill out this anonymous feedback form to let me know!

Please email all inquiries to intoaisafety@gmail.com.

]]> Mon, 04 Dec 2023 09:00:00 -0700 Jacob Haimes Jacob Haimes 577 This episode is a brief overview of the major takeaways I had from attending EAG Boston 2023, and an update on my plans for the podcast moving forward. TL;DL Starting in early December (2023), I will be uploading episodes on a biweekly basis (day TBD).I won't be releasing another episode until then, so that I can build a cache of episodes up.During this month (November 2023), I'll also try to get the podcast up on more platforms, set up comments on more platforms, and create an anonymous feedback form. Links Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. How to generate research proposalsKarolina Sarek: How to do research that mattersWill releasing the weights of future large language models grant widespread access to pandemic agents? Like the show? Think it could be improved? Fill out this anonymous feedback form to let me know! Please email all inquiries to intoaisafety@gmail.com. This episode is a brief overview of the major takeaways I had from attending EAG Boston 2023, and an update on my plans for the podcast moving forward. TL;DL Starting in early December (2023), I will be uploading episodes on a biweekly basis (day TBD).I technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes FEEDBACK: AISC Proposal w/ Remmelt Ellen 2 2 FEEDBACK: AISC Proposal w/ Remmelt Ellen full 084356f7-066c-49d9-b8d9-a45f7162f138 https://kairos.fm/intoaisafety/e002 In this episode I discuss my initial research proposal for the 2024 Winter AI Safety Camp with one of the individuals who helps facilitate the program, Remmelt Ellen.

The proposal is titled The Effect of Machine Learning on Bioengineered Pandemic Risk. A doc-capsule of the proposal at the time of this recording can be found at this link.

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 

]]> In this episode I discuss my initial research proposal for the 2024 Winter AI Safety Camp with one of the individuals who helps facilitate the program, Remmelt Ellen.

The proposal is titled The Effect of Machine Learning on Bioengineered Pandemic Risk. A doc-capsule of the proposal at the time of this recording can be found at this link.

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. 

]]> Mon, 27 Nov 2023 09:00:00 -0700 Jacob Haimes Jacob Haimes 3398 In this episode I discuss my initial research proposal for the 2024 Winter AI Safety Camp with one of the individuals who helps facilitate the program, Remmelt Ellen. The proposal is titled The Effect of Machine Learning on Bioengineered Pandemic Risk. A doc-capsule of the proposal at the time of this recording can be found at this link. Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance. MegaSyn: Integrating Generative Molecule Design, Automated Analog Designer and Synthetic Viability PredictionDual use of artificial-intelligence-powered drug discoveryArtificial intelligence and biological misuse: Differentiating risks of language models and biological design toolsModel Organisms of Misalignment: The Case for a New Pillar of Alignment ResearchShadow Alignment: The Ease of Subverting Safely-Aligned Language ModelsFine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!unRLHF - Efficiently undoing LLM safeguards In this episode I discuss my initial research proposal for the 2024 Winter AI Safety Camp with one of the individuals who helps facilitate the program, Remmelt Ellen. The proposal is titled The Effect of Machine Learning on Bioengineered Pandemic Risk. A technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes MINISODE: Introduction and Motivation 1 1 MINISODE: Introduction and Motivation full 4a709b26-c999-4113-b23f-daeac781b2df https://kairos.fm/intoaisafety/e001 Welcome to the Into AI Safety podcast! In this episode I provide reasoning for why I am starting this podcast, what I am trying to accomplish with it, and a little bit of background on how I got here.

Please email all inquiries and suggestions to intoaisafety@gmail.com.

]]> Welcome to the Into AI Safety podcast! In this episode I provide reasoning for why I am starting this podcast, what I am trying to accomplish with it, and a little bit of background on how I got here.

Please email all inquiries and suggestions to intoaisafety@gmail.com.

]]> Mon, 13 Nov 2023 09:00:00 -0700 Jacob Haimes Jacob Haimes 583 Welcome to the Into AI Safety podcast! In this episode I provide reasoning for why I am starting this podcast, what I am trying to accomplish with it, and a little bit of background on how I got here.

Please email all inquiries and suggestions to intoaisafety@gmail.com.

]]> technology, AI, artificial intelligence, machine learning, safety No Jacob Haimes