What A Big Tech Whistleblower Learned About Power

2026-10-10 09:55:00 • 1:01:06

-

Offline is brought to you by NetSuite.

0:02

Across global markets, AI is changing the way businesses conduct

0:05

themselves from the top down.

0:07

That's the idea behind NetSuite next.

0:09

The next generation of the business management suite

0:11

trusted by over 44,000 companies with AI woven into

0:15

every tool you already rely on.

0:17

It's a unified suite that brings your financials, inventory,

0:19

commerce, HR, and CRM into a single source of truth.

0:23

It automatically surfaces custom insights throughout your day.

0:26

NetSuite is customized for a wide range of industries,

0:29

so it supports the way your business truly works.

0:32

Whether your company earns millions or even hundreds of

0:34

millions, it's time for NetSuite next,

0:36

where your business meets AI.

0:39

Our finance team uses NetSuite.

0:40

Here's what Jessica has to say.

0:42

Our finance team has used NetSuite for years now,

0:45

and they love it because it is scalable and equipped

0:47

to handle all of our operational needs.

0:49

From generating invoices to producing key reports

0:51

that support short-term or long-term business decisions,

0:54

NetSuite serves as a reliable, all-in-one platform

0:57

that helps our team work efficiently and stay organized.

1:00

If your revenues are at least in the seven figures,

1:02

go to NetSuite.com slash offline.

1:05

Get your free guide at NetSuite.com slash offline.

1:08

NetSuite.com slash offline.

1:10

NetSuite.com slash offline.

1:13

Boo!

1:14

Spooky season has officially entered the group chat,

1:17

and that means one thing.

1:18

It's time to stock the fridge and summon your squad

1:20

with smear-nauffice.

1:22

Whether you're headed to a costume party,

1:23

hosting a scary movie marathon,

1:25

or laying low with a backyard bonfire,

1:28

smear-smeat always delivers.

1:30

And honestly, being the friend who remember to bring the drinks

1:33

is elite behavior.

1:34

So skip the tricks and get the party started

1:37

with a treat that's cold, crisp, and perfectly mixed.

1:40

And hey, if you're looking to switch things up,

1:41

check out smear-nauffice zero sugar.

1:44

Same flavors you love with zero sugar and 100 calories.

1:47

Game changer.

1:48

Smear-nauffice.

1:49

Two crisp to resist.

1:51

Please enjoy responsibly.

1:53

Must be 21 plus.

1:55

Your time is valuable.

1:56

Why spend hours waiting at the ER?

1:58

Solace Health is the only concierge immediate care

2:01

membership with exceptional urgent and emergency care

2:04

on your schedule.

2:06

No crowded waiting rooms or restrictive scheduling.

2:08

Just top ER doctors, advanced imaging,

2:11

and specialist referrals all available 24-7.

2:15

Find a Solace Health Center near you

2:17

and sign up at solacehealth.com.

2:20

That's S-O-L-L-L-I-S health.com.

2:24

We decided to have maybe like a public whistleblower,

2:26

like maybe five weeks before the first

2:30

Western Journal story came out.

2:31

I was like in this pit of despair,

2:33

I mean like I cannot escape the circumstances that I am in.

2:37

I never ever thought in my wildest dreams

2:40

that like my story might inspire an AI

2:43

whistleblower one day.

2:44

How much of what went wrong at Facebook

2:46

do you blame on Mark Zuckerberg personally

2:50

and how much was baked into the structure

2:53

and incentives of the company?

2:54

Ooh.

2:56

And how much are those two intertwined?

2:58

Right.

2:59

We ran an experiment where we stopped

3:01

sending kids notifications during the school day,

3:03

stopped sending them late at night,

3:04

kids have said they're less stressed,

3:06

there's no point in us launching this though

3:08

because they spend 1% fewer minutes a month.

3:11

And Mark has said that's all he cares about.

3:13

One thing I wish we were seeing more

3:14

from the current kind of crop of AI whistleblowers,

3:17

we get a lot of accounts.

3:19

We are not getting a lot of what I would call data

3:22

or like evidence.

3:23

The only place where you can really study these things

3:25

where the conversations are fully happening

3:27

is behind those closed doors.

3:29

If you are going to leave,

3:31

like we need your help trying to bootstrap

3:34

more of that public understanding,

3:36

the thing that the government provides

3:37

is kind of like the ref who says like,

3:40

yeah, like that car actually has fewer fatalities

3:43

or when we did crash tests,

3:44

the dummy's got less damage.

3:46

Like we should be asking what is the crash test dummy of AI?

3:52

What do you do when being right isn't enough to change what's wrong?

4:02

You speak up, you make your case,

4:04

you show people the evidence,

4:05

but what happens when they believe you

4:08

and still don't act?

4:10

What do you do then?

4:11

Francis Hagen knows this dilemma better than most.

4:14

Five years ago,

4:14

she was a data scientist at Facebook

4:16

who became convinced the company was dismissing serious dangers

4:20

that its own researchers had discovered.

4:22

So she copied thousands of pages of internal documents,

4:25

gave them to journalists and regulators,

4:28

and eventually revealed herself as the whistleblower behind

4:31

what became known as the Facebook files.

4:33

This week her story is getting the full Aaron Sorkin treatment

4:36

in the social reckoning,

4:38

a follow-up to the social network

4:39

based on Hagen's memoir, The Power of One.

4:42

Sure enough,

4:43

the movie has a classic Hollywood story

4:45

about one brave person taking on a big powerful corporation.

4:49

But the more I've thought about Hagen's story,

4:51

the more I've realized that the Hollywood version

4:53

leaves out the most important part.

4:55

Facebook's problem wasn't that no one inside the company

4:58

knew anything was wrong.

4:59

They knew a lot.

5:00

Their own researchers knew that Instagram

5:02

could harm teenage girls who struggle with body image issues.

5:06

Their own employees warned that Facebook's algorithm

5:08

was poisoning our political climate,

5:10

fueling hate speech and violence in other countries.

5:13

These people knew the risks,

5:15

they knew the dangers,

5:16

they had the evidence,

5:17

but being right wasn't enough.

5:20

For Mark Zuckerberg and Facebook senior leaders,

5:23

all those warnings and studies collided with other pressures

5:27

to keep people on the platforms,

5:28

to grow the company,

5:30

to beat the competition,

5:31

to generate more profit.

5:33

They ultimately had to decide how much money and influence

5:36

they were willing to sacrifice

5:38

in order to prevent harms that were harder to measure

5:41

and might not happen for years.

5:43

And the answer turned out to be very little.

5:47

Five years later,

5:48

the Francis Huggins who work in artificial intelligence

5:50

are wrestling with an even harder question.

5:53

What if the people in charge of your company

5:54

are also warning about the dangers

5:56

and that's still not enough?

5:58

Anthropic founder, Dario Amade,

6:00

has repeatedly sounded the alarm

6:02

about the potentially catastrophic risks

6:04

of developing AI that we may not be able to control.

6:08

And a common response has been,

6:09

why don't you just stop then?

6:11

Why don't you just decide on your own to slow down?

6:14

Well,

6:15

what if Anthropic slows down

6:17

but open AI doesn't?

6:18

What if Google doesn't?

6:19

What if China doesn't?

6:21

The truth is problems that affect all of us

6:23

cannot be solved by any one of us.

6:26

Not by one whistleblower who exposes the truth.

6:29

Not by one CEO who wants to do the right thing.

6:32

You don't ask the nicest factory owner

6:34

to stop dumping poison into the river

6:36

while all their competitors get to keep doing it.

6:39

You make dumping poison into the river illegal.

6:42

These kinds of problems,

6:43

whether it's pollution or AI or future pandemics,

6:47

require convincing a lot of people

6:49

who may not agree on much else

6:50

to come together and figure out what happens next.

6:54

Pass the law, sign the agreement,

6:57

join the strike, file the lawsuit,

6:59

show up, vote,

7:01

because being right about something

7:02

isn't the same as having the power to change it.

7:05

For most of us,

7:06

the place where we now experience politics every day

7:09

is on the very social media platforms

7:11

that Francis Hagen warned us about.

7:12

We operate in an information environment

7:15

that primarily rewards us

7:17

for successfully expressing

7:18

and proving what we believe.

7:20

You post the take,

7:22

you bring the receipts,

7:23

you expose the hypocrisy,

7:25

the like start rolling in and pretty soon,

7:27

you're on the winning side of a viral exchange.

7:30

Cool.

7:32

Now what?

7:32

What did you actually convince all those people to do?

7:36

Did someone decide to vote?

7:38

Did more people join an organization?

7:40

Did enough politicians change their minds?

7:43

If not, what's the plan to replace them?

7:45

What's the plan to build enough power

7:47

to actually bring about the change that you want?

7:50

None of this means one person's choices don't matter.

7:53

They have to.

7:54

Collective action has to begin somewhere

7:56

with somebody,

7:57

which brings me back to the power of one.

7:59

Hagen said she often thinks about Vachlav Havill,

8:02

the Czech playwright and dissident

8:03

who helped lead the movement

8:04

that brought down communist rule in Czechoslovakia.

8:07

Years before that happened.

8:09

Havill wrote an essay called The Power of the Powerless.

8:13

About what an individual can do inside a system

8:16

that seems too big and powerful to change.

8:18

His answer wasn't that one person

8:20

could bring down the system alone.

8:21

It was that you could refuse to participate in its lies.

8:25

You could make a different choice.

8:28

And when other people saw you do that,

8:30

it could change what they believed was possible for themselves.

8:34

Hagen put it this way.

8:35

People see that you've reclaimed a little bit of your own life

8:39

and it actually changes how they live.

8:42

And maybe that's the real power of one.

8:44

Not the ability to fix everything yourself,

8:47

but to make someone else believe that they can act too.

8:50

And then someone else.

8:52

Until enough of us are acting together

8:54

that the people in charge have no choice

8:56

but to finally change.

8:59

My guess this week is Francis Hagen,

9:01

whose decision to blow the whistle on Facebook

9:03

became one of the biggest tech stories of the last decade,

9:06

and one which is now the subject of Aaron Sorkin's new movie,

9:09

The Social Reckoning.

9:11

We talked about what it was like for her to see her life

9:13

dramatized on the big screen,

9:15

what she learned from trying to change Facebook from the inside,

9:18

and what she tell the growing number of AI employees

9:21

who are now wrestling with many of the same questions.

9:24

We also get into whether whistle blowing actually works,

9:27

what it takes to hold powerful tech companies accountable

9:30

and how one person speaking up can sometimes

9:32

get a whole lot of other people to act.

9:35

Here's Francis Hagen.

9:40

Francis, welcome to the show.

9:41

Thank you for inviting me.

9:42

Happy to be here.

9:43

So you've had quite a journey over the last five years.

9:46

You've gone from Facebook,

9:48

Data Engineer to Whistleblower to author and advocate to

9:52

as of this week, the central character of an Aaron Sorkin movie

9:56

based on your memoir.

9:58

What was it like to watch the Hollywood version

10:01

of one of the strangest and probably most stressful periods

10:05

of your life?

10:08

You know, the first time I got to see the movie was maybe

10:12

three weeks ago.

10:13

So they called me on Thursday and they're like,

10:16

are you by chance in LA in the next week?

10:18

And I'm like, no, I live in Puerto Rico.

10:20

Like I'm thousands of miles away.

10:22

I'm just by chance in LA.

10:23

And so they had me come out and for like 36 hours

10:27

and come see the movie.

10:29

And I saw it at Sony Studio,

10:33

this little time screen room by myself.

10:35

And it's, I think the thing that it captures really,

10:40

really well is kind of the stakes.

10:42

So when I was blowing the whistle,

10:46

like I wasn't that worried about like legal consequences

10:49

because Facebook had never, they never sued anyone until

10:52

Sarah Wynne Williams published careless people.

10:54

But I did, I was so afraid of getting caught because I knew

11:00

if I got caught, they would close the doors behind me

11:03

and no one else would ever get to try.

11:05

And so they really caught capture kind of that intensity

11:08

and they also capture kind of like the magic.

11:11

So when I started working with Jeff,

11:13

there were things I knew for sure.

11:15

And there were things that were like known unknowns.

11:17

And that kind of like excitement of discovery

11:20

as like the puzzle pieces like click in the place.

11:22

Like I thought the movie did a really good job of capturing.

11:25

Like it really did feel magical while we were figuring out

11:27

what was going on.

11:29

So the movie is framed as a, you know, David and Goliath story

11:34

about one employee you taking on one of the world's most powerful companies.

11:39

Is that how it felt to you at the time?

11:41

You know, at the time, it, you know, people have used the words

11:45

like hero before with me.

11:46

And I always feel really uncomfortable about it because like the way

11:50

what, when I was going through what it felt like was Facebook

11:53

had put me in an impossible position.

11:55

So like I joined the company thinking I was going to work on

11:58

like prep for the 2020 election.

12:00

And I got there and got exposed to like the Facebook

12:04

was just very openly aware that choices they had made or lack of action

12:09

was putting lives at risk in countries and places like Africa

12:12

or Southeast Asia.

12:13

Like the genocide in Myanmar had happened in the previous like 18 months.

12:16

We're 25,000 people had died.

12:19

And I felt like I had no choice.

12:23

Right.

12:24

Like I was, I was either, they made me culpable because now I knew.

12:27

And I had this fear that if I did nothing, I would lay in bed in 20 years

12:32

as I watched kind of the culmination of all these things that were already

12:36

moving inside the company, come to fruition.

12:39

And then I would, I would never be able to forgive myself.

12:42

And so the, I think it's, I think they did a really good job of capturing

12:47

kind of that feeling of being torn, right, that I really love social

12:51

software.

12:52

I really wanted Facebook to succeed.

12:53

And knowing that there was like this festering rot happening in the company.

12:58

When you first got to the company, you know, I know you specifically wanted to work

13:04

on, you know, misinformation, potential harms caused by the platforms.

13:08

Like what made you believe that you could help the company fix those problems

13:13

from the inside and when did that belief start to break down?

13:19

Going into Facebook.

13:21

So a detail is different between like what happened to Francis in real life versus

13:25

Francis the character is, you know, I had been in the industry for about,

13:30

I think about 15 years by the time I was at Facebook.

13:33

So I had worked on it at Google on a variety of different search engines.

13:36

I had been the lead product manager on picking out the pins and your home feed on Pinterest.

13:42

I had worked at Yelp.

13:44

Like Facebook was my fourth social network.

13:46

So I worked on Google Plus as well.

13:48

And I knew going in that like even during the 2016 elections,

13:54

like I had been looking at Facebook and just seen the features.

13:59

So I'll give you an example.

14:00

It used to be that when you would like click like on a post,

14:03

a little carousel would pop out underneath that post showing other stories you might want to engage with.

14:10

And it was very, very clear to someone who designs like algorithm products that the way those stories were picked

14:15

was based on like their click through rate, like how likely they were going to get a click.

14:19

Because it was like you would click on some very reasonable normal AP newswire story.

14:25

And you would get like the most fantastical variant of it.

14:28

So you might click something about Catholic church and you get like Pope and Dorses Donald Trump as the first worry.

14:34

Like very clearly this is like for shock value, how things are picked.

14:37

And so like I had this suspicion that if I was on the inside and I was working on algorithms like

14:44

you know, I never expected to be like the person who could solve everything.

14:48

But I thought I could make a positive difference.

14:50

And I viewed it as like I think everyone in tech should do some kind of either civil service or volunteer the nonprofit at some point in their career

14:59

because we're giving so many opportunities.

15:01

I figured this is like an easy way to give back that doesn't require me you know,

15:08

spending time in Washington or something like that.

15:11

And when did it start dawning on you that you know, this is the efforts that you were putting into this.

15:18

We're not going to bear fruit inside the company.

15:22

To give you like a sense of the chaos.

15:24

So you know, imagine you show up.

15:26

You've never really thought about the idea that like software could lead to genocide.

15:30

Yeah, right.

15:31

Like you know, this is kind of huge gap.

15:33

Like I've been helping people people pick out their dinners at Pinterest and like have pretty bedrooms.

15:37

And like now you're like, oh, and by the way, like you can cause ethnic violence with very similar products.

15:43

Imagine you've like been on this crash course where like you're meeting all the time with the researchers who have been going in and out of these countries and are like, you know,

15:52

those PhDs in in in in how societies fall apart.

15:56

Imagine you've just like kind of bootstrapped from from zero to one over like three months.

16:01

And you get called into a room and told you know how your team of like five or six is already a little bit traumatized by like having to be exposed to all this.

16:09

Just ignore it.

16:10

We have a bigger problem.

16:12

We have just found a Russian foreign influence operation that is trying to send misinformation specifically to police officers in the United States.

16:21

You're not going to work on civil strife somewhere in Africa.

16:25

You're going to work on targeted misinformation in the US election.

16:28

Like like think of think of like one, I mean, I understand why that's a huge problem like I live here.

16:34

People with guns.

16:35

Sounds like you shouldn't be targeting them with misinformation.

16:37

Like that sounds like a reasonable problem.

16:39

But but just imagine the level of fluidity where like you literally are forced to make choices of allocating resources at that level.

16:47

Right.

16:48

Like oh, that it doesn't matter what the stakes are on this thing.

16:51

We have so few people to go around that this is what we're doing.

16:54

And it it it.

16:57

I think within six months of being there, I was like the level of chaos here is is very unlikely to be conducive to solving these problems.

17:05

But then COVID hit right.

17:07

So like a detail it's different from the movie versus real life is I joined in 2019.

17:11

I didn't start blowing the whistle until after like until 20 December of 2020.

17:16

And so I I think like a lot of us I kind of I chose to focus on the present and and getting through COVID.

17:27

And it wasn't until our team got dissolved that my mind kind of shifted into gear being like, oh, actually, if we want to solve these problems, we're going to have to go outside the company.

17:36

I think the most striking thing to me about the Facebook files, you know, it wasn't that Facebook didn't know that its product was causing harm.

17:45

It's the company did know.

17:47

And continually, as you said, either made decisions to not try to alleviate those harms or change the algorithm or or do what was necessary or just did not altogether.

18:03

Just ignored the concerns that they knew about that their research was showing them.

18:08

Why wasn't knowing I think a lot of people like outside the company would be like, okay, well, if they had research that showed them this was a problem.

18:16

If they had these studies that showed them this is a problem like why wasn't that enough.

18:20

One of the things that's been really nice about the court cases that have played out over the last few years is that we have been able to get access to like a much broader sample of internal documents than even I brought out.

18:31

So, you know, the documents that I brought out were largely focused around this question of like societal instability, biases and algorithms, pushing people towards either extremist groups or just extremist content.

18:45

And so, you know, I think that's what I think about the content.

18:50

Um, uh, impacts on like fact that content moderation doesn't really work the way described like it struggles to find the bad stuff.

18:58

It takes a lot of good stuff.

19:00

Facebook is very non transparent about what actually worked or didn't work.

19:04

But when it comes to kids, you know, maybe 10% of what I brought out was about kids.

19:09

And one of the things that it's been super interesting about what's been released through the court cases is that we've actually been able to get, you know, the exact documents where they talk about this is what we learned.

19:19

This is what we're going to do. This is why.

19:21

And the thing that you see over and over again is a disconnect between how success was defined in the company and what the actual consequences were externally.

19:32

And I think on a, if I was going to really sum up in like a one sentence or two sentence description of the problem set of Facebook was that Facebook wanted to believe that they could be objective and how they manage the company by picking a few metrics and then just making decisions using those numbers.

19:48

And when we manage with metrics instead of context and intuition and like more of a holistic way of making decisions.

19:57

We end up cutting corners and people have been talking a lot about the paper clip problem with AI, you know, that the AI will go out there and you know, be like make more paper clips and it just happens to be that like your home is competing for resources with like more paper clips.

20:11

Facebook on a much smaller scale like came in there and said the number of minutes is all that matters.

20:19

And so many minutes are kids spending our adults spending on Instagram each month.

20:24

We have very, very clearly written documents that say we ran an experiment where we stopped sending kids notifications during the school day, we stopped sending them late at night, kids have said they're less stressed.

20:34

There's no point in us launching this though because they spend 1% fewer minutes a month and Marcus said that's all he cares about.

20:41

So the focus on metrics at the expense of almost everything else at the expense of, you know, trying to quantify harms that were probably more diffuse, difficult to measure, maybe delayed, right?

21:00

Like they weren't going to have for a while.

21:02

Yeah.

21:03

And that sort of caused a lot of the problems.

21:06

I'm like, very curious what the conversations were like inside the company because clearly when someone raised, you know, we're worried that Instagram is causing body image issues or we're worried that because we don't have content moderation in some of these developing countries with Facebook that things are getting out of control.

21:30

What are those conversations like inside the company when someone pushes back and says, well, yeah, maybe that could be an issue, but, you know, is it, is it as simple as like, no, we need to focus on engagement and growth or is it a little more complicated than that?

21:43

You know, it's one of the things that is going to seem cartoonish. If you watch the movie is there's a scene where one employee is coaching the French is having character that like the whole point of Facebook is to remove friction where everything is optimized for remove friction said company and when you complain, you are friction.

21:59

And you're just going to yourself removed.

22:01

And like that scene feels so reductive.

22:06

But like I remember when I first joined and like, it was just weird the vibe you would get talking to people like it's it's very clear that people assimilate over time to the notion that like you are rewarded for focusing on the positive.

22:21

You are rewarded for having a mindset of like, why does it why don't people acknowledge all the good we do instead of like, you know, can we reduce the amount of bad for the same amount of good.

22:32

And I like one of the posts I brought out it had been actually leached before by other people like it was not news when I brought it out, but it's within the cash of documents that I brought.

22:42

Is a blog post that was posted by the CTO of the company, boss worth maybe maybe 2019 maybe 2018 and in it he's talking about people complaining about a child having committed suicide.

22:57

So this is like a 15 16 year old they've unfortunately harmed themselves.

23:01

And he's talking about how what the work of Facebook is so important that it basically doesn't matter.

23:09

Right like like that like some people are going to die like because of the power that they've unleashed on the world.

23:15

And the reality is that you have to break a few eggs to make an omelette.

23:18

And I think you really have to take a step back and ask like, how is it possible that like a culture like this gets normalized.

23:25

And I think part of it is, you know, they say like the the sign of like an advanced mind is to be able to hold to conflicting ideas in your mind at the same time.

23:35

Right like like a key thing to be a critical thinker is that the two ideas can be true.

23:40

Even if they're in conflict and or intention and you know Facebook does create a huge amount of good in the world right is created magical moments as connected people who were disconnected.

23:51

And so that's the only people like the frances character says you know some people are awkward they have trouble connecting.

23:56

We can bring them together with the internet.

23:59

And and people are also getting hurt.

24:04

And I think if Mark were a more mature leader he would say hey, we have lots of tools that are supposed to reduce that harm.

24:12

So for example, I was a not all kids are at high risk of damage from Instagram.

24:16

That is a controversial statement like some people some psychokillic colleges would disagree with me.

24:21

But imagine you were more actively looking for the 10% or 20% that are at highest risk.

24:27

And you were intervening if you saw that things were getting worse.

24:31

For example, a lot of these kids who do harm themselves by the time they they do something drastic maybe half of their feed is self harm content.

24:39

Why are you not getting someone involved when it's 10% when it's 5% of their feed.

24:44

Right, we have tools that are disposal is just a lack of action is happening.

24:47

More of my conversation with Francis Hogan in just a minute.

24:50

But first do us a favor if you like offline and you want more offline content consider subscribing to our offline YouTube channel.

24:58

It's free. All you have to do is click the subscribe button.

25:01

If you're listening to this we video all of these and we're trying to build our YouTube channel.

25:05

So check it out, hit subscribe and you'll get more offline content.

25:09

Also, CricketCon is less than 30 days away.

25:12

It's a chance for political nerds, pollsters, organizers, journalists, creators and cricket hosts to gather in one place in real life just days after the midterms.

25:21

There's some big questions ahead about what the party looks like and what we want to focus on in 2028.

25:27

There are a whole bunch of different topics we'll be talking about across four different stages.

25:31

Can the Democratic Party brand be saved? What guardrails do we need for AI?

25:36

I'll be hosting a panel on the Democratic Party's brand during the all day cricket con event.

25:40

So you can check out CricketCon.com to get tickets and stay tuned for more exciting names to be added to the lineup soon.

25:54

Offline is brought to you by Sundays.

25:56

When it comes to pet food companies have a lot of cost-cutting measures and filler ingredients at their disposal.

26:01

But Sundays made a deliberate choice. Real human grade meat, no synthetic vitamin pre mixes, nothing you can pronounce.

26:08

Made with 80% plus all natural meat and nutrient rich ingredients like kale, ginger and blueberries.

26:13

Sundays is airdried and contain zero fillers, synthetic additives or chemicals.

26:18

It doesn't look or smell like dog food, it looks like high quality jerky.

26:22

Created by Dr. Tori Waxman to meet her high standards is both a veterinarian and a dog parent.

26:27

And the best part, it's effortless. No fridge, no freezer, no prep, no mess, just scoop and serve.

26:32

You get the quality of a home cooked meal with the ease of kibble.

26:34

My dog loves Sundays for dogs. Leo runs to the bowl every time I pour it in and we love it because it's easy to store.

26:42

It's not white dog food which kind of gets gross, it smells gross.

26:45

And most importantly, Leo loves it.

26:47

Make the switch to Sundays, go right now to Sundays for dogs.com slash offline and get 50% off your first order.

26:54

Or you can use code offline at checkout.

26:57

That's 50% off your first order at Sundays for dogs.com slash offline Sundays for dogs.com slash offline or use code offline at checkout.

27:07

Offline is brought to by Quince busy fall schedules call for effortless style.

27:11

Quince makes everyday dressing easy with high quality versatile essentials built to last.

27:15

The sweater that goes with everything the perfect pair of pants or a no failed t-shirt that stands up to wear after wear.

27:21

Those are the pieces that make getting dressed easy and that's what Quince does best.

27:25

Quince crafts timeless high quality wardrobe essentials like organic cotton, marina wool and 100% Mongolian cashmere sweaters starting at $60.

27:33

Delivering luxury softness and quality without the luxury price tag.

27:37

And when the temperatures start to drop, Quince makes it easy to build on those everyday staples with premium down jackets and classic wool outerwear.

27:43

Versatile layers designed to keep you warm and comfortable all season long.

27:47

Everything at Quince is priced 50 to 80% less than similar brands.

27:50

They work directly with ethical factories and cut out the middlemen so you're paying for high quality not brand markup.

27:56

Got a bunch of Quince stuff at home wearing the Quince sneakers right now that I got this summer and also has some great polos.

28:02

And hopefully it gets cool here in the L.A. someday so I can wear that cashmere sweater that I bought.

28:07

Find your next fall favorites at Quince download the Quince app for app exclusive offers or go to quince.com.

28:13

Get free shipping on your order and 365 day returns now available in Canada and the UK too.

28:19

And when Quince asks where you heard about them, let them know it was offline.

28:23

It's the best way to support the show.

28:29

How much of it is this rationalization that I've heard from all kinds of people at Facebook publicly that you know this is sort of a town square and people who are not interested in the world.

28:42

And people are or even if you go beyond the town square thing, people are going to make their own decisions.

28:47

And we can't police everything.

28:50

We can't force people to make good decisions.

28:53

We have this platform and then people are going to decide what they want to do.

28:58

And so we can't solve every problem or heal every person or make sure that there's no harm if someone's going to choose to stay on the platform to seek out these.

29:11

These, you know, political groups that are extreme if they're going to seek out content and Instagram that makes them feel bad like we just can't do anything about all of that.

29:19

How much do you think people inside the company sort of lean on that justification and rationalization and also maybe truly believe it.

29:28

So I think there is definitely an internal culture that really encourages people to stay in their lane.

29:34

So any given quarter, any given half, you are going to have your specific stated goals.

29:39

And if you achieve those goals, you're going to be rewarded if you choose something else that isn't on that state goals is you you may not be rewarded, especially if you miss the goals that you were assigned.

29:48

I'll give you an example where like there's this question of there are problems that are genuinely hard that I don't think will ever solve.

29:54

And I don't think they should try to solve them.

29:56

For example, there is going to be offensive content on social media.

30:00

You know, we are not like I do not want to live in a world where I never encounter offensive content on social media because it means you have to take down lots and lots of good stuff to make it that clean.

30:09

So example, one of the documents I brought out talked about how terrorism content in Arabic 75% of counter terrorism content.

30:19

Because there are a lot of things that are not going to be done in this case.

30:23

And so there are a lot of things that are not going to be done in this case.

30:26

And so there are a lot of things that are not going to be done in this case.

30:29

And so there are a lot of things that are not going to be done in this case.

30:32

And so there are a lot of things that are not going to be done in this case.

30:34

And so there are a lot of things that are not going to be done in this case.

30:37

And so there are a lot of things that are not going to be done in this case.

30:40

And so there are a lot of things that are not going to be done in this case.

30:42

And so there are a lot of things that are not going to be done in this case.

30:44

And so there are a lot of things that are not going to be done in this case.

30:46

And so there are a lot of things that are not going to be done in this case.

30:49

And so there are a lot of things that are not going to be done in this case.

30:52

And so there are a lot of things that are not going to be done in this case.

30:55

And so there are a lot of things that are not going to be done in this case.

30:58

And so there are a lot of things that are not going to be done in this case.

31:00

And so there are a lot of things that are not going to be done in this case.

31:02

And so there are a lot of things that are not going to be done in this case.

31:04

And so there are a lot of things that are not going to be done in this case.

31:05

And so there are a lot of things that are not going to be done in this case.

31:07

And so there are a lot of things that are not going to be done in this case.

31:09

are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are are

31:39

Carol, we trust you.

31:41

You can say anything you want.

31:43

But if you want to spread Alice's message,

31:45

you have to copy and paste it and put it in the share box.

31:49

You can't just hit reshare.

31:51

We're going to make you have a moment of reflection

31:52

before you spread that information onwards.

31:55

And that small pause ends up having the same impact

31:58

on misinformation that the entire third party

32:00

fact checking program has.

32:02

Right, that's the power of design.

32:05

And when we talk about kids getting hurt,

32:07

one of the things that came out from the court cases

32:09

was Facebook was analyzing who is receiving unwanted sexual

32:13

communications.

32:14

So this is something that's like a nude photo, we might say.

32:17

When they looked at who is receiving them,

32:20

over half the reports came from kids,

32:23

even though half of users were not kids.

32:25

And of those, over half of them were from adults

32:27

the kids didn't know.

32:29

Why was an adult who sent an unwanted sexual

32:33

communication even once allowed to do it a second time?

32:36

Why weren't they at least put in time out for three months

32:38

and said, you can't talk to kids for a couple of months.

32:40

Right?

32:42

Or like, we're going to manually check this

32:43

and see if you have a history of these things.

32:46

A recurrent response.

32:46

And why was that?

32:47

It's like, yeah.

32:48

Like, why do you think that?

32:49

I don't know.

32:50

I, that's the wild thing.

32:52

And that's why they lost their lawsuit.

32:53

Let's be totally honest.

32:54

Right.

32:54

Because like when a jury looked at these things,

32:56

they said, how was this ever considered

32:58

a reasonable decision?

32:59

How much of what went wrong at Facebook?

33:02

Do you blame on Mark Zuckerberg personally?

33:05

And how much was baked into the structure

33:08

and incentives of the company?

33:10

Ooh.

33:11

And how much are those two intertwined?

33:13

Right.

33:14

Right.

33:14

Yeah.

33:15

Yeah.

33:16

So one of the reasons why I'm very happy

33:19

with how the movie turned out is the movie, yes.

33:21

Part of it is inspired by what I went through.

33:23

And like, that's definitely an exciting,

33:25

like, heist, like, kind of part of the movie.

33:27

But there's like a parallel part of the movie,

33:29

which is a kind of a scene of life of what

33:31

is it like to be Mark?

33:32

Right?

33:33

Because Mark is a very unique human

33:35

in that there's very, very few people in the world

33:37

who has to have as much power as him

33:40

and so little accountability.

33:42

Right.

33:42

Because he has more than half the votes

33:44

that control Facebook.

33:46

All the people around him are only

33:47

have their jobs because they make him happy.

33:50

So they have to constantly be kind of

33:51

weighing like, how much do I push you?

33:53

Right.

33:53

Like, how uncomfortable.

33:54

How much can I make you grow?

33:55

Right.

33:56

And I think part of why there is this culture

34:03

that tries to abstract things to like,

34:05

did the metric go up?

34:07

I think that partially is because it allows them

34:09

to have a more, you know, it's more frictionless.

34:13

Right.

34:13

Like, once you agree on like, what the goalposts are,

34:15

you say, you know, we're going to let people run free.

34:17

Like, we believe in empowering people

34:19

to make whatever decisions they think are best

34:21

to accomplish that shared goal.

34:24

It just happens to me now you don't

34:26

have to have a conversation about side effects.

34:28

Because you're not going to move those goalposts very often.

34:30

They keep the same metrics over multiple years often,

34:34

even when new information comes through.

34:37

I think the last thing is the people who were looking

34:40

into those kinds of complaints, the reality is receiving

34:45

an unwanted sexual message is a less common problem

34:48

than someone getting locked out of Facebook

34:51

or someone trying to spam Facebook.

34:53

At Facebook, resources are allocated not

34:56

necessarily based on severity of the problem,

34:57

but on prevalence, drawing more attention to a problem

35:01

or the danger of false positives.

35:04

You know, there's a throwaway line in the movie

35:05

about Facebook carrying more about the blowback

35:08

of a false positive and carrying about the impact

35:11

of actually taking something down.

35:13

And I think that is a real intense fear of the company.

35:15

If Zuckerberg had resigned in 2021,

35:18

you think the company would have behaved much differently?

35:21

I do.

35:22

I do think it would have.

35:23

Like, one of the things that's kind of, I think, sad for me

35:26

because I love social software.

35:27

Is let's imagine it's not he had resigned in 2021,

35:30

he had resigned in 2017.

35:33

Right?

35:34

Like, think of how many more people used Facebook

35:36

on a regular basis in 2017 than use it today,

35:39

at least in the States.

35:40

Right?

35:41

We'd see probably more content from our friends.

35:42

We'd have different kinds of experiences there.

35:45

When you went to Jeff Horowitz at the Wall Street Journal,

35:49

you copied the documents, you gave them to him.

35:52

When you made them public, what did you hope would happen?

35:54

What was your, as he was about to hit publish on those stories,

36:00

what did you think the outcome would be?

36:02

What did you hope the outcome would be?

36:03

Yeah.

36:05

So I was a realist in 2021.

36:09

I'm a student of history.

36:12

I really like, I was a Cold War studies minor.

36:15

I like American history.

36:18

This is not a false of the political parties

36:20

that in power right now.

36:21

Every Congress for the last 25 years,

36:24

each progressive Congress has passed fewer bills.

36:27

We have certain kinds of structural challenges

36:29

that come from our Constitution and just the nature of how

36:34

our society is set up.

36:35

They make it very hard for us to do new things these days.

36:39

And so I assumed there would be a lawsuit,

36:42

because we'd seen it with opiates, we'd seen it with tobacco.

36:44

This is like a common consumer protection pattern.

36:47

I thought the level of evidence made it fairly likely

36:50

that would take place.

36:52

And then I assumed Europe would take action.

36:54

And I would say I spent much, much more time

36:56

working on legislation in Europe over the first two years

36:59

after I came forward than I did in the United States.

37:01

And the thing that is nice is that they did

37:04

pass the Digital Services Act, which is the first law

37:07

anywhere in the world that says that the public has a right

37:09

to know things like, if your content is taken down,

37:12

like that should be publicly reported.

37:14

We should be able to understand if there's biases

37:17

in what they let us see or not see.

37:19

They have that right.

37:19

We don't have that right.

37:21

Your story feels newly relevant today

37:25

because of what's happening in the AI industry.

37:28

You mentioned this earlier.

37:30

I just read New York Magazine just interviewed

37:32

a bunch of former employees at OpenAI and Foropic,

37:35

Google DeepMind, who are wrestling with almost exactly

37:38

the same question you faced, which is,

37:40

am I more useful staying inside and trying

37:43

to change the company or leaving and sounding the alarm?

37:47

What would you tell someone at an AI company

37:50

by having that debate right now?

37:52

How do you know whether internal dissent

37:55

is actually working in the best choice

37:58

and how do you know when it's time to leave?

38:01

I think it's going to be very different for each person

38:03

in their circumstances because part of this

38:05

is a question of skills, especially a question of credibility

38:08

and it's a question of how new is the information.

38:11

So I do strongly encourage people who find themselves

38:15

in circumstances where it is causing them

38:17

a lot of emotional toil to continue working.

38:21

You have no obligation to sacrifice yourself

38:24

for a community to work on these problems.

38:27

You should take care of yourself first.

38:29

But I do think there is one thing I wish we were seeing more

38:34

from the current kind of crop of AI whistleblowers

38:36

is we get a lot of accounts.

38:40

We are not getting a lot of what I would call data

38:42

or like evidence.

38:44

So there's a scene very early in the movie

38:46

where the Jeff's character tells the Francis character.

38:51

All you've given me is a story, right?

38:53

Like you haven't given me, like I don't have proof.

38:57

And one of the things that is hard right now,

39:00

this is like part of why we need to be passing laws

39:02

to give the public the right to ask questions

39:04

and get information from these companies

39:07

is we are dealing with a really big information asymmetry.

39:11

So just like you currently cannot take

39:14

even an undergraduate level class

39:17

on how to manage a social network,

39:18

basically anywhere in the world, you can't take

39:22

an undergraduate class on managing a frontier AI model, right?

39:26

Like we are the only place where you can really study these things

39:29

where the conversations are fully happening

39:31

is behind those closed doors.

39:34

And so I think there is a question of if you are going to leave,

39:39

like we need your help trying to bootstrap

39:42

more of that public understanding.

39:45

And you know, academia and I hope more journalists help try

39:48

to scaffold how we can get more of that shared understanding.

39:52

But we also need documentation.

39:54

Like how are these things being done internally

39:57

so that we, it makes the conversation much more concrete.

40:01

One of the former open AI employees described colleagues

40:06

saving their chips, which is holding on to influence

40:09

because they imagine there will be some decisive future moment

40:14

when they'll finally use it.

40:17

Did you see any version of that at Facebook

40:19

or did you feel like,

40:21

I got to, maybe I should hold on a little bit more

40:24

because I might be able, if I stay here long enough,

40:27

I may be able to either fix the problem

40:29

or influence them or change something internally.

40:30

Like how do you think about that tension?

40:33

What an interesting concept.

40:36

I guess part of why that makes sense

40:39

from like a game theory perspective is like,

40:42

things are accelerating so fast when it comes to these AI models.

40:46

I think for me inside the company,

40:49

I would say it had been at a steady boil point

40:52

for a couple of years.

40:54

Right, so like, you know, Myanmar happened in 2018, 2017.

41:00

We had not yet seen Ethiopia until after

41:02

I'd started accumulating documents.

41:04

So I was on a task force that was working on,

41:07

like we could see that Ethiopia was about to boil over

41:10

for context, there was a civil war there

41:12

that was largely a fan by social media

41:13

and about half a million people, but, you know,

41:15

we were seeing kind of the wave was coming,

41:18

but it hadn't really crested yet.

41:19

And January 6th then happened yet.

41:22

And so I don't think I encountered anyone who like had

41:26

that kind of like, oh, I can see the things are getting

41:28

so much worse than like waiting six months

41:31

or waiting a year actually would make a material difference.

41:34

I think the larger issue was we had four years of track record

41:38

already of watching people try to get the system to move.

41:44

So there's a scene in the movie where they bring to Mark Zuckerberg

41:51

this plan for the 2020 election.

41:54

It's a result of a task force.

41:55

I was on that task force.

41:56

I was never in the room.

41:57

They show me in the room in the movie.

41:59

I was never there.

42:02

But I did contribute to it

42:04

where they're saying, hey, what's imagine interventions

42:07

beyond just taking down content?

42:10

Like what are all the other kind of dials that we could tweak

42:13

that would make things less bad?

42:15

What are those soft actions?

42:16

Not just hard actions.

42:17

And those kinds of moments like that,

42:20

they've been trying lots of that systematically for four years.

42:24

And there was kind of a feeling that occasionally

42:27

you'd be able to push something through,

42:28

like maybe the vibes would just like just right that day

42:30

and you could get like a little bit more,

42:32

but it was never anyone who felt like they were going to have

42:35

a unique moment where that was going to be possible in the future.

42:37

Yeah, I think about this a lot because,

42:40

you know, you hear this with a lot of these,

42:43

the reaction to sort of the warnings

42:46

from these AI employees.

42:48

And you know, understandably,

42:50

some of the reaction is like, well, then just quit the,

42:52

why aren't they all quitting?

42:53

You know, or like why aren't you,

42:55

just stop building it.

42:56

And you know, then you hear, well,

42:58

they think that they can have a bigger influence

43:02

inside the company and then people will, you know,

43:04

laugh and be like, well, that's crazy

43:07

and they're just doing it to make money or this or that

43:09

or because they're scared.

43:10

And you know, I will say that just it's slightly different,

43:14

but there's a parallel like the difference

43:16

between the first Trump term and the second Trump term.

43:18

I remember thinking in the first Trump term,

43:20

like why are these people there?

43:22

They should quit and they should speak out.

43:24

And then in the second Trump term, I'm like, you know,

43:26

I understand why I understand why a lot of those people,

43:29

they were there.

43:30

Were there.

43:31

Like it was, it's not great that they made that choice,

43:33

but it was, you know, probably good for the country.

43:35

They were there and it's much worse now.

43:38

To be super honest, like I think sometimes about

43:40

whether or not I should go work at Anthropic, right?

43:43

Like I have such a specialized skill set.

43:45

Rather, there's not a ton of people

43:46

who work in the space that I work in.

43:49

And like the realities, like these systems

43:51

are being built today.

43:52

Like it's not like they're not trying.

43:54

The question is, is there enough

43:56

and when red flags appear, are they listened to?

43:59

And I think we've seen a couple rounds of these stories

44:02

where safety employees have said,

44:03

no, no, we detected XYZ and we still launch the model, right?

44:08

One of the key things is like,

44:10

there's a bunch of tech that is being built right now

44:13

where I don't think we have enough people

44:15

in the world working on it.

44:16

Right?

44:17

Like these are hard problems.

44:18

They're not obvious.

44:20

And, you know, I can totally imagine someone being

44:24

in a really conflicted place,

44:25

where depending on what your role was within that company

44:28

and which company,

44:29

because I think each of the frontier labs

44:31

have behaved in different ways.

44:32

It is really complicated trying to say,

44:34

what is your appropriate role?

44:36

But I want to clarify, there's also jobs

44:38

like working on ads at Facebook.

44:40

Like it's really hard to tell me how you are

44:43

like making the world a better place working on ads

44:45

at Facebook.

44:47

I'm sure there's some equivalent thing at Anthropic

44:49

where it's like, you are definitely accelerating

44:52

in the speed of which the model goes.

44:53

You're not putting the brakes on.

44:56

!

44:57

Offline is brought to you by Thrive Market.

45:04

Spooky season is here, but Thrive Market is here

45:06

to keep those scary artificial ingredients

45:08

out of your kitchen.

45:09

Stock up on healthier Halloween candy options

45:11

and fall pantry staples, all delivered straight to your door

45:14

with no store runs and no retail markups.

45:17

For just $5 a month,

45:18

you'll get access to a curated selection of organic

45:21

and non-GMO brands, 90 plus dietary fillers,

45:24

weekly sales, free gifts, and piece of mind

45:26

knowing over 1,000 ingredients are restricted.

45:29

One annual fee, priceless piece of mind.

45:31

Thrive Market has really great candy options right now

45:34

that trick-or-treaters will love.

45:35

Unreal brands, Halloween chocolate, variety packs,

45:37

yum earth, Halloween organic lollipops,

45:40

lesser evil spooky space ball snack packs.

45:43

All sound pretty good.

45:44

Thrive Market is the first online only grocer

45:46

to accept Snap EBT.

45:48

Every paid membership sponsor is a free membership

45:50

for a family in need.

45:52

Plus, your purchases this month support the Thrive Market,

45:55

save the children partnership,

45:56

funding the Learn Without Limits initiative

45:58

for kids in high-need rural communities.

46:01

Get $30 off your first two orders with my link,

46:04

thrivemarket.com slash offline,

46:06

get stocks before Halloween and save $30 off your first two orders

46:10

that offsets the cost of an annual membership.

46:12

Sign up now at thrivemarket.com slash offline.

46:17

Boo!

46:17

Spooky season has officially entered the group chat

46:20

and that means one thing.

46:21

It's time to stock the fridge and summon your squad

46:24

with Smirnoff Ice.

46:25

Whether you're headed to a costume party,

46:27

hosting a scary movie marathon,

46:28

or laying low with a backyard bonfire,

46:31

smist me, always delivers.

46:33

And honestly, being the friend who remember

46:35

to bring the drinks is elite behavior.

46:37

So skip the tricks and get the party started

46:40

with a treat that's cold, crisp, and perfectly mixed.

46:43

And hey, if you're looking to switch things up,

46:44

check out Smirnoff Ice Zero Sugar.

46:47

Same flavors you love with Zero Sugar and 100 calories.

46:50

Game changer.

46:51

Smirnoff Ice, two crisp, two resist.

46:54

Please enjoy responsibly.

46:56

Must be 21 plus.

46:58

Your time is valuable.

46:59

Why spend hours waiting at the ER?

47:02

Solace Health is the only concierge immediate care membership

47:05

with exceptional urgent and emergency care on your schedule.

47:09

No crowded waiting rooms or restrictive scheduling.

47:11

Just top ER doctors, advanced imaging,

47:14

and specialist referrals, all available 24-7.

47:18

Find a Solace Health Center near you

47:20

and sign up at solacehealth.com.

47:23

That's S-O-L-L-I-S health.com.

47:31

Isn't the bigger problem relying on individual

47:37

or even corporate responsibility that's voluntary here?

47:41

Because at Facebook, you and other employees

47:45

struggle to get leadership to do the right thing

47:48

or to want to do the right thing.

47:50

It feels like, at least with Anthropic,

47:53

you've got the leadership being like,

47:55

yeah, I want to slow down, regulate us,

47:58

and then the response is, well, then just do it.

48:00

You're doing it yourself.

48:02

But it's like, what happens when slowing down

48:05

means a competitor gets ahead,

48:07

what happens when it means if all the US company

48:10

slow down and China gets ahead,

48:12

isn't the larger issue that you need rules and agreements

48:18

that everyone follows, which is,

48:20

I thought what governments are for?

48:22

Yeah, the movie is partially inspired or based on,

48:26

or in terms of source material,

48:28

how I contributed the most to the movie was I wrote

48:30

a memoir called The Power of One,

48:31

which came out a couple years ago.

48:33

And when I wrote that, the thing I really, really focused on

48:37

was trying to understand, why is it known

48:40

as like Apple is ruining the world?

48:42

Or like, why are there no Apple whistleblowers?

48:44

Like I wanted to look back at like,

48:46

like so for Facebook, there's constantly whistleblowers.

48:48

Like people call me the Facebook whistleblower.

48:51

There are far too many whistleblowers in Facebook

48:52

for me to be the Facebook whistleblower.

48:56

But you don't see that from Apple.

48:57

And even from Google, until they started doing more in AI,

48:59

you very rarely saw Google whistleblowers.

49:02

So like, why is it so different?

49:05

I don't think it's as simple as like Facebook is evil,

49:08

or like Mark is evil.

49:09

I think the key difference is Facebook

49:11

is just the first kind of hint of this giant change

49:16

in our economy.

49:17

So our economy and the rituals of safety and oversight

49:21

that we built up over like three or 400 years, right?

49:24

Like we've been making safe and safe corporations

49:26

since like the Dutch were like making corporations,

49:28

like build dikes and the Netherlands and reclaim the sea,

49:31

right?

49:32

This is like a long term processing.

49:35

When you make a bunch of widgets, be it a car,

49:38

be it your coffee mug,

49:40

my coffee mug, your coffee mug, they're from the same line,

49:43

I can test the paint on my coffee mug and say,

49:46

like, hey, we have a problem, like these coffee mugs are rad.

49:48

Like what the coffee mug is is not really in conversation.

49:53

Even when it comes to Google, because Google is a product

49:55

that is basically the same for you and me,

49:58

like for most searches, you get the basically the same results.

50:01

There's little bits of personalization for things

50:03

like I always pick the same time zone converter,

50:07

because I don't like the one Google recommends.

50:09

They will bump that up a little bit

50:10

if you click on it enough times, right?

50:12

But because it is basically the same for most people,

50:17

an academic can go and run 10,000 searches against Google

50:20

and come back and say there is this systemic bias in Google.

50:23

There is a Google, right?

50:25

But when it comes to Facebook,

50:27

because everyone's experience on Facebook is different

50:30

or on Instagram, everyone's experience is different.

50:32

People would come to Meta and say,

50:34

hey, you have this problem recommending

50:36

just order content to kids.

50:38

And they would say that's so sad, I'm so sorry,

50:41

but that's not a representative experience on our platform.

50:45

And people couldn't argue back,

50:46

because what it is is really hard to establish

50:50

if you can't see behind the curtain.

50:52

I think one of the best, best signs we are seeing

50:55

is five years ago, when I was before the Senate,

50:59

I said, you need to have embedded observers

51:02

in these companies that have full access to data like employees.

51:06

And the thing that people like Anthropic

51:08

have been asking for is,

51:10

in just the last few weeks is you need to mandate

51:13

that there are auditors and society's companies

51:15

with full access to data that can confirm

51:18

that what we're saying is true.

51:20

And the reason for that is when you allow people

51:23

to space to cut corners and you put them in such a high pressure,

51:27

high stakes environment, corners get cut.

51:31

And you could be a good person under a lot of stress

51:33

and you have to make your numbers at the end of the month.

51:36

And I think the fact that the CEOs are having these conversations,

51:41

we're gonna look back on it into years and say,

51:43

why did we not pass laws that mandated at least that as the floor?

51:47

Like we shouldn't stop the conversation there.

51:49

We should be having conversations about redistribution

51:52

and who gets to decide certain kinds of safety trade offs

51:55

and various things.

51:56

But at a minimum, they wanted observers inside all these companies.

52:00

And part of that I think is,

52:01

if there were observers inside all the companies,

52:03

they would say there's meaningful differences

52:05

between what Facebook is doing.

52:07

Literally, Mark has been saying things like,

52:08

if you think your model's not safe, just don't watch it.

52:11

I know.

52:12

It's like, I heard it.

52:15

It's not simple.

52:16

Yeah.

52:17

It's like, okay, that's not how it is just this like,

52:22

this tendency to dismiss like a hundred years,

52:26

200 years of like figuring out that the reason we have regulation

52:32

of private companies is not to like,

52:34

it's not because we believe that like,

52:36

people who work in government or more virtuous

52:38

or better or smarter,

52:39

but because you just need rules that everyone can follow

52:42

in a society and that treat everyone

52:45

that every different company equally.

52:47

Because otherwise, you have competitive pressures

52:50

that lead even people with good intentions to make bad decisions.

52:54

And we're in a very similar situation to like,

52:56

what is happening between the social media companies right now,

52:59

which is, you know, Facebook has really enjoyed

53:01

over the years being like, look at all the safety features

53:03

we launched for kids.

53:05

And when academics went through and started really systematically

53:08

in the last, you know, 12 to 18 months,

53:10

going through and trying to find those features

53:12

or like trigger them,

53:13

they found that a lot of them either were just missing

53:15

or like didn't work as intended.

53:17

Right now, the AI companies are trying to say,

53:19

we are being responsible like, look at what we do.

53:22

We don't actually know, right?

53:23

Like it's the same thing.

53:24

We're hearing marketing messages

53:27

and we have nothing to confirm them.

53:29

And I'm always trying to remind people like,

53:31

for most industries,

53:32

we're not kept safe by the government.

53:34

We're kept safe by competition and innovation, right?

53:38

The thing that the government provides

53:40

is kind of like the ref who says like, yeah,

53:43

like that car actually has fewer fatalities

53:45

or like that car has better fuel economy

53:48

or when we did crash tests,

53:50

the dummy's got less damage.

53:51

Like we should be asking what is the crash test dummy of AI, right?

53:57

What can the government come in to give kind of like

53:59

a common level?

54:01

You mentioned sort of independent observers.

54:04

Like what else would you need to see

54:07

that would give the you confidence

54:10

that AI companies were being regulated

54:14

or sort of there was sufficient oversight

54:18

that wasn't just kind of voluntary agreements

54:20

where you have to take their word?

54:21

So I think one of the things that is really interesting

54:25

watching the behavior of the AI companies

54:28

compared to what happened on social media

54:30

is we do get substantially more information out

54:33

of most of the frontier companies on a regular basis

54:36

than we have ever gone out of meta-regarding

54:38

meta-zalgarisms, right?

54:40

That because there is this larger conversation and concern

54:45

and probably the fact there's a lack of immunity,

54:47

like I'm guessing part of why they have engaged more

54:49

with the public is because they have not gone in section 230, right?

54:53

And we have gone substantially more information.

54:56

The question is, is that information true?

54:59

And it sounds kind of like a half answer

55:02

or like kind of a weak answer to say,

55:04

like let's just start with observers and full access to data.

55:08

But the reality is like I am very, very hesitant

55:12

to come in and say like this is what the rules of the road

55:14

should be when we don't even really have a good portrait

55:16

of what's going on.

55:18

Because it is one of these things

55:19

where the unintended consequences can be very large.

55:23

And I don't want to have a false sense of confidence, right?

55:26

Like when you think you're safe

55:28

and you're not actually safe,

55:29

I was actually like in some ways the worst possible situation.

55:32

And so if we could get to a point where we felt confident

55:35

that at least the flows of information we are seeing right now

55:37

and remember that it's substantially more

55:39

than we saw with social media,

55:41

if we could just go from being completely distrustable

55:45

to being like actually know this has been 85% accurate,

55:49

that would at least let us then have materially

55:52

different conversations.

55:53

Because I think right now people are hesitant to push for more

55:57

because we don't actually know what we're even asking for.

55:59

You mentioned that your memoir is called The Power of One.

56:02

Five years later,

56:04

what do you think the power of one person actually is?

56:06

I have to say like the thing that I find like most rewarding

56:08

or like the thing that I didn't expect,

56:10

like when I came forward, I view it as like

56:13

it was a selfish action.

56:14

Like I felt like my life was over

56:16

because I was like in this pit of despair.

56:21

I mean like I cannot escape the circumstances that I am in.

56:25

Right?

56:25

The thing that I would say has been like

56:27

the most unexpected reward for it is

56:30

I've had so many people come up to me and say like

56:33

I am making different choices in my life today.

56:35

Like I might have pursued a different career.

56:37

I might have quit a job.

56:39

I might have done,

56:40

I might have gone way more involved in my kids life.

56:43

They're school.

56:44

The huge spectrum of things

56:47

because I saw what you did

56:49

and like the information that you brought out.

56:50

And I never ever thought that I would touch.

56:53

Like I said, we decided to have maybe like a public whistleblower,

56:56

like maybe five weeks before the first

57:00

Wester General Story came out.

57:01

Like I got media trained like three days before I filmed 60 minutes

57:05

and 60 minutes got filmed the first week,

57:07

the first Wester General Story came out.

57:09

Like it was late, late in the game.

57:12

I never ever thought in my wildest dreams

57:15

that like my story might inspire an AI whistleblower one day.

57:20

But like that is part of what the power of one is

57:22

that when even one person chooses to live

57:25

like a full and authentic life,

57:27

it gives other people permission to also go

57:30

and live full and authentic lives.

57:32

It's so interesting because it does feel like

57:34

from your story and the story of other people

57:38

inside these companies that it is too much to ask

57:42

sort of one person to fix these problems,

57:45

to change these problems because there are structural

57:50

institutional incentives that need to change

57:52

with laws and policies, et cetera.

57:56

It seems like maybe the real power that one person has,

58:01

as you just mentioned, is like the ability

58:03

to get other people to act too.

58:06

And that like what we're really looking for here

58:08

is collective action.

58:10

And we can't just be reliant on the next whistleblower

58:15

to save us.

58:16

So roll back in time with me to like the 1980s.

58:19

So like imagine you're in the Czech Republic,

58:20

Soviet Union is like super oppressive.

58:23

You are a playwright.

58:25

You've been writing plays and you've gone

58:26

in trouble because you're a little too snarky.

58:29

People have realized these plays about dinner parties

58:31

and things like that are actually about communism

58:33

and about the Soviet party.

58:34

And they're like, you know what?

58:35

You don't get to write plays anymore.

58:36

You thought you'd kind of dodge the bullet

58:38

because you were a mildly aristocratic family

58:42

and people are like, oh, he's actually had

58:43

like a reasonably high status shop.

58:45

You're gonna go work in a brewery for some amount of time.

58:48

Like we'll let you out when we're happy with you again.

58:51

So Vada Slavhovovl, who later became like the leader

58:55

of the free Czech movement.

58:57

And was like a big force in toppling the Soviet Union.

59:00

He wrote this pamphlet called the power of the powerless.

59:03

And he talks about the idea of like when you were living

59:06

in a system that truly dehumanizes you,

59:08

that the difference between say, you know,

59:12

Hitler's Germany and the Soviet Union

59:14

was the Soviet Union was a system

59:16

where if individuals tried to cross the party line,

59:19

the party just healed around them.

59:21

Right, so you could go and resist,

59:24

but like you would just disappear from history.

59:26

So like in a system like that,

59:28

what remains of like what is the power of the powerless?

59:32

And he talks about this idea of like you still have choices

59:36

even in systems where you are like very marginalized, right?

59:40

And choosing to not harm other people,

59:43

choosing to like live fully, you know,

59:48

he talks about this idea that people start to notice

59:51

that you've like reclaimed a little bit of your own life

59:53

and it actually changes how they live.

59:55

Yeah.

59:56

And so I think there is a real thing

59:58

where there are a lot of people in tech right now

1:00:00

that feel powerless.

1:00:01

A lot of people outside tech that feel powerless.

1:00:03

But one of the things I remind people of is

1:00:06

we use a lot of nuclear metaphors

1:00:07

when we talk about the danger of AI.

1:00:09

You know, we're like, we should have a pause.

1:00:10

Cause like back when we were like,

1:00:12

about to blow up the world,

1:00:13

we were like, we should have a test band prize.

1:00:15

You know, if we were gonna go right back

1:00:18

to before we did the test band treaty,

1:00:19

so I think like 1960,

1:00:22

we had so little culture of dissent

1:00:25

that people were beating old women

1:00:28

on the stairs of City Hall in New York

1:00:31

for protesting against civil defense.

1:00:33

Like basically they were like, we should not

1:00:35

large nuclear war.

1:00:36

Like we should not role play nuclear war.

1:00:37

This is a bad idea.

1:00:38

And they literally beat these protesters

1:00:40

until they had broken bones.

1:00:41

Like that's how little culture of dissent we had.

1:00:45

We are so much further along

1:00:47

in terms of being able to realize

1:00:49

that we each have to have a voice

1:00:51

and that we have to stand up

1:00:52

if we see things that are wrong.

1:00:53

And so I'm very hopeful that there is a path forward.

1:00:56

And I hope that someone sees this movie

1:00:58

and it lights up a spark in them

1:00:59

that maybe they can do something too.

1:01:01

There's an irony here.

1:01:02

I've been thinking about, which is like,

1:01:04

you know, your story began with

1:01:06

what social media was doing to society.

1:01:08

One of social media's less obvious effects.

1:01:12

I think is how it's changed our relationship

1:01:14

and our understanding of how,

1:01:17

how political action actually works and happens.

1:01:20

And you know, we increasingly experience politics

1:01:24

because of social media

1:01:26

as an argument about who's right.

1:01:28

And it seems like we've started confusing

1:01:32

sort of winning an argument with changing an outcome.

1:01:35

And you know, you talk about everyone getting a voice.

1:01:37

Like I think social media is incredibly effective

1:01:39

at giving people a voice.

1:01:41

But the question now is like,

1:01:42

what turns a collection of voices into actual power

1:01:46

as opposed to just yelling at each other

1:01:49

and trying to figure out who's right?

1:01:51

I think one of the things that we've come to appreciate

1:01:53

like a lot more, maybe like the last five years

1:01:55

is the value of being in the same places together physically.

1:01:59

Right? So I don't know,

1:02:01

roll back in time to like 2015,

1:02:03

like click, click to vism or like clicking activism,

1:02:06

like, oh, sign this petition, change the world.

1:02:09

Like that, I feel like it was a lot larger part of this

1:02:12

like, guys, in terms of like how people thought

1:02:14

about resistance and people now talk a lot more about

1:02:17

like, what are the things that you can do

1:02:18

to actually advance a problem?

1:02:20

So maybe that means if you have people striking

1:02:23

against automation or being replaced by AI,

1:02:26

like how can you materially help those people who are striking?

1:02:29

Or can you how can you join them in solidarity?

1:02:31

Or maybe it's just like, can you march in a protest?

1:02:35

Right? Like if you don't actually have skin in the game,

1:02:37

it's very hard to actually move the ball down the field.

1:02:40

And I think a secondary thing is just connection, right?

1:02:44

Like part of how we actually harness power

1:02:47

is we help other people to fill less alone

1:02:49

and less powerless.

1:02:50

And I think that's another thing that people have been

1:02:52

waking up to in recent years.

1:02:54

And that's the thing that is different.

1:02:56

Yeah.

1:02:57

Frances Hogan, thank you so much for joining offline.

1:03:00

It was great, great talking to you.

1:03:01

And can't wait to see that movie.

1:03:03

My pleasure.

1:03:04

How good do you? Take care.

1:03:05

You too.

1:03:06

Offline with John Favreau is a crooked media production.

1:03:08

Our show is produced by Austin Fisher, Emma Elyk Frank,

1:03:10

and Anisha Banerjee.

1:03:11

Our team includes DeLonville and Wavva, Mia Kelman,

1:03:13

Charlotte Landis, Eric Shoot, Rachel Gaiski,

1:03:16

and Will Jones with support from Adrian Hill and Matt DeGrope.

1:03:18

Our staff is proudly unionized

1:03:20

with the writer's Guild of America East.

1:03:21

What's up?

1:03:27

Right now, the midterms are the biggest story

1:03:29

in American politics.

1:03:30

But however they go, the Democratic Party

1:03:33

is gonna have to do some serious soul searching.

1:03:35

Join us, Washington, DC, November 5th through 7th

1:03:38

at the second annual Crooked Con.

1:03:40

It's gonna be the positive America hosts

1:03:41

and some of the smartest people in politics.

1:03:43

We're gonna try to answer some big questions.

1:03:46

Stuff like, if we won, how did we win?

1:03:48

If we lost, how could we possibly have lost?

1:03:50

And with 2028 around the corner, where do we go from here?

1:03:53

If you believe in democracy, community,

1:03:55

and fighting for the future, now's the time

1:03:56

to grab your tickets to CrookedCon in 2026.

1:04:00

Head to CrookedCon.com to get your tickets now.

1:04:10

That's the sound of a baby being born at St. John's.

1:04:15

That's the sound of your celebratory first meal

1:04:18

being served.

1:04:20

That's the sound of sunshine pouring into your spacious room.

1:04:25

And that's the sound of a happy baby

1:04:27

taking in its first view.

1:04:30

Because when it comes to your birthing experience,

1:04:32

we've thought of everything.

1:04:34

St. John's, everything for the better.

1:04:39

I won a vacation with rides, a waterpark, and in Aquarium,

1:04:43

a deep sea adventure, and a real submarine.

1:04:46

Then I want to build and find my own spaceship

1:04:50

through a whole Lego galaxy.

1:04:52

A grown-up might call that unrealistic.

1:04:54

We call it Kids Free San Diego, where children under 12

1:04:57

play for free at places like Lego Land all October.

1:05:00

Discover deals and discounts at Legoland.com slash October.

1:05:03

Restrictions supply offers me very see partner for details,

1:05:05

funded in part with the city of San Diego tours

1:05:06

and marketing district assessment funds.