Twitter risks fraying as engineers exit over Musk upheaval

Advertisement

Advertise with us

Elon Musk’s managerial bomb-throwing at Twitter has so thinned the ranks of software engineers who keep the world’s de-facto public square up and running that industry insiders and programmers who were fired or resigned this week agree: Twitter may soon fray so badly it could actually crash.

Read this article for free:


By clicking the button above, an account will be created and you will begin to receive some of our recommended newsletters. You may opt out of any newsletter by visiting your Email and Communication Preferences page or by clicking "unsubscribe" at the bottom of any email.

or

Already have an account? Log in here »

To continue reading, please subscribe:

Digital Subscription

One year of digital access for only $1.44 a week*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*Billed as $5.77 plus GST every four weeks. After 52 weeks, price increases to the regular rate of $19.95 plus GST every four weeks. Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 17/11/2022 (1449 days ago), so information in it may no longer be current.

Elon Musk’s managerial bomb-throwing at Twitter has so thinned the ranks of software engineers who keep the world’s de-facto public square up and running that industry insiders and programmers who were fired or resigned this week agree: Twitter may soon fray so badly it could actually crash.

Musk ended a very public argument with nearly two dozen coders over his retooling of the microblogging platform earlier this week by ordering them fired. Hundreds of engineers and other workers then quit after he demanded they pledge to “extremely hardcore” work by Thursday evening or resign with severance pay.

The newest departures mean the platform is losing workers just at it gears up for the 2022 FIFA World Cup, which opens Sunday. It’s one of Twitter’s busiest events, when tweet surges heavily stress its systems.

FILE - A receptionist works in the lobby of the building that houses the Twitter office in New York, Wednesday, Oct. 26, 2022. On Thursday, Nov. 17, 2022, Twitter continued to bleed engineers and other workers after new owner Elon Musk gave them a choice to pledge to “hardcore” work or resign with severance pay. (AP Photo/Mary Altaffer, File)
FILE - A receptionist works in the lobby of the building that houses the Twitter office in New York, Wednesday, Oct. 26, 2022. On Thursday, Nov. 17, 2022, Twitter continued to bleed engineers and other workers after new owner Elon Musk gave them a choice to pledge to “hardcore” work or resign with severance pay. (AP Photo/Mary Altaffer, File)

“It does look like he’s going to blow up Twitter,” said Robert Graham, a veteran cybersecurity entrepreneur. “I can’t see how the lights won’t go out at any moment” — although many recently departed Twitter employees predicted a more gradual demise.

Hundreds of employees signaled they were leaving ahead of Thursday’s deadline, posting farewell messages, a salute emoji or other familiar symbols on the company’s internal Slack messaging board, according to employees who still have access. Dozens also took publicly to Twitter to announce their departure.

Earlier in the week, some got so angry at Musk’s perceived recklessness that they took to Twitter to insult the Tesla and Space X CEO. “Kiss my ass, Elon,” one engineer said, adding lipstick marks. She had been fired.

Twitter leadership sent an unsigned email after Thursday’s deadline saying its offices would be closed and employee badge access disabled until Monday. No reason was given, according to two employees who got the email— one who took the severance, one still on payroll. They spoke on condition of anonymity, fearing retribution.

A trusted phalanx of Tesla coders at his side as he ransacked a formerly convivial workspace, Musk didn’t appear bothered.

“The best people are staying, so I’m not super worried,” he tweeted Thursday night. But it soon became clear some crucial programming teams had been thoroughly gutted.

Indicating how strapped he is for programmers, Musk sent all-hands emails Friday summoning “anyone who actually writes software” to his command perch on Twitter’s 10th floor at 2 p.m. — asking that they fly into San Francisco if not local, said the employee who quit Thursday but was still receiving company emails.

After taking over Twitter less than three weeks ago, Musk booted half of the company’s full-time staff of 7,500 and an untold number of contractors responsible for content moderation and other crucial efforts. Then came this week’s ultimatum.

Three engineers who left this week described for The Associated Press why they expect considerable unpleasantness for Twitter’s more than 230 million users now that well over two-thirds of Twitter’s pre-Musk core services engineers are apparently gone. While they don’t anticipate near-term collapse, Twitter could get very rough at the edges — especially if Musk makes major changes without much off-platform testing.

Signs of fraying were evident before Thursday’s mass exit. People reported seeing more spam and scams on their feeds and in their direct messages. Engineers reported dropped tweets. People got strange error messages.

Still, nothing critical has broken. Yet.

“There’s a betting pool for when that happens,” said one of the engineers, all of whom spoke on condition of anonymity for fear of retaliation from Musk that could impact their careers and finances.

Another said that if Twitter has been shutting servers and “high volume suddenly comes in, it might start crashing.”

“World Cup is the biggest event for Twitter. That’s the first thing you learn when you onboard at Twitter,” he said.

With the earlier layoffs of curation employees, Twitter’s trending pages were already suffering. The engineering fireworks began Tuesday when Musk announced on Twitter that he had begun shutting down “microservices” he considered unnecessary “bloatware.”

“Less than 20% are actually needed for Twitter to work!” he tweeted.

That drew objections from engineers who told Musk he had no idea what he was talking about.

“Microservices are how most modern large web services organize their code to allow software engineers to work quickly and efficiently,” said Gergely Orosz, author of the Pragmatic Engineer blog and a former Uber programmer. There are scores of such services and each manages a different feature. Instead of testing the removal of microservices in a simulated real-world environment, Musk’s team has apparently been updating Twitter live on everyone’s computers.

FILE - The Twitter splash page is seen on a digital device, Monday, April 25, 2022, in San Diego. On Thursday, Nov. 17, 2022, Twitter continued to bleed engineers and other workers after new owner Elon Musk gave them a choice to pledge to “hardcore” work or resign with severance pay. (AP Photo/Gregory Bull, File)
FILE - The Twitter splash page is seen on a digital device, Monday, April 25, 2022, in San Diego. On Thursday, Nov. 17, 2022, Twitter continued to bleed engineers and other workers after new owner Elon Musk gave them a choice to pledge to “hardcore” work or resign with severance pay. (AP Photo/Gregory Bull, File)

And indeed, one microservice briefly broke — the one people use to verify their identity to Twitter via SMS message when they log in. It’s called two-factor authentication.

“You have hit the limit for SMS codes. Try again in 24 hours,” Twitter advised when a reporter tried to download their microblogging history archive. Luckily, the email verification alternative worked.

One of the newly separated Twitter engineers, who had worked in core services, told the AP that engineering team clusters were down from about 15 people pre-Musk — not including team leaders, who were all laid off — to three or four before Thursday’s resignations.

Then more institutional knowledge that can’t be replaced overnight walked out the door.

“Everything could break,” the programmer said.

It takes six months to train someone to work an on-call rotation for some services, the engineers said. Such rotations require programmers to be available at all hours. But if the person on call is unfamiliar with the code base, failures could cascade as they frantically plow through reference manuals.

“If I stayed I would have been on-call constantly with little support for an indeterminate amount of time on several additional complex systems I had no experience in,” tweeted Peter Clowes, an engineer who took the severance.

“Running even relatively boring systems takes people who know where to go when something breaks,” said Blaine Cook, Twitter’s founding engineer, who left in 2008. It’s dangerous to drastically reduce a programming workforce to a skeleton crew without first bulletproofing the code, he said.

“It’s like saying, ‘These firefighters aren’t doing anything. So, we’ll just fire them all.’”

The engineers also worry Musk will shut down tools involved in content moderation and removing illicit material that people upload to Twitter — or that there simply wouldn’t be enough people on staff to run them properly.

Another concern is hackers. When they’ve breached the system in the past, diminishing damage depends on detecting them quickly and kicking them out.

It’s not clear how Musk’s housecleaning at Twitter has affected its cybersecurity team, which suffered a major PR black eye in August when the highly respected security chief fired by the company earlier this year, Peiter Zatko, filed a whistleblower complaint claiming the platform was a cybersecurity shambles.

“So much of the security infrastructure of a large organization like Twitter is in people’s heads,” said Graham, the cybersecurity veteran. “And when they’re gone, you know, it all goes with them.”

___

AP Technology Writer Matt O’Brien contributed to this report.

Report Error Submit a Tip

More Stories

Canada names Beijing flag-bearers, won’t boycott opening ceremony

Rosie DiManno - Star Columnist, Toronto Star 5 minute read Preview

Canada names Beijing flag-bearers, won’t boycott opening ceremony

Rosie DiManno - Star Columnist, Toronto Star 5 minute read Wednesday, Feb. 2, 2022

The two-time Olympic gold medallist in women’s hockey and three-time Olympic short-track speedskating champ are each fine choices in what can be a fraught business for the COC.

Read
Wednesday, Feb. 2, 2022

WP Router Placeholder Page

0 minute read Thursday, Dec. 22, 2022

Manitoba COVID-19 cases rise to 17; confirmed cases are travel-related

Carol Sanders and Larry Kusch 5 minute read Preview

Manitoba COVID-19 cases rise to 17; confirmed cases are travel-related

Carol Sanders and Larry Kusch 5 minute read Thursday, Mar. 19, 2020

Manitoba is conducting more tests for the novel coronavirus — including a new drive-thru site that opened in Selkirk — while suspending breast cancer screening.

As of Wednesday morning, chief public health officer Dr. Brent Roussin said the province had thus far conducted 2,900 tests for COVID-19.

Hours later, two more presumptive positive cases were reported, bring the total of confirmed and presumptive cases to 17, with no reports of anyone requiring hospitalization. All but one still being tracked Wednesday are travel-related, Roussin said at a news conference.

While nine COVID-19 screening sites have opened in Manitoba in the last 10 days, breast cancer screening is on hold for two weeks, said Lanette Siragusa, Shared Health chief nursing officer.

Read
Thursday, Mar. 19, 2020

Fact Check

1 minute read Thursday, Nov. 30, 2023

Fact Check

Having problems with the form?Contact Us Directly |

Esteban Jaramillo

0 minute read Preview

Esteban Jaramillo

0 minute read Thursday, Aug. 6, 2026

Read
Thursday, Aug. 6, 2026

Shifting line on COVID-19 statistics

Larry Kusch 5 minute read Preview

Shifting line on COVID-19 statistics

Larry Kusch 5 minute read Friday, Aug. 7, 2020

Last week, Saskatchewan Premier Scott Moe provided residents of his province with the kind of detailed coronavirus pandemic information rarely seen in neighbouring Manitoba.

Concerned by the rapid spread of COVID-19 in Saskatchewan Hutterite colonies, Moe served up some cold facts July 29: of the 322 active cases in the province that day, 244 were from colonies. In an update the following day, Saskatchewan officials backed away from specifically mentioning Hutterite colonies, instead citing infection totals for "multiple communal living settings."

Manitoba has also seen a recent spike in Hutterite case counts, but its residents have received scant information from their provincial government.

For a time, the province did refer to certain cases as being linked to Hutterite colonies, but quickly stopped when it received blowback from the communities for being singled out. The public can now only guess the actual numbers based on regional health authority counts.

Read
Friday, Aug. 7, 2020