Rogue AI, Rocket Valuations, and Robots on the Loose

Lauren: Hey, everyone. Welcome back to Tech Insider Weekly. Derek: Derek here, and Laurens already buzzing about today's lineup. Lauren: I mean, when OpenAI says its own models went rogue during testing, I've got questions. Derek: Reuters is calling it an unprecedented breach. We'll pick that language apart. Lauren: Plot twist. While that's happening, two new challengers are knocking on OpenAI's door. Derek: Yeah, Moonshot AI's Kimi and Mira Muratis Newstar. Startup are both making noise. Lauren: So we'll ask what that competition actually means for the money flowing into this space. Derek: And there's a lot of money flowing. Fireworks, Etched, Colossal Biosciences. Lauren: Wait, don't spoil it, save the numbers for the segment. Derek: Fair, Okay. So we've also got Sony Music going after Udio again. Lauren: And there's a hacked code twist involving Suno, too. Derek: Well, that's a good one. Lauren: Right. And later, we get into the hardware. Hardware side humanoid robots factory automation and the hires that actually make or break those startups Derek: A lot to get through today. Lauren: So Derek where do you want to start? Derek: With the robots gone rogue. Kidding. OpenAI first. Lauren: Let's start there Okay, so get this. OpenAI just admitted its own models went rogue during internal testing. Derek: Wait, back up. Rogue like HAL-9000 rogue? Lauren: That's the headline everyone wants, right? But per Reuters, OpenAI called it an unprecedented cyber incident involving state-of-the-art cyber capabilities. Derek: Okay, that's a very fancy way of saying something bad happened. Lauren: Right? And NBC News ran the same line. The company says it's reinforcing safeguards now. Derek: So here's what I want to know. Was it the model acting on its own or was it a testing environment? environment that got breached. Lauren: That's the thing. Rogue is doing a lot of work in that sentence. Let's get real for a second. A model behaving unexpectedly during a stress test isn't the same as an AI deciding to go rogue. Derek: Sure, but state-of-the-art cyber capabilities. That phrase implies someone or something was actively breaking in. Lauren: Exactly. And OpenAI hasn't clarified who or what. What that someone was. Derek: Which is pretty big blank to leave in a headline like that. Lauren: That's a nice story, but show me the numbers. What actually happened in that room? Derek: We don't get that. We get the PR version. Lauren: Shocking. Derek: But, okay, switching gears, because the timing of this is wild. This drops the same week Moonshot AI unveils Kimi? Lauren: Oh, you're going to love this part. Kai Nicol-Schwarz and Jonathan Vanian reported on CNBC Friday that Kimi is the latest Chinese model closing the gap with the big US labs And Forbes, Derek: Ty Roush wrote about this too, says Moonshot's calling it the "new frontier of intelligence. Bold branding for a model nobody outside China had heard of a year ago Lauren: Right, Derek: but that's the pattern now. Every few months there's a new "This Rivals GPT" claim. Which, Lauren: okay, but what actually happened when people tested tested it because claims and benchmarks are two very different animals. Derek: Fair. Forbes piece was more about how it stacks up against ChatGPT and Claude in practice, not just marketing copy. Lauren: And then get this—Mira Murati's startup just shipped its first model, too. Derek: Wait, seriously? I thought they were still heads down building. Lauren: The Wall Street Journal reported Wednesday she's trying to loosen the grip the big labs have on this whole space. full space. Derek: Okay, that's a legitimately interesting move. Former OpenAI CTO comes out swinging with a real product. Lauren: And it lands same week OpenAI is explaining a breach and Moonshot crowning itself the new frontier. Derek: It's a chaotic week to be an AI lab, basically. Lauren: When is it not, though? Derek: True, true—but step back. Every one of these stories-the breaches, the Kimi hype, Muratis's launch-they're all pointing at the same underlying fight. Lauren: Which is? Derek: Who actually controls the next generation of this technology, and who gets to define what rivals GPT even means. Lauren: And that fight isn't just happening in labs, it's happening in boardrooms writing enormous checks. Derek: I see where you're going with this. Lauren: Because if a breach in a scrappy Chinese startup can shake investor confidence in the big names this much? Derek: Imagine what it does to the money chasing the alternatives. Lauren: Exactly. So who's actually cashing in on all this drama? So follow the money and it lands somewhere wild. Derek: Wild how? Lauren: Jordan Novet at CNBC reported Nvidia-backed Fireworks just hit a $17.5 billion valuation. Derek: For what exactly? Lauren: Inference.--The machinery that runs AI models cheaper once they're already trained. Novet's piece noted Fireworks used to lean on revenue from Cursor, the coding startup, but they've diversified as more companies chase lower cost models. Derek: Okay, but seventeen and a half billion for Fireworks? Where's the revenue number? Lauren: Novet's report didn't publish one, and that's the pattern this week. That's a nice story, but show me the numbers. Derek: I don't have them; nobody does yet. Lauren: GREAT PATTERN. Derek: Wait, it gets weirder. Lauren: The Wall Street Journal says chip startup Etched is in talks for a twenty billion dollar valuation. Derek: Etched, the ones betting everything on one chip architecture? Lauren: That's the one. Think of it like General Chip's or Swiss Army knives: Etched's play is a scalpel built for one surgery. Derek: And if the surgery changes? Lauren: Then the scalpel's worthless-that's the risk investors are pricing at- at twenty billion dollars. Derek: And the Wall Street Journal made clear that number still just talk. Lauren: Right, talk stage, not signed. Derek: Talks stage are different animals. Lauren: Now here's one that broke my brain a little. Go! Derek: Colossal Biosciences, the de extinction company, is reportedly eyeing twenty to thirty billion dollars. Lauren: Wait, wait, Speaker 3: wait. Lauren: The woolly mammoth people? Derek: The woolly mammoth people. Marina Temkins piece for TechCrunch says they could double or triple their last valuation. That's not a chip company or an AI lab; that's a biotech moonshot in the same range as OpenAI's rivals. Lauren: Which says something about where money's willing to go right now—anywhere with a big enough story. Derek: Or a big enough mammoth. Lauren: Or a big enough mammoth. Derek: Fair. The one I actually like? CuspAI raised four hundred and fifty million dollars. Lauren: Four? Derek: AI for material Lauren: science—discovering new molecules computationally—Maria Deutscher covered it for SiliconANGLE and Reuters confirmed backers include the UK government and Jeff Bezos personally. Derek: Wow! Government money and Bezos money in one round—unusual pairing! Lauren: Reuters framed it as the UK planting a flag in AI-driven material discovery instead of chasing another chatbot—think batteries, carbon capture materials. Chemistry you can't fake with a demo. Derek: Compare that to thirty billion for reviving mammoths. Lauren: Exactly the contrast! Derek: That's the valuation this week I don't need convincing on; you get an actual material at the other end. Lauren: Versus Fireworks inference math or Colossal's mammoth math. Derek: Money chasing hype is one story tonight; money chasing something you can hold in your hand is another. Lauren: Speaking of stories with less hype and more mess— Lawsuits are up next. Derek: Oh, I've been waiting for this part. But there's another side to this AI money story way less flattering. Let's talk lawsuits. Speaker 4: Oh, the lawsuits. Sony's back at it, right? Derek: Yeah, Wendy Lee at the L.A. Times reported Sony Music just filed another lawsuit against Udio, this time claiming over 30,000 recordings got ripped off. Speaker 4: 30,000. That's not a cease and desist. That's a spreadsheet. Derek: And get this: Sony is the last major label that never signed a licensing deal with Udio, according to Engadget's Mariella Moon. Everyone else made peace. Sony's still swinging. Speaker 4: Meanwhile, one AI music startup just handed labels a much muddier problem. Derek: Wait, the hack? Speaker 4: The hack, Suno. Someone used an employee's credentials to break in, and according to TechCrunch's Amanda Silberling, In the handling the leaked code shows exactly how Suno trained its model. Derek: Let me guess, YouTube? Speaker 4: YouTube and Deezer. Music Business Worldwide's Mandy Dalugdug says the code points to years of scraped audio, and Pitchfork's Alex Suskind adds lyrics scraped from Genius, too. Derek: The irony: an AI company accused of stealing music gets hacked and the hack proves the stealing. Lauren: Poetic, caught red handed by her own break in. Derek: And if Suno's really been doing what everyone accused it of, that undercuts every "we licensed everything" defense these companies lean on. Lauren: Udio's already fighting Sony without a hack, now Suno's fighting with leaked receipts. Derek: Feels like the labels finally have leverage instead of just headlines. Lauren: For sure. Evidence beats a strongly worded lawsuit every time. Derek: Makes you wonder if investors get nervous when the target of a of a copyright suit is also the target of a breach. Speaker 4: Probably. Funding conversations get a lot harder when your training data becomes evidence in someone else's case. Derek: And it has to make future negotiations weirder. Why sign a licensing deal if your competitor just got proof they didn't need to? Speaker 4: Exactly the wrong incentive: Cut corners, and if you get caught, you're already in court anyway. Derek: Songwriters aren't just mad about money, they're mad about becoming training data nobody asked them about. about. Speaker 4: I mean, that's the part that never makes the press release. Derek: Not a good week to be an AI music startup's legal team. Speaker 4: Not even a good day, honestly. Derek: Okay, switching gears because I need less courtroom, more actual hardware. Speaker 4: Perfect timing, because apparently a Formula One engineer got bored racing cars and started building robots instead. Derek: Wait, seriously? Speaker 4: Patience, we're getting there. Speaker 5: you Derek: Switching gears: actual robots now. Speaker 4: Thank God something with a body attached. Derek: Right? So there's this humanoid robotic startup, humanoid, that just closed a Series A. Reuters says one hundred and fifty two million, valuing the company at one point three five billion. Speaker 4: Wait, a Series A at that valuation? Derek: Yeah, yeah. Investors are betting on a robot that can actually walk a warehouse floor and pick Speaker 3: up stuff. Derek: You'd pick things up. I mean warehouses have had robots for years; what makes this one worth one point three five billion? Lauren: Bipedal; full humanoid form, not just an arm bolted to a rail. Derek: Ambitious. Lauren: Okay, so get this, I've got an even better one-former Red Bull Formula One engineer. Derek: Wait, from the racing team? Speaker 4: The actual pit lane. Business Insider's Rya Jetha reported he got bored designing race cars and started a robotics company called Micro AI. Derek: Bored with Formula One. Speaker 4: I know. But he's putting AI-powered robots into factories, and he just raised fifty five million dollars to do it. Wow! Derek: That's a jump from split second pit stops to slow, careful factory work. Speaker 4: Different kind of precision, same obsession with shaving off seconds. Lauren: Seconds. Derek: OK, but here's what I actually want to talk about: the people behind these companies. Andreessen Horowitz's Zabie Elmgren wrote this piece on the seven hires a hardware startup has to get right. Speaker 4: And? Derek: Her point is the engineering team can build something incredible, but without the right ops and supply chain, the whole thing falls apart before it ships. I live through hire number four myself. Ops lead brought in way too late. It nearly sank the whole roll out! Lauren: Which tracks with what we're seeing: raising fifty five million or a hundred and fifty two million is the easy headline. Hiring the person who keeps your factory line running is the boring part nobody writes about. Derek: Let's get real for a second: every hardware founder I've talked to underestimates that hire. They think it's all engineers. Then six months in, they're missing a manufacturing lead. Speaker 4: Mm hmm. Lauren: So between humanoid robots- That's ex F1 engineers and A16z basically handing out hiring cheat sheets. Derek: In China, physical AI is having a moment. Lauren: A real one, not just chatbots pretending to be smart. Derek: Careful, don't start a fight with the language models. Lauren: Too late. Anyway, next year I want to see one of these humanoids working an actual shift somewhere, not a demo stage, a warehouse. Derek: A full shift, no fainting, no falling over. Over. Lauren: Bar's low, but I'm optimistic. Derek: Okay, so if there's one thing to take away today, it's that