Speed Means Nothing If You're Down: Benchmarking For The Real World
Spencer Kimball is the CEO and co-founder of Cockroach Labs.
For decades, database performance benchmarks like TPC-C (Transaction Processing Performance Council Benchmark C) chased peak throughput under ideal conditions. Systems were scaled vertically and micro-optimized at every layer to game benchmarks and maximize transactions per second (TPS). But times—and technology—have changed.
Today's applications live everywhere: across regions, clouds and availability zones. They're always on, global and expected to perform flawlessly despite disruptions. Users now demand instant banking balances, lag-free global broadcasts, immediate access to patient records and real-time inventory updates across international supply chains. These aren't aspirations; they're baseline expectations, assumed and demanded unequivocally.
Modern workloads are unpredictable, highly distributed and intensely data-driven. Fraud detection, logistics tracking and AI-powered automation now run continuously at a global scale. Autonomous systems assume constant availability and consistency. They don't pause for outages or wait for recovery. They expect the system to be fast, consistent and always available.
Yet legacy benchmarks still focus on raw throughput, rarely accounting for the realities of modern architecture: latency spikes, node crashes or regional outages. The true measure of performance isn't speed under ideal conditions—it's resilience under failure.
If anyone doubts the importance of resilience, recent history is rife with cautionary tales.
• Costco's Black Friday outage in 2019 allegedly cost millions in sales.
• Ticketmaster's 2022 crash during Taylor Swift's ticket sales revealed its infrastructure was unprepared for massive spikes.
• A faulty update in 2024 froze hospital electronic health records, forcing clinicians to revert to paper and risking patient safety.
• CrowdStrike's 2024 outage halted global freight logistics due to insufficient resilience planning.
• Barclays and Capital One outages in 2025 left millions unable to access banking services, demonstrating that even leading institutions aren't immune.
There is a perennial thread running through this representative sampling of recent failures: The rising complexity of modern applications requires a shift in mindset to resilience as a first-order goal.
Modern infrastructure complexity—multiregion, multicloud and governed by stringent regulations like GDPR, PDPA and DORA—demands new benchmarks that prioritize resilience as a fundamental metric, not an afterthought. Benchmarks that ignore this operational and compliance complexity are no longer sufficient.
True resilience testing involves deliberately introducing controlled chaos: killing nodes, dropping disks, simulating outages. The objective is clear: Observe the system's behavior under stress. Does it reroute traffic seamlessly? Are transactions duplicated, delayed or lost? How rapidly does performance return to baseline? These aren't trivial operational details—they're critical indicators of system integrity.
Chaos testing, a methodology where systems are intentionally stressed to uncover hidden vulnerabilities, is gaining traction. However, resilience testing often remains disconnected from standard performance metrics like throughput and latency. Integrating these tests ensures resilience isn't merely theoretical but quantifiable and central to system design.
Just as vehicle performance isn't judged solely by top speed, database benchmarks shouldn't focus exclusively on maximum throughput. Benchmarks must evolve to measure continuity, recovery speed and stability under real-world pressures. Systems engineered with built-in replication, self-healing automation and geographic consensus aren't merely technically superior; they're strategically essential. These aren't just engineering choices; they're risk strategies. And they should be part of how we measure value.
Speed without resilience is meaningless. Challenge your teams and vendors to prove resilience under chaos. If they can't, they're not ready for today's demands.
The ultimate benchmark isn't the fastest lap—it's staying on track when legacy systems are stuck rebuilding in the pit.
Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
30 minutes ago
- Yahoo
FedEx Corporation (FDX): Keep An Eye On Global Tensions, Warns Jim Cramer
FedEx Corporation (NYSE:FDX) is one of the . FedEx Corporation (NYSE:FDX) is one of the biggest freight and logistics companies in the world. Its shares are dependent on global and American economic performance. Year-to-date, FedEx Corporation (NYSE:FDX)'s shares have lost 16.5% on the back of a devastating 19% drop in the aftermath of the Liberation Day tariffs. Cramer's previous comments about the company have discussed how its business-to-business operations are failing to perform. However, despite this, the CNBC host prefers FedEx Corporation (NYSE:FDX) over its rival UPS. Cramer also likes the firm's CEO. His latest remarks urged viewers to keep an eye on President Trump's anger towards Spain and how it could affect global logistics companies like FedEx Corporation (NYSE:FDX): 'I wanna keep an eye on that, because I know that a company like FedEx, I mean cross border's really, really huge.' A driver unloading packages from a van for a time-critical delivery. Here's what Cramer said after FedEx Corporation (NYSE:FDX)'s latest earnings results: 'Third loser, freight transportation. Truckers can't seem to make their numbers. The railroad stocks can't get any momentum. FedEx showed you how hard this business is when they reported last night. Their business-to-business service has been stuck in neutral, even as the business-to-consumer side is okay, but FedEx hasn't been able to make the Street's numbers. I think we've got some opportunity here, though. FedEx has cut its capital expenditures and chopped its expenses. It's a coiled spring. I like coiled springs, but understand that it won't spring until we see how the tariffs shake out, because so much of the business involves import-export. Until then, spring stays coiled.' While we acknowledge the potential of FDX as an investment, our conviction lies in the belief that some AI stocks hold greater promise for delivering higher returns and have limited downside risk. If you are looking for an extremely cheap AI stock that is also a major beneficiary of Trump tariffs and onshoring, see our free report on the best short-term AI stock. READ NEXT: 20 Best AI Stocks To Buy Now and 30 Best Stocks to Buy Now According to Billionaires. Disclosure: None. This article is originally published at Insider Monkey.
Forbes
2 hours ago
- Forbes
How To Get Hired At Deloitte: 3 Insider Tips From The Head Of Talent
How To Get A Job At Deloitte: Insider Tips From The Head Of Talent Getting hired at Deloitte is no small feat. The company receives a couple million job applications every year, and the application process is extensive and competitive. Now the world's largest consultancy, Deloitte was founded more than 180 years ago as a London-based accounting firm. It currently spans 150 countries and territories and employs approximately 460,000 people across the globe. In terms of revenue and employees, Deloitte is the largest of the Big Four professional service firms and has expanded its service offerings beyond accounting to include business process, AI, human capital, strategy and more. 3 insider tips for how to get hired at Deloitte. David Rizzo, Chief Talent Officer at Deloitte David Rizzo, the head of talent for Deloitte US and 25-year employee, told Business Insider that the company receives 'more than 2 million job applications a year across our US organization." He shared—before revealing three important insider tips—that he leads the team that decides which candidates are the best fit for the company. The tips Rizzo revealed for how to get hired at Deloitte focus within these areas: Tip #1. This is what the head of talent looks for in a Deloitte candidate. For the Business Insider interview, David Rizzo said that the top three (3) things he looks for in Deloitte job candidates are: Tip #2. This is how you can make your Deloitte job application stand out. The competition to get hired at Deloitte is fierce. To stand out, David Rizzo says that you need to demonstrate high-impact contributions and communicate the value you bring. Tip #3. This is how you should prepare for a Deloitte interview. David Rizzo shared specifics about what he recommends you focus on and how you should prepare for a Deloitte interview. When a credible insider shares tips and strategies for how to get hired at the largest professional services firm, you take note. If you have a goal to get hired at Deloitte, I highly recommend you process the above insider tips and move accordingly with submitting your application and preparing for the job interview process. Tips from other Deloitte employees. Other Deloitte employees share tips as well to help you succeed in getting hired. Check out the messages in this video and you'll hear these recommendations: Career advice from Deloitte executives for those just starting out. If you are just starting out in your career, several Deloitte executives offer up specific career advice to help you succeed. I recommend you check out the messages in this video. Whether you are just starting out in your career or you're a mid or senior-level employee, it's important to understand that you are on a lifelong journey where ups, downs, uncertainties and unknowns will surely visit you from time to time. None of us is immune. Sometimes things feel scary, uncertain and overwhelming. That's normal. That's to be expected. What you want to remember is to embrace the process and slow down long enough to feel what you feel so that you can better process your feelings and experiences. Doing this will help you put things in perspective and put your best effort forward whether you are trying to get hired at Deloitte, promote within the company, navigate organizational change or trying to embark on opportunities outside of Deloitte. Recommended reading: Deloitte Is Hiring Job Seekers Who Don't Have A College Degree Nail The Interview: Answer 'Why Should We Hire You' Like A Pro 3 Things Strategic Thinkers Do To Get Hired In Senior Management Positions
Yahoo
4 hours ago
- Yahoo
'Central bank of central banks' warns of rising inflation risks
The world's 'central bank of central banks' warned about the rising possibility of fresh outbreaks of inflation. The Switzerland-based Bank for International Settlements noted in a new report that consumers across the globe expect steep price increases in the next year — and that because of the lasting effect of COVID-era inflation, their predictions now risk becoming a self-fulfilling prophecy. 'When it comes to inflation expectations, it's once bitten, twice shy,' a BIS official said. The report gives clues to central bankers' thinking as policymakers cautiously trim interest rates as inflation subsides. Washington's trade war adds to the volatility: Rising protectionism is eroding the global economic order, the BIS' chief said, creating a 'new era of heightened uncertainty and unpredictability.' — J.D. Capelouto Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
