Skip to main content

Why I leave Nvidia’s game-changing tech off in most games

Ratchet and Clank Rift Apart running on the Samsung Odyssey OLED G8.
Image used with permission by copyright holder
ReSpec hero art with Jacob Roach
This story is part of Jacob Roach's ReSpec series, covering the world of PC gaming and hardware.

Nvidia’s most recent graphics cards have increasingly relied on Deep Learning Super Sampling (DLSS) 3 to find their value. GPUs like the RTX 4070 Ti and RTX 4060 Ti aren’t impressive on their own, but factor DLSS 3 into the buying decision, and they start to become attractive. If you look at Nvidia’s overall strategy for this generation of chips, it looks like the company has started selling DLSS, not graphics cards.

It’s not hard to see why DLSS 3 is so important. It makes the impossible possible, like path tracing in Cyberpunk 2077, and it helps multiply frame rates far beyond what should be possible in games like Portal RTXBut now that we finally have DLSS 3 in more games and the party trick status has faded away, I’ve left Frame Generation off in most games. Here’s why.

Recommended Videos

How DLSS 3 works

Nvidia DLSS 3 running in Microsoft Flight Simulator.
Nvidia

First, it’s important to explain how DLSS 3 works. It comprises two components. DLSS Super Resolution is the image reconstruction technique we’ve come to know and love over the past several years. DLSS 3 adds Frame Generation as well, which is exclusive to RTX 40-series graphics cards and helps GPUs like the RTX 4070 stand out from the crowd.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

Frame Generation is the interesting bit. It works by comparing two sequential frames in a game and creating a field of motion. It tracks particles, reflections, shadows, lighting, and everything in-between, then brings that all together to calculate a new frame. When combined with DLSS Super Resolution, as Nvidia points out, it makes the tech capable of generating seven out of every eight pixels you see. That’s mighty impressive.

A chart shing motion through Nvidia's DLSS 3.
Nvidia

If you break down this process, though, it’s clear to see that there’s a problem. That generated frame is basically a “dumb” frame. It’s just a picture, completely devoid of what you’re doing in the game or the inputs you’re entering. All it has to go on is the frame that came before and the frame that will come after. You can think about Frame Generation like an ultrafast AI image generator that’s taking your previous and next frame into account. Critically, it doesn’t react to your inputs.

A chart showing how DLSS 3 reconstructs frames.
Nvidia

This creates extra latency. As a thought experiment, imagine you’re running a game at 30 frames per second (fps). That means there’s 33.3 milliseconds between each frame, so if you take an action, you’ll have to wait 33.3ms to see it reflected in the game (there’s more latency elsewhere in the PC, but let’s ignore that for now). This is why, especially if you’re accustomed to playing games at 60 fps or higher on PC, it can feel like you’re playing in slow-motion at 30 fps.

Let’s bring in DLSS Frame Generation. Ignoring some overhead that’s necessary for calculating each frame, it would theoretically double your frame rate to 60 fps by generating every other frame. That’s how Frame Generation works. Remember half of those frames are dumb, though. You’re getting the appearance of 60 fps, but only the responsiveness of 30 fps.  And that’s the critical issue with DLSS 3.

Nvidia attempts to offset this problem with its latency-reducing Reflex tech. This basically syncs up the CPU and GPU so that frames are rendered as soon as they’re ready, eliminating the typical render queue that sits in-between the two components. Reflex ensures your real frames arrive as fast as possible, so the impact of your fake frames doesn’t feel as large.

A diagram explaining different types of system latencies.
Nvidia

Nvidia likes to point out the experience of all three components working in tandem — Reflex, Frame Generation, and Super Resolution all improving responsiveness and smoothness as a singular unit. That’s just the problem, though; they aren’t a single unit. In games that support all three, you’re free to use Super Resolution and Reflex on their own, which will always result in lower latency compared to turning on Frame Generation.

This is a much more potent combo for actually increasing your frame rate, too. Super Resolution is simply enhancing detail on images that are actually rendered by your graphics card. In the same situation as above, if Super Resolution took you from 30 fps to 60 fps, you’d actually be getting the responsiveness of 60 fps.

Not right for every game

Diablo 4 running on the Alienware x16.
Jacob Roach / Digital Trends

The dynamic between Super Resolution and Frame Generation became clear when I started playing Diablo 4Like most other games with DLSS 3 support, I jumped into the graphics menu and flipped on Frame Generation, and instead of Super Resolution, I opted for Nvidia’s Deep Learning Anti-Aliasing (DLAA). The game was smooth, but something felt off.

Everything I did felt just a hair behind my input. It wasn’t a problem at first, but as I started climbing levels and taking on harder content, the tight rotation of abilities and attacks I needed to execute (along with a healthy dose of network lag) didn’t feel right. I turned off Frame Generation, turned on Super Resolution instead, and suddenly it felt right.

This wasn’t the first time I experienced the occasional sluggishness of DLSS 3, but it was put on full display in the fast-paced environment of Diablo 4. It’s also problematic in Marvel’s Spider-Man and Ratchet & Clank: Rift Apart, especially if you’re trying to tackle the higher difficulties of the games. Returnal can feel off as well, given how quickly you need to dodge around screen.

Hogwarts Legacy running on the Samsung Odyssey OLED G8.
Jacob Roach / Digital Trends

The story here isn’t that DLSS 3 is bad and you should turn it off, though. DLSS 3 is very impressive, and there’s a reason I say I leave it off in “most” games. I wouldn’t be able to comfortably play Portal RTX without the tech, and Cyberpunk 2077‘s path tracing mode owes its life almost exclusively to DLSS 3. That’s not to mention games like Hogwarts Legacy and A Plague Tale: Requiem, where a hair of extra latency is worth a performance and visual upgrade.

However, Nvidia has billed DLSS 3 as some sort of performance multiplier across games, and although it can improve the smoothness of your games, it also comes with some reasonable trade-offs. And unfortunately, the situations where you need DLSS 3 the most are also the situations where it shows the most problems.

RTX 4060 performance in Cyberpunk 2077 at 1440p
Jacob Roach / Digital Trends

For instance, with the RTX 4060, you’ll get about 67 fps in Cyberpunk 2077 with the Ultra RT preset at 1440p and DLSS 3 enabled. As we’ve covered, you’re actually feeling the latency of about 33 fps, though. DLSS 3 enhances already good performance. It doesn’t fully make up for poor performance, unlike Super Resolution.

This is important to point out, especially with the backlash some of Nvidia’s recent GPUs have received. Nearly all of Nvidia’s current-gen GPUs have carried DLSS 3 as a badge of honor, making up for lackluster generational improvements. It’s absolutely fair to factor DLSS 3 into a buying decision, but you should weigh it against the raw performance of the graphics card. The DLSS 3 performance number you see in a chart doesn’t tell the full story. In the case of a game like Cyberpunk 2077, you may believe you can reasonably play the game at over 60 fps with maxed-out ray tracing, but the feeling of actually playing at that frame rate isn’t even close.

Reasonable trade-offs

Two RTX 4060 graphics cards sitting next to each other.
Jacob Roach / Digital Trends

Personally, I use DLSS Super Resolution and Reflex together when I can, usually skipping out on the Frame Generation option unless it’s an extreme circumstance like Portal RTX. It’s true that Frame Generation is a shortcut to much higher performance, but it also carries all of the caveats that shortcuts normally do.

As I’ve covered, there are plenty of situations where DLSS 3 makes sense and can vastly improve your gaming experience. But it still can’t overcome the experience of better raw performance out of your graphics card, which is a very important factor to keep in mind. There has been a lot of marketing hype around DLSS 3, and for as much of that is earned, there are still trade-offs you need to contend with.

Jacob Roach
Lead Reporter, PC Hardware
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
EmuDeck is slowly taking over my PC gaming setup
EmuDeck running on a Windows PC.

I was once like you. I thought EmuDeck was just a quick and easy way to set up emulators on my Steam Deck, and despite using it for years, I never thought more of it than that. But slowly over the past few months, EmuDeck has become one of the most essential apps I have installed on my gaming PC.

EmuDeck showed up on the scene in 2022, originally built as a "collection of scripts that allows you to autoconfigure your Steam Deck" for emulation. It will install your emulators, configure them, create directories for your games, and hook into apps like Steam ROM Manager so you can see all of your emulated games in your Steam Deck library. It's been an essential tool for retro and emulation enthusiasts since release, but EmuDeck has grown into something much more powerful -- and it's not slowing down.
Always humble beginnings

Read more
Nvidia’s most underrated DLSS feature deserves far more attention
Alan Wake 2 running on the Samsung Odyssey OELD G9.

Since the introduction of Nvidia's Deep Learning Super Sampling (DLSS), the company has done an excellent job getting the feature in as many games as possible. As the standout feature of Nvidia's best graphics cards, most major game releases come with the feature at the ready.

That's only become truer with the introduction of DLSS 3 and its Frame Generation feature, showing up in recent releases like Ghost of Tsushima and The First Descendent. But one DLSS feature has seen shockingly low representation.

Read more
I tried to settle the dumbest debate in PC gaming
settling borderless and fullscreen debate dt respec vs

Borderless or fullscreen? It's a question every PC gamer has run up against, either out of curiosity or from friends trying to get the best settings for their PC games. Following surface-level advice, such as what we lay out in our no-frills guide on borderless versus fullscreen gaming, will set you on the right path. Borderless is more convenient, but it might lead to a performance drop in some games. In theory, that's all you need to know. But the question that's plagued my existence still rings: Why? 

If you dig around online, you'll get wildly different advice about whether borderless or fullscreen is better for your performance. Some say there's no difference. Others claim huge improvements with fullscreen mode in games like PlayerUnkown's Battlegrounds. More still say you'll get better performance with borderless in a game like Fallout 4. You don't need to follow this advice, and you probably shouldn't on a more universal basis, but why are there so many different claims about what should be one of the simplest settings in a graphics menu?

Read more