What is “AI upscaling” in video game development?

I’ve seen demo’s from Nvidia that do this AMAZINGLY well.

That’s a hell of a lot of math - and as display resolutions and frame rates get better - the problem rapidly escalates.

But the point remains - as it does with ALL AI - that you can’t really trust it not to do something very strange.

Gage Wood throws third no-hitter in Men's College World Series history, keeps Arkansas title hopes alive - NCAA.com

However, consider a common thing people to with flight simulators…practicing landing at night.

There are landing aid lights which are super-bright so you can see them from a very long way away. One type of these lights are on the ends of the runway and they are designed to show whetherer you’re approaching the runway on the right “glide slope” - so they change color depending on how high/close you are to the touchdown point.

But there are issues.

As a NATO/Ukraine supporter, since you're so blown away and angered by Trump putting Zelensky in his place yesterday, why don't you support the Ukraine by joining the Ukrainian army? There's 200,000,000+ of you. Put your money where your mouths are.

These light points are tiny - they only just cover a single pixel.

I’ve been working in Flight Simulation -where this problem is massively exacerbated by clients who have maybe 16 display screens - all at some crazy high resolution!

But that’s a kinda special situations - and we could maybe handle it by drawing those specific lights AFTER the AI had filled in all the gaps.

The Mustang’s New Appearance Pack Is a 1980s Fever Dream - Motor1.com

So if we render the scene at reduced resolution - we might not draw that critical light point at all because it fell into one of the gaps.

That’s A VERY BAD THING!!! When you’re trying to train a pilot to react correctly to those lights and they’re being displayed incorrectly - you can end up doing what we call “Negative training” - where you make the pilot WORSE - not better!

So usually - if you’ve got an 8 MegaPixel screen - the graphics card has to calculate the color of every single one of those 8 million pixels (maybe more with anti-aliasing) - probably 70+ times per second.

My wife has a bunch of really attractive friends, and she expects me to never say anything to her about how beautiful they are. Does this seem fair? I love my wife, and just commenting shouldn’t hurt anything, right?

The AI might MAYBE notice that the light was there on the previous frame and “fill it in” - but what happens if you went off the glide slope at that moment. The light SHOULD change color - but because the AI doesn’t know anything about the glide slope - or the particular angles at a specific airport - it’s highly likely to screw up.

So using this technique could be very handy.

So the idea is that you train an AI to look at just (say) 1 million pixels - and try to guess what the others should be.

A Giant Mouth Has Opened on The Sun And Even It Looks Surprised - ScienceAlert