We Remastered My First Video in 4K!

[Music]

Okay, let's take a look at that fan header. It was mind-blowing! We use upscaling to enhance the quality of everything, from photos to games to nonsensical movie plots. But perhaps the most common use is the restoration of old or degraded videos. Now, basic upscaling techniques work by sampling each pixel and then multiplying it to match the desired new resolution. However, that can only take us so far and won't generate the kind of result we saw with the 4K 60fps remastered upload of Rick Astley's "Never Gonna Give You Up."

To understand more about how a 720p 30fps video managed to look this good, we reached out to Topaz Labs, makers of the machine learning-assisted upscaling software used for that project. We also tried our own restoration using their software on my very first YouTube upload — a review of the Sunbeam Tech Tunic Tower.

As you can see, the results are uneven, but there are some interesting reasons for that. We also attempted a restoration on another classic video using the MSI Creator Z16p laptop, provided to us along with a sponsorship for this project. So, let's dive into the details!

Using Deep Learning to Enhance Video Quality

When upscaling videos, it's not as straightforward as upscaling still images. You're dealing with thousands or even tens of thousands of frames, and if you want to target a modern video resolution like 4K, you could be attempting to create millions of pixels that weren't there before.

The process involves using machine learning algorithms to predict the best intermediate frames between existing frames. Companies like Topaz Labs have trained their neural networks on millions of frames to improve upscaling results. However, the quality of the original footage plays a significant role in the success of the upscaling process.

Upscaling a 240p Video: The Challenges

To demonstrate the limitations of upscaling, we started with my very first YouTube upload, which was recorded at a mere 240p. This resolution only gives us a total of 76,800 pixels to work with. Most of those pixels are just the blank wall behind me, leaving very few pixels to capture the expressions of my eyes.

Additionally, the original footage was interlaced, a technique used to increase the perceived frame rate and resolution of older footage. Interlacing involves drawing half of the picture first as a series of lines across the screen, followed by the second series of lines to fill in the gaps. This technique poses challenges for upscaling.

Results: The Good and the Not-So-Good

The upscaled video showcased some impressive improvements, although not without limitations. The footage had moments of brilliance, where it looked significantly sharper and better. However, certain areas still suffered from artifacts and distortion.

Comparing the upscaled version to the original video wouldn't be fair, as the original was of poor quality. However, the upscaled video showed improvements in certain aspects, such as sharper lines on the shirt and copper heat pipes. While it's not perfect, there were flashes of brilliance that made the viewing experience better.

Moving on to Higher Resolution Footage

We then turned to higher-resolution footage to see how upscaling performs with more pixels to work with. We used the famous fire truck unboxing video that was available in 720p. With the help of the Topaz Labs software, we were able to upscale this footage to 4K.

The results were more noticeable in this case. The upscaled video showcased improved sharpness and reduced artifacts. However, challenges remained when it came to handling motion, especially with handheld camera footage.

Keyword

Video upscaling, 4K remaster, machine learning, resolution enhancement, video restoration

FAQ

Q: What is video upscaling? A: Video upscaling is a technique that uses machine learning algorithms to enhance the resolution and quality of low-resolution or degraded videos.

Q: Can upscaling improve the quality of all types of videos? A: While upscaling can enhance the quality of videos, the success of the process depends on the original footage's quality and characteristics. Higher-resolution footage tends to yield better results.

Q: What are the challenges of upscaling low-resolution videos? A: Low-resolution videos have fewer pixels, making it difficult to capture fine details. Additionally, interlaced footage and camera motion can present challenges for upscaling algorithms.

Q: How does upscaling software work? A: Upscaling software uses machine learning algorithms to predict intermediate frames between existing frames, improving the visual quality of the footage. Training the software on large datasets helps enhance its predictive capabilities.

Q: What hardware is required for video upscaling? A: Video upscaling can be computationally intensive. While the minimum requirements are relatively low, employing a powerful GPU and beefy hardware can significantly improve processing speed.

Q: How long does video upscaling take? A: The time required depends on various factors, including the resolution of the original video, the desired output resolution, and the processing power of the hardware used. Upscaling higher-resolution footage generally takes longer.

Q: Can upscaling remove all video artifacts? A: While upscaling can minimize artifacts in videos, eliminating them entirely may not always be possible, especially with videos containing complex motion or low-quality source material.

Q: Are there other methods for enhancing video quality? A: Yes, apart from upscaling, techniques like denoising, frame rate conversion, and color correction can also be used to enhance video quality.

Q: What are the limitations of upscaling videos? A: Upscaling cannot create nonexistent pixels or recover details that were lost in the original footage. The final result also depends on the quality of the source material and the effectiveness of the upscaling algorithm.

Q: What are the use cases for video upscaling? A: Video upscaling is commonly used for restoring old or degraded footage, enhancing the visual quality of low-resolution videos, and preparing content for modern high-resolution displays.

Q: Can upscaling improve the viewing experience of older videos? A: Yes, upscaling can significantly improve the visual experience of older videos, making them more enjoyable to watch on modern high-resolution displays.

Q: What other factors should be considered when upscaling videos? A: Besides upscaling, factors such as denoising, frame rate conversion, and color correction should also be considered to achieve the best possible results when enhancing video quality.

Please note that these FAQs are generated and may not cover all aspects of the topic.