We have moved to https://openmodeldb.info/. This new site has a tag and search system, which will make finding the right models for you much easier! If you have any questions, ask here: https://discord.gg/cpAUpDK |
Difference between revisions of "Using ESRGAN, Links, And Other Information"
(Add DirectML Tutorial Link, specified that it's WIP // Edit via Wikitext Extension for VSCode) |
|||
(22 intermediate revisions by 4 users not shown) | |||
Line 15: | Line 15: | ||
=== GUI Tools === | === GUI Tools === | ||
+ | ---- | ||
+ | ==== Cupscale [https://upscale.wiki/wiki/Cupscale_Tutorial (Wiki)] [https://github.com/n00mkrad/cupscale (GitHub)] ==== | ||
+ | ---- | ||
+ | Cupscale is a young ESRGAN GUI that's built with usability in mind. | ||
− | ==== | + | ===== Advantages ===== |
+ | |||
+ | * Run ESRGAN on CPU, Nvidia GPU or even AMD GPUs using Vulkan | ||
+ | * Interpolate models on-the-fly (no need to create extra model files) | ||
+ | * Create multiple types of comparisons | ||
+ | * Batch upscale entire folders | ||
+ | * Upscale GIFs and even videos | ||
+ | * Multiple seamless modis are available | ||
+ | * Supports many image formats including JPEG, PNG, WEBP, DDS, and more | ||
+ | |||
+ | ===== Disadvantages ===== | ||
+ | |||
+ | * No cross platform support | ||
− | IEU | + | ==== IEU - Image Enhancement Utility [https://github.com/ptrsuder/IEU.Winforms (GitHub)] ==== |
+ | ---- | ||
+ | IEU has been used by many people and is considered mature, but if you encounter bugs or have feature requests, feel free to report them on Discord, or on GitHub repository by creating an issue. | ||
The '''Download''' is under the [https://github.com/ptrsuder/IEU.Winforms/ IEU.Winforms] Releases tab. | The '''Download''' is under the [https://github.com/ptrsuder/IEU.Winforms/ IEU.Winforms] Releases tab. | ||
Please take a bit of your time to read [https://github.com/ptrsuder/IEU.Winforms/wiki/Basic-usage IEU wiki] first. | Please take a bit of your time to read [https://github.com/ptrsuder/IEU.Winforms/wiki/Basic-usage IEU wiki] first. | ||
− | ===== Advantages | + | ===== Advantages ===== |
− | |||
* Process any amount of images with all models you select via check-boxes | * Process any amount of images with all models you select via check-boxes | ||
* Control over the output format and naming scheme | * Control over the output format and naming scheme | ||
− | |||
− | |||
− | |||
* Can use a different model for the alpha channel | * Can use a different model for the alpha channel | ||
* Can upscale each channel separately (Red, Green, Blue and Alpha) | * Can upscale each channel separately (Red, Green, Blue and Alpha) | ||
*: This is useful for non diffuse textures, so normal maps (_n.dds typically), specular maps, ... | *: This is useful for non diffuse textures, so normal maps (_n.dds typically), specular maps, ... | ||
* Can interpolate different models right in the GUI | * Can interpolate different models right in the GUI | ||
− | |||
===== Disadvantages ===== | ===== Disadvantages ===== | ||
* No cross platform support | * No cross platform support | ||
− | |||
− | |||
=== CLI Tools === | === CLI Tools === | ||
− | + | ---- | |
− | ==== [https://github.com/ | + | ==== Joey's ESRGAN [https://upscale.wiki/wiki/Joey's_ESRGAN_Tutorial (Wiki)] [https://github.com/JoeyBallentine/ESRGAN (GitHub)] ==== |
− | + | ---- | |
===== Advantages ===== | ===== Advantages ===== | ||
* Cross-Platform | * Cross-Platform | ||
* Works on headless systems | * Works on headless systems | ||
− | * | + | * Auto splits and merges images in memory |
− | * | + | * Multiple seamless modis are available |
− | * | + | * It can chain models |
− | * | + | * As with any CLI tool, you can easily script around it to add further features. |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
===== Disadvantages ===== | ===== Disadvantages ===== | ||
− | * | + | * You have to enter the full model names if you don't wrap a script around it |
− | * | + | * CLIs can feel intimidating to those unused to them |
− | |||
− | |||
− | |||
− | + | ===== Using DirectML with Joey's fork ===== | |
− | + | [https://upscale.wiki/wiki/Using_DirectML_with_ESRGAN Work in Progress Tutorial] | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
== Tips when using ESRGAN == | == Tips when using ESRGAN == |
Latest revision as of 01:51, 31 October 2021
Make sure that you have followed the installation guide carefully (Windows, Arch Linux, MacOS). We support BlueAmulets fork offically, not the current ESRGAN branch from xinntao, if you use that one, you will get errors. |
Now that you have installed ESRGAN you can upscale images. There are a few different ways of using ESRGAN. Below I will document the official one. This should work for everyone, but there are a few different applications designed to make the life of the users easier as well as to prevent common pitfalls of using ESRGAN.
Contents
Things you need to know before you use ESRGAN
- ESRGAN supports only RGB images, that means it will remove alpha / transparency channels if present and it won't work with grayscale images.
- ESRGAN is limited by the amount of VRAM you have.
But there are ways around both. At the time of writing this there are some popular tools used by a lot of us to solve this:
Tools / Ways to use ESRGAN
GUI Tools
Cupscale (Wiki) (GitHub)
Cupscale is a young ESRGAN GUI that's built with usability in mind.
Advantages
- Run ESRGAN on CPU, Nvidia GPU or even AMD GPUs using Vulkan
- Interpolate models on-the-fly (no need to create extra model files)
- Create multiple types of comparisons
- Batch upscale entire folders
- Upscale GIFs and even videos
- Multiple seamless modis are available
- Supports many image formats including JPEG, PNG, WEBP, DDS, and more
Disadvantages
- No cross platform support
IEU - Image Enhancement Utility (GitHub)
IEU has been used by many people and is considered mature, but if you encounter bugs or have feature requests, feel free to report them on Discord, or on GitHub repository by creating an issue. The Download is under the IEU.Winforms Releases tab. Please take a bit of your time to read IEU wiki first.
Advantages
- Process any amount of images with all models you select via check-boxes
- Control over the output format and naming scheme
- Can use a different model for the alpha channel
- Can upscale each channel separately (Red, Green, Blue and Alpha)
- This is useful for non diffuse textures, so normal maps (_n.dds typically), specular maps, ...
- Can interpolate different models right in the GUI
Disadvantages
- No cross platform support
CLI Tools
Joey's ESRGAN (Wiki) (GitHub)
Advantages
- Cross-Platform
- Works on headless systems
- Auto splits and merges images in memory
- Multiple seamless modis are available
- It can chain models
- As with any CLI tool, you can easily script around it to add further features.
Disadvantages
- You have to enter the full model names if you don't wrap a script around it
- CLIs can feel intimidating to those unused to them
Using DirectML with Joey's fork
Tips when using ESRGAN
- When upscaling compressed textures use a 1x decompression model for the format first and or downscale them first by at least 50% with ,code>nearest neighbor or
box
filtering first, before upscaling them in ESRGAN - ESRGAN runs much faster on Nvidia GPUs, you can compile pytorch yourself for AMD GPUs but at the moment that is quite difficult to do
- If you run out of VRAM, use Deorder’s scripts or IEU, which will split the texture in smaller parts first
- If you have textures in sub-folders, use Deorder’s scripts or IEU with "Preserve folder structure" mode selected
- If your textures contain an alpha channel (transparency), use Deorder’s scripts or IEU
- Try out different models. In our Model Database you will find a lot of different models, that we trained ourself
- If you are still not happy with the results despite having tried out different models, consider training your own and sharing it with us later
Additional Notices
Windows
- When upscaling large images (depending on your GPU for example 1000x1000px images) on Windows, it's possible for the operating system to kill the ESRGAN process if it takes too long. This can be fixed using the Nvidia Nsight Monitor app that is installed alongside the CUDA toolkit. Here are Instructions for doing so