Loading...

Trainable Loss Weights for Image Super-Resolution

Chaichi Mellatshahi, Arash | 2023

71 Viewed
  1. Type of Document: M.Sc. Thesis
  2. Language: Farsi
  3. Document No: 56071 (19)
  4. University: Sharif University of Technology
  5. Department: Computer Engineering
  6. Advisor(s): Kasaei, Shohreh
  7. Abstract:
  8. Image super-resolution is the process of estimating a high-quality image from a low-quality image. With the growth of remote sensing images, computer games, and the development of artificial intelligence applications in medical image analysis, research in this area of machine vision has seen significant growth. In recent years, research on super-resolution has primarily focused on the development of unsupervised models, blind networks, and the use of optimization methods in non-blind models. However, limited research has discussed the loss function in the super-resolution process. The majority of those studies have only used perceptual similarity in a conventional way. This is while the development of appropriate loss can improve the quality of other methods as well. In this thesis, a new weighting method for pixel-wise loss is proposed. With the help of this method, it is possible to use trainable weights based on the general structure of the image and its perceptual features while maintaining the advantages of pixel-wise loss. Also, a criterion for comparing weights of loss is introduced so that the weights can be estimated directly by a convolutional neural network using this criterion. In addition, in this research, the expectation-maximization method is used for the simultaneous estimation super-resolution network and weighting network. In addition, a new activation function, called ”FixedSum”, is introduced which can keep the sum of all components of vector constants while keeping the output components between zero and one. As shown in the experimental results section, weighted loss by the proposed method leads to better results than the unweighted loss in both signal-to-noise and perceptual similarity metrics on HAT, RCAN, VDSR and EDSR networks in the datasets of Set5, Set14, Urban100, BSDS100, and Magna109
  9. Keywords:
  10. Super-Resolution ; Loss Function ; Expectation Maximazation Algorithm ; Convolutional Neural Network ; Perceptual Similarity ; Image Super-Resolution

 Digital Object List

 Bookmark

  • مقدمه
    • تعریف مسئله
    • اهمیت موضوع
    • اهداف پژوهش
    • ساختار پایان‌نامه
  • کارهای پیشین
    • بهبود معماری شبکه‌های عصبی ژرف در فراتفکیک‌پذیری
    • زوج تصویر واقعی
    • شبکه‌های فراتفکیک پذیری غیرکور
    • شبکه‌های فراتفکیک‌پذیری کور
    • یادگیری تصاویر غیر جفت
    • معیار ارزیابی و توسعه خطا
    • جمع‌بندی
  • روش پیشنهادی
    • معیاری برای وزن‌های خطا
    • شبکه‌ی وزن‌دهی
    • بهینه‌سازی همزمان شبکه‌ی فراتفکیک‌پذیری و وزن‌دهی
    • جمع‌بندی
  • نتایج
    • مقدمه
    • تعیین پارامتر k در طی آموزش
    • بررسی عملکرد تابع فعال‌سازی FixedSum در شبکه‌ی وزند‌هی
    • تفاوت روش پیشنهادی با خطای افزوده
    • مقایسه روش وزن‌‌های آموزش پذیر خطا با خطای بدون وزن درمقیاس‌ها و معماری‌های مختلف
    • مقایسه روش وزن‌‌های آموزش پذیر خطا با وزن‌دهی خطا برمبنای عدم قطعیت
  • نتیجه‌گیری
    • پیشنهاداتی برای پژوهش‌های آتی
  • واژه‌نامه
...see more