In this assignment you will automatically "colorize" face images using a large
data base of face images. The algorithm will procceed as follows. Given a
grayscale query image, match that image to a large training set of color
images. Transfer the color from matched image to the query image.
Face image data is online here. Images in the testset directory are your grayscale query images. Images in the trainset directory are your large data base of color training images. Your task is to compute colorizations for each query image using the training data base.
Some parameters you should explore in your assignment are:
Additional details can be found in the "80 million tiny images" reference
You may observe some artifacts in your resulting colorized images. You should explore enhancements to the basic colorization algorithm to deal with these artifacts. There is no single answer here and you will be graded on your ideas for enhancements and quality of your results.
Some possible ideas might be: using information from a set of similar data base images to colorize your image, transfering color from parts of matching images rather than the complete image, estimating better feature based alignments prior to colorization, merging the results with other work on colorization (e.g. "Colorization Using Optimization - code available), performing colorization on entire people (whole bodies rather than just faces) or other categories (e.g. landscapes or product images).
To turn in your assignment, email your commented code, readme, and a webpage or pdf showing results to email@example.com. If you create a webpage and it is too large to send via email, please also submit a small version (print out of the page or icon sized images) via email!
Use both words and images to show us what you've done. Please:
The core assignment is worth 100 points, as follows: