2

I already know that AI can paint, by using genetic algorithms, there are already lots of works such as this and this. In addition, I also know AI can compose: Song from PI: A musically plausible network for pop music generation (genetic algorithm too).

But what I find interesting is not painting those ambiguity/abstract paintings.

The not abstract painting flow I think is (just for example):

  1. at least training AI with superman's comic

  2. give AI a very simple posture sketch of a standing human

  3. AI paint it to superman.

Currently, I don't know if there is any way/guide/thought/algorithm can teach AI to paint a superman like the comic (not abstract ones). I'd like to research this area but can't find where and how to start.

Dennis Soemers
  • 10,519
  • 2
  • 29
  • 70
Mithril
  • 121
  • 4

1 Answers1

1

This paper (that was featured in another question), StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks describes some techniques similar to what you described in the question. Instead of comics, the system in the paper is trained on a database of nature photos (birds or flowers) combined with text descriptions of each photo. It will then draw an "imaginary" bird or flower based purely on a text description. It does this in two steps: it the first, it picks a posture for the depicted subject (I believe randomly...) and roughs out patches of color that match the described features of the subject in the selected posture. It then refines the sketch, again using the text description for parameters, until it appears "photo-realistic" in the style of the training photos. It does not just recreate its training images; instead, it is able to recreate features of its training images with different positions/colors.

Community
  • 1
antlersoft
  • 607
  • 4
  • 6