Patent AU-2020202660-B2 (AU)
Title: Image Modification Styles Learned from A Limited Set of Modified Images
Inventor: WILENSKY GREGG
IPC: G06T5/50
Filed: 2020-04-21
Granted: 2021-11-18
Abstract: Image modification styles learned from a limited set of modified images are 
described. A learned style system receives a selection of one or more modified images 
serving as a basis for a modification style. For each modified image, this system creates 
a modification memory, which includes a representation of the image content and 
modification parameters describing modification of this content to produce the modified 
image. These modification memories are packaged into style data, used to apply the 
modification style to input images. When applying a style, the system generates an 
image representation of an input image and determines measures of similarity between 
the input image's representation and representations of each modification memory in 
the style data. The system determines parameters for applying the modification style 
based, in part, on these similarity measures. The system modifies the input image 
according to the determined parameters to produce a styled image.
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
100 --
c W 1215PM carrer 12:15PM 
112 116 
114 114 
Apply Style Undo Done 
L--~Y
Computing Device 102 
Content Editing Application 104 
Learned Style System 118 
Digital Visual Content 106 
112 Nerk 
Style Data120
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
200 
Modified Image 202 
Image Content 204 
Modification Parameters 206 
Learned Style System 118 
Representation Module 212 
Image Representation 216 
Style Generation Module 214 
Particular Style Data 208 
Modification Memory 210 
Image Representation 216 
(Modification Parameters 206
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
300 
Single-Image Style Data 302 
Modification Memory 304 
Image 
Representation 
306 
Modification 
Parameters 
308 
Multi-Image Style Data 310 
First Mod. Memory 312 Nth Mod. Memory 314 
First Image N th Image 
Representation Representation 
316 320 
First Modification N th Modification 
Parameters Parameters 
318 322
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
400 
412O 
406 l Carrier 12:15 PM 402 
Select One o rMore Images to Create Style 
Zia- 410 
408 
404 
"Abstract Beach" Style 
Modified Images Selec : 
41
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
500 
Input Image 502 
Multi-Img. Style Data 310 Learned Style System 118 
First Mod. Mem. 312 
First Image Representation Module 212 
Representation 
316 
Input Image Representation 510 
FirstModfcto 
Parameters 
Representation Comparison Module 504 
NthMod. Mem. 314 
N h Image Style Image Similarities 512 
Representation 
N t Modification Parameter Determination Module 506 
Parameters 
322 
Determined Parameters 514 
Parameter Application Module 508 
( Styled Image 516
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
600 
604 
604 
604 
602 
606 
604 
608 604 
610 
604
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
700 
702 
Obtain one or more modified images to serve as a basis for a modification 
style, each of the modified images including image content depicting a 
scene before modification and modification parameters describing the 
modification to the image content to produce the modified image 
704 
Generate image representations of the image content of the one or more 
modified images, an image representation comprising reduced information 
representative of the image content rather than a pixel-by-pixel entirety of 
the image content 
706 
Generate a modification memory for each of the one or more modified 
images, the modification memory including a respective image 
representation and respective modification parameters 
708 
Generate style data that includes the generated modification memories 
710 
Maintain the style data in storage to apply the modification style to a 
subsequent image
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
800 
802 
Obtain an input image 
804 
Receive a selection of a modification style to apply to the input image, the 
modification style corresponding to style data which includes one or more 
modification memories of modified images selected to serve as a basis for 
the modification style 
806 
Generate a representation of the input image comprising reduced 
information representative of the input image's depicted content rather 
than a pixel-by-pixel entirety of the input image's depicted content 
808 
Determine a measure of similarity between the representation and image 
representations included in the one or more modification memories 
810 
Determine parameters for applying the modification style to the input 
image based, in part, on determined measures of similarity and 
modification parameters included in the one or more modification 
memories 
812 
Modify the input image according to the determined parameters to 
produce a styled image having the modification style
Inventor: Gregg Wilensky 
Title: Image Modification Styles Learned from a Limited Set of Modified Images 
900 
Platform 916 
Resources 918 
Cloud 
914 
Computing Device 902 
Processing Computer-readable 
System 904 Media 906 
Hardware Memory/ 
Elements 910 Storage 912 
1/O 
Interfaces 908 
Learned Style System 118