Uncovering compositional structure in neural networks

Language description: Only consonant-vowel syllables are allowed; delete sounds as needed to make this happen.
Input Correct output Meta-initialized
model's output		 Randomly-initialized
model's output
rOau .rO.a.u. .rO.a.u. .rO.a.u.
axxaO .a.xa.O. .a.xa.O. .a.xa.O.
rxxa .xa. .xa. .xa.
axrxu .a.xu. .a.xu. .a.xu.
ttxaO .xa.O. .xa.O. .xa.O.
Input rOau axxaO rxxa axrxu ttxaO
Correct output .rO.a.u. .a.xa.O. .xa. .a.xu. .xa.O.
Meta-initialized
model's output		 .rO.a.u. .a.xa.O. .xa. .a.xu. .xa.O.
Randomly-initialized
model's output		 .rO.a.u. .a.xa.O. .xa. .a.xu. .xa.O.

Introduction: No duplication without representation