Doodle to App
- People
- Christoph Csallner
- Soumik Mohian
- Code
- Doodle2App
- Data
- DoodleUINet
- Drawing interface used to collect DoodleUINet
Papers
- Doodle2App: Native app code by freehand UI sketching.
Proc. 7th IEEE/ACM International Conference on Mobile Software
Engineering and Systems (MOBILESoft), Tool Demos and Mobile Apps Track,
2020.
(GitHub,
DoodleUINet data set,
GitHub to collect DoodleUINet,
slides)
-
We trained Doodle2App on thousands of (manually created)
freehand sketches of 20 common Android UI elements. The resulting
website allows users to sketch an Android screen. The website then
converts the sketched screen to Android code that is ready to compile
and run on stock Android phones. In technical terms: We pre-trained a
classifier on 2 million Google "Quick, Draw!" sketches and retrained the
classifier on thousands of sketches collected via Amazon Mechanical Turk.
In some sense the resulting tool is a modern version of SILK
("Sketching Interfaces Like Krazy").