D2S2: Drag 'n' Drop Screen Search

People
Christoph Csallner
Don Dang
Soumik Mohian
Tony Tang
Tuan Trinh
Code
D2S2 drag 'n' drop screen search

Papers

D2S2: Drag 'n' drop mobile app screen search. Proc. 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), Demonstrations Track, 2023. (GitHub, YouTube)
D2S2 is the first interactive drag-and-drop search engine for mobile app screenshots. D2S2 encodes text queries and the location, size, and icon type of the icons a user dragged on D2S2's UI. In a preliminary experiment D2S2 produced significantly more relevant search results than Google Image Search.