Machine learning-based prototyping of graphical user interfaces for mobile apps

K Moran, C Bernal-Cárdenas, M Curcio… - IEEE Transactions …, 2018 - ieeexplore.ieee.org
It is common practice for developers of user-facing software to transform a mock-up of a
graphical user interface (GUI) into code. This process takes place both at an application's …

Reverse engineering mobile application user interfaces with remaui (t)

TA Nguyen, C Csallner - 2015 30th IEEE/ACM International …, 2015 - ieeexplore.ieee.org
When developing the user interface code of a mobile application, in practice a big gap exists
between the digital conceptual drawings of graphic artists and working user interface code …

Systems, apparatuses and methods for generating a user interface by performing computer vision and optical character recognition on a graphical representation

TA Nguyen, C Csallner - US Patent 10,191,889, 2019 - Google Patents
US10191889B2 - Systems, apparatuses and methods for generating a user interface by
performing computer vision and optical character recognition on a graphical representation …

P2A: A tool for converting pixels to animated mobile application user interfaces

S Natarajan, C Csallner - … of the 5th International Conference on Mobile …, 2018 - dl.acm.org
Developing mobile applications is typically a labor-intensive process in which software
engineers manually re-implement in code screen designs, inter-screen transitions, and in …

Deep learning‐based prototyping of android GUI from hand‐drawn mockups

AA Abdelhamid, SR Alotaibi, A Mousa - IET Software, 2020 - Wiley Online Library
Recently, transforming graphical user interface (GUI) mockups into code becomes a
common challenging practice for current software developers. However, this transformation …

Prefab layers and prefab annotations: extensible pixel-based interpretation of graphical interfaces

M Dixon, A Nied, J Fogarty - Proceedings of the 27th annual ACM …, 2014 - dl.acm.org
Pixel-based methods have the potential to fundamentally change how we build graphical
interfaces, but remain difficult to implement. We introduce a new toolkit for pixel based …

Time domain disturbance observer based control of a quadrotor unmanned aerial vehicle

A Aboudonia, R Rashad… - 2015 XXV International …, 2015 - ieeexplore.ieee.org
This paper presents a time domain disturbance observer based controller applied to a
quadrotor unmanned aerial vehicle. The quadrotor stabilization performance, in its hovering …

PENNER: Pattern-enhanced nested named entity recognition in biomedical literature

X Wang, Y Zhang, Q Li, CH Wu… - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
Many biomedical entity mentions contain other entity mentions nested inside. Most current
named entity recognition (NER) systems deal with only flat entities and ignore such nested …

Rataplan: Resilient automation of user interface actions with multi-modal proxies

T Veuskens, K Luyten, R Ramakers - … of the ACM on Interactive, Mobile …, 2020 - dl.acm.org
We present Rataplan, a robust and resilient pixel-based approach for linking multi-modal
proxies to automated sequences of actions in graphical user interfaces (GUIs). With …

Anchored customization: anchoring settings to the application interface to afford customization

A Ponsard, J McGrenere - Proceedings of the 2016 CHI Conference on …, 2016 - dl.acm.org
The settings panel is the standard customization mechanism used in software applications
today, yet it has undergone minimal design improvement since its introduction in the 1980s …