Unified learning approach for egocentric hand gesture recognition and fingertip detection

•Unified approach to recognize egocentric hand gesture and detect fingertips.•Binary output of learning network as visible fingers in a gesture.•Introducing an ensemble of direct regression to predict fingertip position.•Experiments on known database and real-life images along with VR application.•Achieved highly accurate gesture classification and fingertip position.