This work proposes a novel attention mechanism called micro-attention cooperating with residual network that enables the network to learn to focus on facial areas of interest covering different action units and pushes the boundary of automatic recognition of micro-expression.