You can only insert as full image in your content.
Please see my screen-cast
It will not work if you use it as featured image or in any other element.
This is because the image will be cropped and it will not be animated again.
WordPress does not have the ability to crop gif and let it remain animated.