At the moment the feedback for caps lock activated is a slightly brighter arrow. It is quite hard to see and could be improved quite simply. The brighter arrow is fine, but it could be more visual if you add a simple line above the arrow which indicates that caps lock is activated. Just as the original Swiftkey does.