No, it's less to do with "time" (though still relevant) more to do with the reason for the gesture...
Don't try to hard to think, it's quite easy. There's one reason he is making that gesture, and it's not to tell the time.