Why do people think Rembrandt's The Night Watch is a night scene?

Although informally called "The Night Watch," the only reason people think it's a night scene is because what painter covered it in varnish?