Treebank is a text corpus with syntactic annotation. It records the syntactic tree, i.e. the syntactic parse, of every sentence in running texts. Since 1990s, automatic parsing of natural languages has again become the focus of the international community of computational linguistics, and one of the crucial reasons is the realization of the Penn Treebank (PTB). The performances of statistical parsers, which are based on automatically induced Probabilistic Context-Free Grammar (PCFG), outperform significantly those rule-and unification-based parsers. A Treebank of any language in the world, represented with either phrase structures or dependency structures, takes sentence as its basic description unit. Dependency Grammar is a lexicalized grammar; it denies the notion of phrase structures and describes only the various word-word relations in a sentence, in which the head-word is the dominant of a given relation, and the other word of the word-pair at stake is the dependent of the head. Dependency Grammar creates a transparent interface between the dependency syntax and semantics of a language. This paper highly estimates the life force of the sentence-based syntax and the head-driven sentence analyzing method advocated by Jinxi Li, because they have not only dominated grammar teaching in middle schools more than half century before and after the foundation of the People’s Republic of China, but also guides the treebanking practice today.