Due to the data sparseness problem, the lexical information from a treebank for a lexicalized parser could be insufficient. This paper proposes an approach to learn head-modifier pairs from a raw corpus, and to integrate them into a lexicalized dependency parser to parse a Chinese Treebank. Experimental re-sults show that this approach not only enlarged the coverage of bi-lexical de-pendency, but also improved the accuracy of dependency parsing significantly.