[Bio] [Blog] [Deliverable #1: Compare Basic Summarizer to Centroid-Based Summarizer using ROUGE] [Deliverable #2: Create a Dutch Stemmer for the Yioop Search Engine] [Deliverable #3: Create a New Summarizer for the Yioop Search Engine] [Deliverable #4: Term Frequency Weighting in the Centroid-Based Summarizer] [Deliverable #1: Test Yioop Summarizers Against a Large Data Set] [Deliverable #2: Improve the ROUGE Results for Dr. Pollett's Summarization Algorithm] [CS 299 End of Fall 2015 Semester Summary] [Deliverable #3: A Numerically Stable Lanczos Text Summarization Algorithm] [Deliverable #4: Improving Text Summarization using Automatic Sentence Compression] |
## A Numerically Stable Lanczos Text Summarizaton Algorithm## AimThe goal of this deliverable is to create a numerically stable version of the Lanczos text summarization method, integrate it into the Yioop search engine and report its ROUGE results. ## OverviewI originally proposed working with the text summarization algorithm sold to Yahoo written by Nick D’Aloisio. Unfortunately, the algorithm is not publically available. Stuck looking for a non-traditional text summarization algorithm, we stumbled upon the Lanczos algorithm. The idea to attempt to use the Lanczos algorithm came from the work of one of Dr. Pollett’s previous students Youn Kim. The Lanczos method is “a technique that can be used to solve certain large, sparse, symmetric eigenproblems Ax = λx.”[GOLUB1996] The Lanczos algorithm solves these Eigen problems by splitting the initial frequency matrix into three matrices. “An orthogonal matrix U, a diagonal matrix S, and the transpose of an orthogonal matrix V” [Kim2010]. However, there is a down side to the Lanczos algorithm. Roundoff errors calculated during the run of the algorithm cause it to be numerically unstable. “The central problem is a loss of orthogonality among the Lanczos vectors that the iteration produces” [GOLUB1996]. In other words, the Lanczos cannot break the matrices down quick enough to keep the numbers stable. ## Work PerformedThe first thing I did was download Java code from Youn Kim’s Master’s Thesis webpage and execute it. The Java code was able to summarize his sample text perfectly. All it took for me to make it numerically unstable was to add a few lines to his sample text. Once I had a handle on what output results I was to expect from Youn’s Java code, I began converting it to PHP for use in the Yioop search engine. After I converted all of the Java code to PHP and overcame the subtle differences between Java and PHP, I was ready to make the algorithm numerically stable and integrate it into the Yioop search engine.
While doing my research on ways to make the Lanczos method stable, I came across a paper written by Ani Nenkova and Kathleen McKeown called In addition to the work done by Gong and Liu, work by Ben Hachey, Gabriel Murray and David Reitter is also mentioned in the Nenkova and McKeown paper. Unluckily, the Hachey, Murray and Reitter method only applies to summarizing multiple documents into one. They attempt to use term frequencies from multiple documents to create the initial matrix which may allow the calculations downstream in the Lanczos algorithm to maintain stability. If you are not familiar with what we are doing here, we are doing single document summarization so their idea does not apply to our problem. Plus the issue is really targeted towards stabilizing the SVD generation.
With two strikes under my belt, I thought I would give it one last try. I found a book called ## ResultsIn conclusion, the three attempts to provide a numerically stable version of the Lanczos method were unsuccessful. The idea to use matrix manipulation to generate summaries is very non-conventional, which is what we were looking for, but it is not a viable approach. Thus I will not be able to deliver a summarizer to integrate into Yioop or produced its ROUGE results. ## References[GOLUB1996] Matrix Computations. Gene H. Golub, Charles F. Van Loan. The Johns Hopkins University Press. 1996. [Hachey2006] Dimensionality Reduction Aids Term Co-Occurrence Based Multi-Document Summarization. Ben Hachey, Gabriel Murray, David Reitter. Proceedings of the Workshop on Task-Focused Summarization and Question Answering, pages 1 – 7. Association for Computational Linguistics. 2006. [Gong2001] Generic Text Summarization Using Relevance Measure and Latent Semantic Analysis. Yihong Gong, Xin Liu. Special Interest Group on Information Retrieval. ACM. 2001. [Nenkova2011] Automatic Summarization. Ani Nenkova and Kathleen McKeown. Foundations and Trends in Information Retrieval Vol 5. 2011. [Kim2010] Text Summarization Using Lanczos Algorithm. Youn sang, Kim. San Jose State University. . 2010. |