Question

Do writings by individual authors have statistical signatures? They certainly do, and while such signatures say little about an author's art, they can say something about literary styles of an era, and can even help clarify historical controversies about authorship. Statistical studies, for example, have shown that the Illiad and the Odyssey were not written by a single individual.

For this assignment you are to create a program that analyzes text files -- novels perhaps, or newspaper articles -- and produces two statistics about these texts: word size frequency, and average sentence length.

In particular, you should write a two class application that produces such statistics. Your classes should be called WordMap.java, and WordMapDriver.java. The driver class should read in the name of a file that holds a text, and then provide an analysis for that text. Here is a sample:


> java WordMapDriver
enter name of a file
Analyzed text: /Users/moll/CS121/AliceInWonderland.txt
words of length 1: 7.257%
words of length 2: 14.921%
words of length 3: 24.073%
words of length 4: 20.847%
words of length 5: 12.769%
words of length 6: 7.374%
words of length 7: 6.082%
words of length 8: 3.012%
words of length 9: 1.812%
words of length 10: 0.820%
words of length 11: 0.501%
words of length 12: 0.236%
words of length 13: 0.134%
words of length 14: 0.083%
words of length 15 or larger: 0.001%
average sentence length: 16.917


Your job, then, is to code a solution to this problem, and provide these two statistics - word size percentage, and average sentence length (thus in the example given, 7.257 percent of the words are of length 1, 14.921 percent of the words are of length 2, and so forth, and the average sentence length is 16.917 words).

You can obtain interesting sample texts by, for example, visiting the Gutenberg foundation website (Gutenberg.org), and downloading books from there.

Tips

You should read external files by extending the Echo class from Chapter 10.

An easy and acceptable way to calculate the average length of sentences: count the number of words, count the number of end-of-sentence markers -- !,.,?, then divide the first by the second. Thus if a text has 21 words and 2 periods and a question mark, then its average sentence length is 7.

Show percentages using printf, as described in Chapter 5 of the text. Precision: as above in the example, 3 places to right of decimal point. To include a % symbol in a format string, include two percent symbols. The control character \n generates a carriage return. This statement:

System.out.printf("%4.2f%%\n",40.23);

prints

40.23%

and then advances to the next line.


Additional Requirements

You must use a try/catch harness for your WordMapDriver code.

You must use The String method split to extract the individual words on each line of the text you are examining. In addition to the space symbol, use these characters as delimiters: ,.!?;:

You must comment your classes: add a one line comment for every method and for every instance variable. This comment should clearly state the role of that Java constituent.

Answer 1

Answer: Note: The class Echo is not given. So I implemented the WordMap class without using Echo class. //Import files import java.io.* import java.lang.* import java. util.*; //WordMap class class WordMap //Declare int sentenceMarkerCount-0: int wordCount 0 int[] wordLength; string filename //Define constructor public WordMap (String ip) filename=ip; wordLength-new int[151 //For loop for (int kk-0; kk<15; kk++)

wordLength[kk] 0; //Define method to read from file public void readFile () //Try try //Scanner Scanner mapSan-new Scanner (new File (filename)); string 1line; //Loop while (mapSan.hasNextLine ()) line-mapSan.nextLine) int tpk-0; //Loop to find sentence end markers for (int kk-0:kk<line.length )ikk++) char c-line.charAt (kk);

pxe.printStackTrace () //Define method to print data public void printStatisticsInfo () System.out.println ("Analysed text:"filename); //Loop for (int kk=0;kk< 14 ; kk++) System.out.printf ("words of length" (kk+1) %5 .3 f % % \n", ( (float) wordLength [kk] /wordcount) +1 00) System.out.printf ("words of length 15 or larger: %5 .3 f % % \n", ((float) wordLength [14] /wordcount) *1 00) System. out.printf ("Average sentence-length %5 .3 f % % \n", ( (float) wordcount/sentenceMarkerCou nt))

//WordMapDriver class public class WordMapDriver //main public static void main (Stringl args) String filename; Scanner tpSan=new Scanner (System.in); System. out.print("Enter name of a file:"); filename-tpSan.nextLine ); WordMap wm-new WordMap (filename) wm.readFile); wm.printstatisticsInfo ) Sample input file: sample.txt:

t won't indeed! said ATice, in a great hurry to change the subject of conversation. Are you--are y Sample output: sh-4.3s javac WordMapDriver.java sh-4.3S java WordMapDriver Enter name of a file:sample.txt Analysed text: sample.txt words of length 1: 6.000% words of length 2: 16.000% words of length 3: 20.000% words of length 4: 16.667% words of length 5: 18.000%

words of length 6: 7.3334 words of length 7: 6.667% words of length 8: 4.667% words of length 9: 2.667% words of length 10: 0.000% words of length 11: 0.667% words of length 12: 0.667% words of length 13: 0.667% words of length 14: 0.000% words of length 15 or larger : 0.000% Average sentence-length : 16.667%

Copyable code:

//Import files

import java.io.*;

import java.lang.*;

import java.util.*;

//WordMap class

class WordMap

{

//Declare

int sentenceMarkerCount=0;

int wordCount=0;

int[] wordLength;

String filename;

//Define constructor.

public WordMap(String ip)

{

filename=ip;

wordLength=new int[15];

//For loop

for(int kk=0;kk<15;kk++)

wordLength[kk]=0;

}

//Define method to read from file

public void readFile()

{

//Try

try

{

//Scanner

Scanner mapSan=new Scanner(new File(filename));

String line;

//Loop

while(mapSan.hasNextLine())

{

line=mapSan.nextLine();

int tpk=0;

//Loop to find sentence end markers

for(int kk=0;kk<line.length();kk++)

{

char c=line.charAt(kk);

if(c=='.'||c=='!'||c=='?')

tpk++;

}

sentenceMarkerCount+=tpk;

String[] tp=line.split(" ");

wordCount +=tp.length;

//Loop

for(int kk=0;kk<tp.length;kk++)

{

for(int aa=1;aa<15;aa++)

{

if(tp[kk].length()==aa)

wordLength[aa-1]++;

}

if(tp[kk].length()>=15)

wordLength[14]++;

}

}

//Close

mapSan.close();

}

//Catch

catch(Exception pxe)

{

    pxe.printStackTrace();

}

}

//Define method to print data

public void printStatisticsInfo()

{

System.out.println("Analysed text:"+filename);

//Loop

for(int kk=0;kk<14;kk++)

{

System.out.printf("words of length " + (kk+1) + ": %5.3f%%\n",((float)wordLength[kk]/wordCount)*100);

}

System.out.printf("words of length 15 or larger : %5.3f%%\n",((float)wordLength[14]/wordCount)*100);

System.out.printf("Average sentence-length : %5.3f%%\n",((float)wordCount/sentenceMarkerCount));

}

}

//WordMapDriver class

public class WordMapDriver

{

//main

public static void main(String[] args)

{

String filename;

Scanner tpSan=new Scanner(System.in);

System.out.print("Enter name of a file:");

filename=tpSan.nextLine();

WordMap wm=new WordMap(filename);

wm.readFile();

wm.printStatisticsInfo();

}

}