Question

Create a class called DuplicateRemover. Create an instance method called remove that takes a single parameter called dataFile (representing the path to a text file) and uses a Set of Strings to eliminate duplicate words from dataFile. The unique words should be stored in an instance variable called uniqueWords. Create an instance method called write that takes a single parameter called outputFile (representing the path to a text file) and writes the words contained in uniqueWords to the file pointed to by outputFile. The output file should be overwritten if it already exists, and created if it does not exist.

Create a separate class called Application that contains a main method which illustrates the use of DuplicateRemoverby calling both the remove and write methods. Your input file must be called problem1.txt and your output file must be called unique_words.txt.

Your program should work on any text file. The TA's will provide their own version of problem1.txt when they run your code.

In java

Answer 1

//Application Class

public class Application {

    public static void main(String[] args) {

      DuplicateRemover dr = new DuplicateRemover();

      dr.remove("problem1.txt");

      dr.write("unique_words.txt");

    }

   

}

//DuplicateRemover Class

import java.io.BufferedReader;

import java.io.BufferedWriter;

import java.io.File;

import java.io.FileReader;

import java.io.FileWriter;

import java.io.IOException;

import java.util.Iterator;

import java.util.LinkedHashSet;

public class DuplicateRemover {

    private LinkedHashSet<String> uniqueWords;

    public DuplicateRemover() //constructor that initializes uniqueWords

    {

        uniqueWords = new LinkedHashSet<>();

    }

    public void remove(String dataFile) {

        File f1 = new File(dataFile);

        FileReader fr = null;

        BufferedReader br = null;

        try {

            fr = new FileReader(f1); //Creation of File Reader object

            String[] words = null;

            String s;

            br = new BufferedReader(fr); //Creation of BufferedReader object

            while ((s = br.readLine()) != null) //Reading Content from the file

            {

                s = s.replaceAll("[.,?!)(]", " "); //eliminate fullstops, commas, etc

                words = s.split("\\s+"); //Split the word using space, multiple spaces treated as one using regex

                for (String word : words) {

                    uniqueWords.add(word.toLowerCase()); //add word to set, set doesn't contain duplicate elements

                }

            }

        } catch (IOException ex) {

            System.err.println(ex.getMessage());

        } finally {

            //close everything that's opened

            try {

                if (fr != null) {

                    fr.close();

                }

                if (br != null) {

                    br.close();

                }

            } catch (IOException ex) {

            }

        }

    }

    public void write(String outputFile) {

        BufferedWriter out = null;

        Iterator it = uniqueWords.iterator();

        try {

            out = new BufferedWriter(new FileWriter(outputFile));

            while (it.hasNext()) {

                out.write(it.next().toString());

                out.newLine(); //write next word on a new line

            }

        } catch (IOException ex) {

        } finally {

            try {

                if(out!=null)

                    out.close();

            } catch (IOException ex) {

            }

        }

    }

}

Code screenshots:

Application Class

public class Application { public static void main(String[] args) { DuplicateRemover dr = new DuplicateRemover(); dr.remove ("probleml.txt"); dr.write("unique words.txt");

DuplicateRemover Class
import java.io. BufferedReader; import java.io. BufferedWriter; import java.io.File; import java.io.FileReader; import java.io.FileWriter; import java.io.IOException; import java.util.Iterator; import java.util.LinkedHashSet; public class DuplicateRemover { private LinkedHashSet<String> uniqueWords; public DuplicateRemover() //constructor that initializes uniqueWords uniqueWords = new LinkedHashSet<>(); public void remove (String data File) { File f1 = new File (data File); FileReader fr = null; BufferedReader br = null; try { fr = new FileReader (fl); // Creation of File Reader object String[] words = null; String s; br = new BufferedReader (fr); // Creation of BufferedReader object while ((s = br.readLine()) != null) //Reading Content from the file s = s.replaceAll("[.,?!) ( ", " "); //eliminate fullstops, commas, etc words = s.split("\\s+"); // Split the word using space, multiple spaces treated as one using regex

for (String word : words) { uniqueWords.add (word. toLowerCase()); //add word to set, set doesn't contain duplicate elements } } catch (IOException ex) { System.err.println(ex.getMessage()); } finally { //close everything thats opened try { if (fr != null) { fr.close(); if (br != null) { br.close(); } catch (IOException ex) { public void write (String output File) { BufferedWriter out = null; Iterator it = uniqueWords.iterator(); try { out = new Bufferedwriter (new FileWriter (output File)); while (it.hasNext()) { out.write(it.next().toString()); out.newLine(); //write next word on a new line } catch (IOException ex) { } finally {

try { if (out!=null) out.close(); } catch (IOException ex) {

Input file: problem1.txt

problem 1.txt - Notepad Eile Edit Format View Help Create a class called DuplicateRemover. Create an instance method called remove that takes a single parameter called dataFile (representing the path to a text file) and uses a set of strings to eliminate duplicate words from datafile. The unique words should be stored in an instance variable called uniquewords. Create an instance method called write that takes a single parameter called output File (representing the path to a text file) and writes the words contained in uniquewords to the file pointed to by outputFile. The output file should be overwritten if it already exists, and created if it does not exist. Create a separate class called Application that contains a main method which illustrates the use of DuplicateRemoverby calling both the remove and write methods. Your input file must be called problemi.txt and your output file must be called unique_words.txt. Your program should work on any text file. The TA's will provide their own version of problem1.txt when they run your code. In java

Output file: unique_words.txt

10 unique_words.txt X create 2 a 3 class called 5 duplicateremover an instance 8 method remove that 11 takes 12 single parameter 14 datafile representing 16 the 17 path 18 to 19 text 20 file and uses set of strings 26 eliminate duplicate words from 30 unique 31 should 32 be stored in variable 36 uniquewords 37 write 38 outputfile 39 writes 40 contained 41 pointed 42 by 25 27 29 33 34 35

60 62 unique_words.txt 43 output 44 overwritten 45 if 46 it already 48 exists 49 created 50 does 51 not 52 exist 53 separate application contains 56 main 57 which 58 illustrates 59 use duplicateremoverby 61 calling both 63 methods 64 your 65 input 66 must 67 problemi txt 69 unique words program 71 work 72 on 73 any 74 ta's 75 will 76 provide 77 their 78 own 79 version when 81 they run 83 code 84 java 70 80 82