Question

Part 1 - Word Counts **Read in the text file** - In the cell below, read the #gettysburg_address.txt* file into Python. In [ ]: Question: What is the difference between read() and readlines()? Type Markdown and LaTeX: a? Split the text - Split the text into a list of individual words. This process is called tokenization and is a common data pre-processing step when working with any text data. In [ ]: Create a dictionary - Initialize an empty dictionary to hold the word counts. In [ ]: Populate your dictionary - Iterate over your list of words and update the word counts for each word in the text. In [ ]: Sort your word count dictionary - Dictionaries are unordered collections in Python. You will need to find a way to sort the dictionary by its values. Save the sorted output to a new variable. Example output: Dictionary: ('of': 14, 'was: 5, 'The': 27} Sorted output: ('The', 27), ('of, 14), ('was', 5) In [ ]: Question: How does items() return the dictionary key-value pairs? Type Markdown and LaTeX: a? Print out the top 10 most used words. In [ ]: Bonus - Your script will consider 'The' and 'the' to be separate words. Likewise, 'war' and war.' (note the period) will be considered differently. Before adding your words to the dictionary, clean up the text to remove capitalization and punctuation.

Four score and seven years ago our fathers brought forth on this continent, a new nation, conceived in Liberty, and dedicated to the proposition that all men are created equal.
Now we are engaged in a great civil war, testing whether that nation, or any nation so conceived and so dedicated, can long endure. We are met on a great battle-field of that war. We have come to dedicate a portion of that field, as a final resting place for those who here gave their lives that that nation might live. It is altogether fitting and proper that we should do this.

But, in a larger sense, we can not dedicate - we can not consecrate - we can not hallow - this ground. The brave men, living and dead, who struggled here, have consecrated it, far above our poor power to add or detract. The world will little note, nor long remember what we say here, but it can never forget what they did here. It is for us the living, rather, to be dedicated here to the unfinished work which they who fought here have thus far so nobly advanced. It is rather for us to be here dedicated to the great task remaining before us - that from these honored dead we take increased devotion to that cause for which they gave the last full measure of devotion - that we here highly resolve that these dead shall not have died in vain - that this nation, under God, shall have a new birth of freedom - and that government of the people, by the people, for the people, shall not perish from the earth.

Answer 1

difference between read() and readlines() is that read() return the n bytes of data from the file where n is specified inside the read().,if no parameter is passed it reads the entire path.

while readlines() reads all the lines in file and makes a list of it and returns it.

code for the above question -

 # function to get top 10 used words in file def solve(content): # splitting contents on the basis of comma(,) words = content.split(',') # join contents as string to further split according to spaces and storing in l as list l = ''.join(words).split(' ') # dictionary initialization dic = {} # storing word and its count in dictionary for i in l: # if word is in dictionary increase its count +1 if i in dic: dic[i]+=1 # if word not in dictionary,add it to dictionary and set count=1 else: dic[i]=1 # sorting dictionary according to the value in key,value pair in reversed order using lambda function # and storing into new sorted dictionary # here dic.items returns the total items or dictionary as list of (key,value) pair # key = lambda item: item[1] means sorting according to the second value in tuple. sorted_dictionary = {key: value for key,value in sorted(dic.items(), key=lambda item: item[1],reverse= True)} # priting the top 10 most occurred items from dictionary by cocnverting it into list first. print({key: sorted_dictionary[key] for key in list(sorted_dictionary)[:10]}) # openning file using with keyword in read mode with open("gettysburg_address.txt", "r") as f: # splitting contents of file on the basis of new line and storing in variable contents = f.read() print(contents) # passing contents list as string to the function for further processing solve(''.join(contents))

solve.py X solve.py > solve 1 # function to get top 10 used words in file def solve(content): # splitting contents on the basis of comma(,) words = content.split(',') # join contents as string to further split according to spaces and storing in 1 as list 1 = ".join(words).split('') # dictionary initialization dic = {} # storing word and its count in dictionary for i in 1: # if word is in dictionary increase its count +1 if i in dic: dic[i]+=1 # if word not in dictionary, add it to dictionary and set count=1 else: dic[i]=1 # sorting dictionary according to the value in key, value pair in reversed order using lambda function # and storing into new sorted dictionary # here dic.items returns the total items or dictionary as list of (key, value) pair # key = lambda item: item[1] means sorting according to the second value in tuple. sorted dictionary = Kkey: value for key, value in sorted(dic.items(), key=lambda item: item(1), reverse= True) # priting the top 10 most occurred items from dictionary by cocnverting it into list first. print(key: sorted_dictionary[key] for key in list(sorted_dictionary :101) 28 29 30 # openning file using with keyword in read mode with open("gettysburg_address.txt", "r") as f: # splitting contents of file on the basis of new line and storing in variable contents = f.read().split('\n') # passing contents list as string to the function for further processing solve("'.join(contents))

output -

PS C:\Users\dell(OneDrive\Desktop> python solve.py {"that': 13, 'the': 9, 'to': 8, 'we': 8, 'a': 7, "here': 7, '-': 7, "and": 6, 'nation': 5, 'can': 5 PS C:\Users\dell OneDrive\Desktop>

python returns key,value pairs as tuple when dictionary.items() is called.

dic.items() = {list of (key,value) in dic}

if my answer helped then please upvote and comment for any queries

thankyou!