Question

[Question 5, 16 points total, including 5.1-5.4] Assume we received two search strings when running a search engine, string 1: ABRACADABRA string 2: BRICABRAC 5.1 (6 points) if we are using a 2-character shingle, how many 2-character shingles string 1 and 2 each has? your answer: 5.2 (3 points) what would be the universal 2-shingle word set created by these two strings? your answer: 5.3 (3 points) Which spark language construct(s) can help us to create this universal set? what method one can use to access/retrieve this universal set? your answer: 5.4 (4 points) express the two search strings as vectors based on the universal word set you have identified in 5.2 your answer:

Answer 1

Solution :

String 1 : ABRACADABRA

String 2 : BRICABRAC

5.1 2- character shingle for each string 1 and 2

String 1: {AB,BR,RA,AC,CA,AD,DA} COUNT = 7

String 2 : {BR,RI,IC,CA,AB,RA,AC} COUNT = 7

5.2 universal 2-shingle word set created by these strings

Universal 2-shingle set : {AB,BR,RA,AC,CA,AD,DA,RI,IC} COUNT = 9