The Big Programming Thread - Page 517

changes:
treenumber changed to horizontaldepth
added verticledepth variable
renamed pageInTree array to websitePosition
i.e. websitePosition(horizontalNumber) = verticleNumber 


create empty array websitePosition (array name)
create verticlenumber(variable that stores verticle depth) and set to 5
create horizontalnumber (variable that stores horizontal depth) and set to 0

preserve create array websitePosition(horizontalnumber) 5 (array depth0 with value of verticle5)


start

do


do while no checksortby (do while no extraction is needed)

if lastisfound = 0 and checknextlinkexists() then ' if no stopword + a new good link exists then

- jumping to checknextlinkexists()

we want to look for hyperlink with verticalposition equal to verticledepth value of the current horiztonaldepth array which atm is depth0
the 3rd check in the macro here looks for the stop word "last" which can be located at verticledepth -3 on a page

- jumping back from checknextlinkexists()

if no stopword + a new good link exists then

clickLink() ' dont do this yet: see below

we click on the link corersponding to verticlenumnber of the current horzitinalnumber

since we are entering a new horzitonaldepth we need to + this number now by adding a new array element of +1

BEFORE WE DO THIS we need to check if an array element of +1 already exists
we can do this by checking for the ubound (upperboundary) of the array and see if it matches the current array element
if it does match the current element then we need to add a new array element (see above)
if it does not match then we just straight increase the current array element horizontal number +1

we can do this check by comparing the current horizontalnumber to the ubound of the current websiteposition(horizontalnumber) array

if horizontalnumber = ubound(websiteposition) then 
we need to add a new array element

' CLICKLINK() MUST GO HERE BEFORE ALTERATIONS ARE MADE
set verticlenumber to 5
increase horizontalnumber by 1
redim preserve websiteposition(horizontalnumber)
websiteposition(horizontalnumber) = verticlenumber

if not then
' CLICKLINK() MUST GO HERE BEFORE ALTERATIONS ARE MADE
we need to increase horizontalnumber by 1

- jumping back from checkDeeperHorizontalPageAlreadyExists()

now we 

clickLink()

- jumping to clicklink()

click the link with position of the current arrayelement which will be 5 if a new unvisited page is detected or otherwise horizontal number +1

NO - WE NEED TO CLICKLINK BEFORE ALTERING OUR ARRAY SO CLICKLINK() GOES WITHIN checkDeeperHorizontalPageAlreadyExists() BEFORE ALTERATIONS ARE MADE

- jumping back from clicklink()

' renamed function to checkDeeperHorizontalPageAlreadyExistsAndClickLink()




Else if lastisfound = 0 then ' if stop word is NOT found but a new verticlelink is NOT found
THIS PROCESS OCCURS WHEN WE FINISH THE EXTRACTION PROCESS ON A PAGE AND DOES NOT OCCOUR AT ANY OTHER TIME
BECAUSE STOP WORDS ARE DETECTED OTHERWISE


we want to increase veritcleNumber by 1 because 
1) we have not currently hit a stop word
2) we want to go back 1 horizontal and down 1 verticle

- jumping to clickPreviousLink()

we reduce linknumber by 1 (dont know if this properly fully works but it has been so far so will have to see!!)

we want to reduce horizontaldepth by 1

so that when we next refer to the arrayelement it will be the -1 element

i dont think we need to use "redim" here or anything. we not altering the array or its elements we are just altering the way that we will 
refer to it in the future.

macro here clicks on previously stored url from linklist(linknumber) array

- jumping back from clickPreviousLink()



ElseIf lastisfound = 1  ' if stopword is detected

NOTE WE NEED A STOPWORD FOR EVERY SINGLE PAGE (MAYBE APART FROM EXTRACTION PAGE) THOUGH THESE WILL GENERALLY BE UNIFORM

if the stopword is detected then we need to 

reduce the linknumber by 1 to access earlier url from linklist array

then clickPreviousLink() 

and then RESET TO 5 the verticlenumber of the new array elemeent that results after clickPreviousLink()

we also reset the stopword checker variable to 0



end if

end loop

LATER REALISED THAT I NEED TO INCREASE VERTICLENUMBER HERE 
AND ALSO INSERT THIS NEW VERTICLENUMBER VALUE INTO THE CURRENT WEBPAGE(HORIZONTALNUMBER) ARRAY

extract()

loop